-- Logs begin at Thu 2022-09-15 18:35:34 UTC, end at Thu 2022-09-15 19:34:49 UTC. -- Sep 15 19:02:59.976697 dv-cinder-849846-10-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 15 19:02:59.985771 dv-cinder-849846-10-smb devstack@keystone.service[81617]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 15 19:02:59.987904 dv-cinder-849846-10-smb devstack@keystone.service[81617]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Sep 15 19:02:59 2022] *** Sep 15 19:02:59.987904 dv-cinder-849846-10-smb devstack@keystone.service[81617]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 15 19:02:59.987904 dv-cinder-849846-10-smb devstack@keystone.service[81617]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 15 19:02:59.987904 dv-cinder-849846-10-smb devstack@keystone.service[81617]: nodename: dv-cinder-849846-10-smb Sep 15 19:02:59.987904 dv-cinder-849846-10-smb devstack@keystone.service[81617]: machine: x86_64 Sep 15 19:02:59.987904 dv-cinder-849846-10-smb devstack@keystone.service[81617]: clock source: unix Sep 15 19:02:59.987904 dv-cinder-849846-10-smb devstack@keystone.service[81617]: pcre jit disabled Sep 15 19:02:59.987904 dv-cinder-849846-10-smb devstack@keystone.service[81617]: detected number of CPU cores: 4 Sep 15 19:02:59.987904 dv-cinder-849846-10-smb devstack@keystone.service[81617]: current working directory: / Sep 15 19:02:59.987904 dv-cinder-849846-10-smb devstack@keystone.service[81617]: detected binary path: /usr/bin/uwsgi-core Sep 15 19:02:59.988442 dv-cinder-849846-10-smb devstack@keystone.service[81617]: your processes number limit is 47680 Sep 15 19:02:59.988442 dv-cinder-849846-10-smb devstack@keystone.service[81617]: your memory page size is 4096 bytes Sep 15 19:02:59.988442 dv-cinder-849846-10-smb devstack@keystone.service[81617]: detected max file descriptor number: 2048 Sep 15 19:02:59.988442 dv-cinder-849846-10-smb devstack@keystone.service[81617]: lock engine: pthread robust mutexes Sep 15 19:02:59.988442 dv-cinder-849846-10-smb devstack@keystone.service[81617]: thunder lock: enabled Sep 15 19:02:59.988442 dv-cinder-849846-10-smb devstack@keystone.service[81617]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 15 19:02:59.988442 dv-cinder-849846-10-smb devstack@keystone.service[81617]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 15 19:03:00.029046 dv-cinder-849846-10-smb devstack@keystone.service[81617]: Python main interpreter initialized at 0x5636803b59c0 Sep 15 19:03:00.029046 dv-cinder-849846-10-smb devstack@keystone.service[81617]: python threads support enabled Sep 15 19:03:00.029046 dv-cinder-849846-10-smb devstack@keystone.service[81617]: your server socket listen backlog is limited to 100 connections Sep 15 19:03:00.029046 dv-cinder-849846-10-smb devstack@keystone.service[81617]: your mercy for graceful operations on workers is 90 seconds Sep 15 19:03:00.029601 dv-cinder-849846-10-smb devstack@keystone.service[81617]: mapped 403077 bytes (393 KB) for 2 cores Sep 15 19:03:00.029601 dv-cinder-849846-10-smb devstack@keystone.service[81617]: *** Operational MODE: preforking *** Sep 15 19:03:00.029805 dv-cinder-849846-10-smb devstack@keystone.service[81617]: *** uWSGI is running in multiple interpreter mode *** Sep 15 19:03:00.029805 dv-cinder-849846-10-smb devstack@keystone.service[81617]: spawned uWSGI master process (pid: 81617) Sep 15 19:03:00.030033 dv-cinder-849846-10-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 15 19:03:00.031138 dv-cinder-849846-10-smb devstack@keystone.service[81617]: spawned uWSGI worker 1 (pid: 81625, cores: 1) Sep 15 19:03:00.031138 dv-cinder-849846-10-smb devstack@keystone.service[81617]: spawned uWSGI worker 2 (pid: 81626, cores: 1) Sep 15 19:03:00.031138 dv-cinder-849846-10-smb devstack@keystone.service[81617]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 15 19:03:04.327133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 19:03:04.327133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: from cryptography.utils import int_from_bytes Sep 15 19:03:04.327933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 19:03:04.327933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: from cryptography.utils import int_from_bytes Sep 15 19:03:04.328346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 19:03:04.328346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: from cryptography.utils import int_from_bytes Sep 15 19:03:04.328452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 15 19:03:04.328452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: from cryptography.utils import int_from_bytes Sep 15 19:03:04.377878 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 19:03:04.378110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 19:03:04.378254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] command line args: [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 19:03:04.378480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 15 19:03:04.378616 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 19:03:04.378699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 15 19:03:04.378774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ================================================================================ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 19:03:04.378834 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] command line args: [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 15 19:03:04.378897 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] admin_token = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.379076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 15 19:03:04.379175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] config_dir = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.379248 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ================================================================================ {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 15 19:03:04.379326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.379509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] config_source = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.379638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] admin_token = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.379714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] debug = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.379781 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] config_dir = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.379852 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.380176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.380176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] config_source = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.380293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.380349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] debug = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.380415 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.380473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.380636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.380716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.380782 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.380846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.381156 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.381249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.381249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_config_append = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.381367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.381429 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.381496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.381564 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_dir = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.381621 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_config_append = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.381767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_file = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.381898 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.382010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_dir = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.382208 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.382292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_file = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.382420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.382539 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.382675 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.382751 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.382936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.383060 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.383242 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.383329 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.383442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.383531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.383611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.383683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.383806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.383881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.384009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.384097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.384211 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.384286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.384427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.384514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.384662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.384798 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.384887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.384961 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.385088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.385182 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.385353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.385488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.385596 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.385976 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.386095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.25/identity {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.386251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] publish_errors = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.386336 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] publish_errors = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.386414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.386536 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.386625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.386698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.386813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.386895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.386973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.387106 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.387191 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.387341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.387463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] standard_threads = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.387609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] standard_threads = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.387700 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.387776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.387854 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.388009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.388142 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.388228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.388360 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_journal = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.388438 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] use_journal = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.388515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_json = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.388587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] use_json = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.388713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_stderr = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.388795 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] use_stderr = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.388877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] use_syslog = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.388950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] use_syslog = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.389021 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.389091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 15 19:03:04.389161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.389231 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.389382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.389514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.389601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.389707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.389895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.390033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.390129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.390206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.390377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.390499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.390577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.390659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.390849 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.390971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.391050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.391123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.391330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.391462 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.391553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.391628 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.391792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.391881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.392035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.392117 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.392267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.392350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.392511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.392600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.392753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.392837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.392987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.393070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.393237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.393327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.393488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.393570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.393722 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.393887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.393965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.394035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.394217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.394315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.394476 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.394558 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.394722 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.394804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.394968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.395063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.395197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.395280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.395424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.395506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.395649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.395744 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.395882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.395972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.396127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.396208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.396351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.396437 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.396581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.396659 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.396808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.396887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.397050 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.397136 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.397294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.397371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.397527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.397612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.397834 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.397933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.398070 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.398209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.398287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.398516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.398594 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.398741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.398819 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.398970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.399054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.399199 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.399277 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.399426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.399501 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.399648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.399728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.399893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.399977 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.400122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.400218 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.400356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.400434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.400583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.400660 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.400815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.400894 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.401048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.401126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.401285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.401361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.401510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.401588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.401745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.401883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.402003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.402122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.402228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.402322 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.402457 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.402598 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.402703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.402810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.402912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.403008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.403132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.403234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.403362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.403450 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.403598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.403680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.403830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.403921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.404061 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.404147 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.404306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.404397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.404533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.404647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.404767 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.404855 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.404998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.405143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.405222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.405282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.405487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.405568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.405729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.405843 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.406000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.406078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.406236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.406315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.406469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.406561 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.406701 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.406786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.406937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.407014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.407169 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.407259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.407403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.407482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.407638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.407718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.407871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.407958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.408111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.408298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.408377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.408492 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.408569 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.408650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.408779 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.408859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.409010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.409090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.409243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.409334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.409478 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.409563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.409724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.409822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.409996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.410092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.410234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.410313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.410468 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.410547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.410705 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.410862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.410945 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.411017 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.411153 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.411233 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.411385 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.411473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.411612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.411699 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.411838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.411918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.412065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.412145 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.412294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.412372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.412518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.412595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.412750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.412827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.412980 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.413060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.413221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.413302 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.413554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.413671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.413849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.413992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.414104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.414256 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.414431 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.414523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.414667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.external = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.414757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.414897 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.414977 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.external = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.415191 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.415279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.415408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.415487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.415637 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.password = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.415719 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.415866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] auth.token = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.415984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.password = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.416105 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.416188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] auth.token = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.416339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.416420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.416639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.416732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.416807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.416879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.417039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.417128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.417285 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.417366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.417512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.417592 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.417746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.417843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.418008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.418086 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.418252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.418376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.418499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.418580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.418740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.418819 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.418982 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.419062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.419214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.419295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.419451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.419529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.419696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.419774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.419930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.420012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.420172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.420250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.420427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.420507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.420689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.420768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.420948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.421034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.421187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.421322 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.421442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.421523 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.421673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.421752 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.421932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.422013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.422176 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.422263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.422420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.422506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.422649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.422728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.422887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.422967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.423119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.423204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.423365 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.423456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.423600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.423679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.423844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.423923 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.424077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.424163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.424322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.424402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.424566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.424655 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.424801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.424959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.425037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.425109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.425265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.425346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.425498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.425586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.425742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.425844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.425998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.426078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.426232 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.426328 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.426470 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.426549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.426715 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.426801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.426946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.427035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.427176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.427256 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.427404 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.427485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.427636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.427722 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.427877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.427956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.428120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.428200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.428366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.428452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.428606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.428684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.428859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.428938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.429167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.429265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.429409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.429489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.429650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.429734 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.429911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.430006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.430156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.430236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.430390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.430470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.430631 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.430724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.430869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.430950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.431110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.431188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.431338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.431425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.431584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.431663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.431827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.431906 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.432063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.432151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.432302 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.432381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.432559 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.432657 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.432774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.432856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.433009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.433089 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.433237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.433317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.433469 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.433550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.433707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.433860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.433969 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.434049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.434203 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.434284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.434437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.434517 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.434673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.434759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.434925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.435320 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.435399 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.435556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.435644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.435787 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.435874 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.436033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.436112 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.436278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.436358 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.436513 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.436604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.436747 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.436827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.436983 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.437063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.437211 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.437299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.437448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.437528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.437703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.437802 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.437959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.438051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.438204 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.438284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.438447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.438526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.438688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.438775 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.438919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.438999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.439145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.439225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.439379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.439467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.439610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.439690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.439842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.439921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.440066 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.440155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.440309 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.440389 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.440554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.440642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.440790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.440880 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.441031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.441110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.441269 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.441349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.441496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.441585 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.441737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.441867 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.441995 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.442075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.442229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.442321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.442463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.442542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.442692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.442771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.442933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.443022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.443174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.443254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.443405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.443485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.443657 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.443743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.443879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.443958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.444120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.444200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.444353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.444440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.444660 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.444795 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.444900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.445005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.445149 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.445239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.445401 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.445499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.445642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.445798 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.445888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.445981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.446135 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.446218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.446387 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.446468 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.446626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.446716 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.446861 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.446942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.447105 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.447185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.447351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.447440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.447583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.447664 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.447825 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.447905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.448059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.448136 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.448279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.448359 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.448510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] role.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.448590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] role.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.448751 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] role.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.448833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] role.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.448979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.449059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.449223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.449303 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.449465 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.449547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.449706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.449817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.449974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.450056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.450215 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.450298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.450455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.450535 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.450696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.450776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.450938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.451020 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.451165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.451245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.451406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.451487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.451648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.451730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.451888 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.451969 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.452127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.452208 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.452559 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.452641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.452790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.452869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.453033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.453114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.453276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.453358 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.453518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.453603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.453765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.453877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.454021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.454102 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.454270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.454350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.454516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.454604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.454747 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.454827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.454974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.455131 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.455211 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.455402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.455484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.455643 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.455795 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.455930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.456059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.456198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.456334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.456461 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.456589 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.456714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.456839 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.456971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.457099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.457224 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.457350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.457475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.457620 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.457776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.457876 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.457961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.458036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.458114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.458188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.458269 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.458343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.458415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.458486 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.458583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.458720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.458808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.458966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.459047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.459214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.459295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.459463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.459552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.459704 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.459782 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.459943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.460021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.460206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.460294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.460458 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.460538 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.460733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.460821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.460964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.461141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.461230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.461401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.connection = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.461490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.461642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.461722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.461911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.462007 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.462148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.462237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.462388 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.462468 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.462622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.462703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.462856 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.462945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.463087 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.463168 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.463318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.463398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.463551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.463638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.463788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.463867 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.464021 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.464099 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.464250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.464338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.464491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.464571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.464724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.464803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.464965 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.465052 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.465188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.465268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.465425 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.465505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.465656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.465750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.465918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 15 19:03:04.466043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81625) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 19:03:04.466129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 15 19:03:04.496255 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.496469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.496469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.496613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.496689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.496764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.505123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.505219 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.533603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.533820 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.533891 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.534138 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.588646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.588830 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.638416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.638633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.639053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.639294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.799016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.799227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.799459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.799679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.799830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.799920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.799997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.800072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.800235 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.800463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.800661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.800892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.823576 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.823765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.823836 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.824003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.824097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.824206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.824297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.824440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.824581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.824655 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.824727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.824869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.824994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.825076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.836575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.837120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.849848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.849989 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.850060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.850150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.850228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.850426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.850551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.850621 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.850697 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.850774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.850855 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.851032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.851158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81626) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.851240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81625) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 15 19:03:04.868255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.868420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 19:03:04.868488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.868733 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 19:03:04.868855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.868950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 19:03:04.869030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.869221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.869346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 15 19:03:04.869461 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.869567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.869746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.869901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.869971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.870051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.870295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.879526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.879802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.879926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.880080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.880222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.880314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.880396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.880654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.887532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.887735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.890425 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.890682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.890826 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.890932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.891021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.891246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.891387 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.891494 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.891584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.891782 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.891908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.891999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.892079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.892298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.892427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.892537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.892640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.892832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.892955 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.893075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.893166 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.893361 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.915764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.916184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.917238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.917519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.917642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.917978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.922153 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.922433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.922660 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.922797 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.922922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.923235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.928987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.929370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.929620 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.930004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.935468 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.935764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.935887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.936048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.936174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.936309 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.936404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.936609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.936707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.936887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.937029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.937135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.937227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.937437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.937565 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.937663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.953291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.953426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.953581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.953704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.957392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.957542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.960720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.960856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.960985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.961129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.965259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.965388 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.968385 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.968522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.971553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.971702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.972194 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.972318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.972472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.972618 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.972708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.972787 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.973020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.973156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.973271 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.973382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.988939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.989227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.989349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:04.989506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.989602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.989761 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.989911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.990095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.996596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.997112 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.998149 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.998638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.999648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:04.999931 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.000093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.000385 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.002648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.002934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.003058 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.003228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.003354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.003488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.003581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.003859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.003996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.004244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.015365 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.015647 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.015924 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.016201 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.016325 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.016568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.016692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.016820 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.016913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.017123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.017263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.017506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.017822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.018109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.032412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.033848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.035337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.036735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.038220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.039796 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.039943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.041484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.041610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.041811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.042213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.042975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.043258 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.043662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.048472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.049930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.050055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.051465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.052771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.053156 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.053434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.053715 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.054429 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.054827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.055122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.055406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.061614 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.061926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.062213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.063221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.063512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.063797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.068970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81625) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.069250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.069525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.069897 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.070139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.070424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.070704 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.070849 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81626) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 15 19:03:05.070949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.071040 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.071245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.071373 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.071476 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.071567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.071787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.071913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.071995 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.072075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.072282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.072374 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.072565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81625) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.072652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.072905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.073180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.073463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.073744 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.074181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.074475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81626) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 15 19:03:05.107074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5636803b59c0 pid: 81625 (default app) Sep 15 19:03:05.108922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5636803b59c0 pid: 81626 (default app) Sep 15 19:03:05.110533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba56e14-8034-4684-9a82-d9414f97470f None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:05.110819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba56e14-8034-4684-9a82-d9414f97470f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:05.111084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba56e14-8034-4684-9a82-d9414f97470f None None] PATH_INFO: `/v3` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:05.115218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1/1] 10.222.0.25 () {50 vars in 791 bytes} [Thu Sep 15 19:03:05 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:12.097898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a70c5-eab5-48d4-9ec1-d0d81f70c4c8 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:12.098551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a70c5-eab5-48d4-9ec1-d0d81f70c4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:12.098784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0a70c5-eab5-48d4-9ec1-d0d81f70c4c8 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:12.104176 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1/2] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:12 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:12.112259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da39ff-79d6-47e5-a718-a822b68e1bd7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:12.112839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da39ff-79d6-47e5-a718-a822b68e1bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:12.112839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da39ff-79d6-47e5-a718-a822b68e1bd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:12.184069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: INFO dbcounter [None req-e3da39ff-79d6-47e5-a718-a822b68e1bd7 None None] Registered counter for database keystone Sep 15 19:03:12.206967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG oslo_db.sqlalchemy.engines [None req-e3da39ff-79d6-47e5-a718-a822b68e1bd7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81625) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:03:12.217238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writer thread running {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:03:12.408813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG passlib.handlers.bcrypt [None req-e3da39ff-79d6-47e5-a718-a822b68e1bd7 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81625) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 19:03:12.409093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG passlib.handlers.bcrypt [None req-e3da39ff-79d6-47e5-a718-a822b68e1bd7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81625) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 19:03:12.467940 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e3da39ff-79d6-47e5-a718-a822b68e1bd7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:12.469568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e3da39ff-79d6-47e5-a718-a822b68e1bd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:12.615759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 2/3] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:12 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 504 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Sep 15 19:03:13.086731 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a70c5-eab5-48d4-9ec1-d0d81f70c4c8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:13.158659 dv-cinder-849846-10-smb devstack@keystone.service[81626]: INFO dbcounter [None req-5f0a70c5-eab5-48d4-9ec1-d0d81f70c4c8 None None] Registered counter for database keystone Sep 15 19:03:13.180880 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG oslo_db.sqlalchemy.engines [None req-5f0a70c5-eab5-48d4-9ec1-d0d81f70c4c8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 15 19:03:13.187781 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writer thread running {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 15 19:03:13.308011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0a70c5-eab5-48d4-9ec1-d0d81f70c4c8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:13.312708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08060f94-87c3-403b-832a-d3503abc69b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:13.313356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08060f94-87c3-403b-832a-d3503abc69b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:13.313633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08060f94-87c3-403b-832a-d3503abc69b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:13.313937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08060f94-87c3-403b-832a-d3503abc69b0 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:13.323127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08060f94-87c3-403b-832a-d3503abc69b0 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:13.374990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: WARNING keystone.common.rbac_enforcer.enforcer [None req-08060f94-87c3-403b-832a-d3503abc69b0 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 19:03:13.375232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08060f94-87c3-403b-832a-d3503abc69b0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:13.386057 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 2/4] 10.222.0.25 () {58 vars in 1324 bytes} [Thu Sep 15 19:03:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 19:03:13.392272 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da39ff-79d6-47e5-a718-a822b68e1bd7 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:13.418503 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da39ff-79d6-47e5-a718-a822b68e1bd7 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:13.426145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9c686-a021-4264-8ae2-c4a27e42dec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:13.428085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9c686-a021-4264-8ae2-c4a27e42dec5 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:13.428577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9c686-a021-4264-8ae2-c4a27e42dec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:13.429216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9c686-a021-4264-8ae2-c4a27e42dec5 admin admin] PATH_INFO: `/v3/projects/0bc762c67fb94d798d853612955d1b04` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:13.432075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9c686-a021-4264-8ae2-c4a27e42dec5 admin admin] RBAC: Authorizing `identity:get_project(project_id=0bc762c67fb94d798d853612955d1b04)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:13.541615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: WARNING keystone.common.rbac_enforcer.enforcer [None req-89a9c686-a021-4264-8ae2-c4a27e42dec5 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 15 19:03:13.542248 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9c686-a021-4264-8ae2-c4a27e42dec5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:13.551680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 3/5] 10.222.0.25 () {56 vars in 1207 bytes} [Thu Sep 15 19:03:13 2022] GET /identity/v3/projects/0bc762c67fb94d798d853612955d1b04 => generated 344 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:15.896536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129be6a1-a519-4e3a-ad6c-cfdf70410281 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:15.897359 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129be6a1-a519-4e3a-ad6c-cfdf70410281 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:15.897359 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129be6a1-a519-4e3a-ad6c-cfdf70410281 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:15.904734 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 3/6] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:15 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:15.911482 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1b145-a93e-4f23-9ffa-ae2765427061 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:15.912253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1b145-a93e-4f23-9ffa-ae2765427061 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:15.912402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a1b145-a93e-4f23-9ffa-ae2765427061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:15.935633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-74a1b145-a93e-4f23-9ffa-ae2765427061 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:15.937229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-74a1b145-a93e-4f23-9ffa-ae2765427061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:15.947604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 4/7] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:15 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 15 19:03:16.215463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129be6a1-a519-4e3a-ad6c-cfdf70410281 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:16.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129be6a1-a519-4e3a-ad6c-cfdf70410281 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:16.244213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34e6bab-ba96-4b06-9c33-3db5115bf536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:16.244818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e6bab-ba96-4b06-9c33-3db5115bf536 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:16.245095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e6bab-ba96-4b06-9c33-3db5115bf536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:16.245367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34e6bab-ba96-4b06-9c33-3db5115bf536 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:16.252931 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e6bab-ba96-4b06-9c33-3db5115bf536 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:16.254747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34e6bab-ba96-4b06-9c33-3db5115bf536 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:16.264126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 4/8] 10.222.0.25 () {58 vars in 1324 bytes} [Thu Sep 15 19:03:16 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 19:03:16.272997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1b145-a93e-4f23-9ffa-ae2765427061 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:16.283330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a1b145-a93e-4f23-9ffa-ae2765427061 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:16.289396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6714810f-d625-4d92-b0d3-20274daf1b9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:16.290180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714810f-d625-4d92-b0d3-20274daf1b9c admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:16.290459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714810f-d625-4d92-b0d3-20274daf1b9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:16.290733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6714810f-d625-4d92-b0d3-20274daf1b9c admin admin] PATH_INFO: `/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:16.292195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714810f-d625-4d92-b0d3-20274daf1b9c admin admin] RBAC: Authorizing `identity:get_user(user_id=ec63c21fc22648d4ac6ebbc9ee1cd9d1)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:16.294082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6714810f-d625-4d92-b0d3-20274daf1b9c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:16.295913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 5/9] 10.222.0.25 () {56 vars in 1198 bytes} [Thu Sep 15 19:03:16 2022] GET /identity/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1 => generated 247 bytes in 24 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:18.523741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73455b-e0c3-49b8-b31f-bd2e939b0829 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:18.524332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73455b-e0c3-49b8-b31f-bd2e939b0829 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:18.524594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b73455b-e0c3-49b8-b31f-bd2e939b0829 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:18.526420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 5/10] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:18.532041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251e19f-2d3f-4e85-b13c-4902f14737bc None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:18.532510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251e19f-2d3f-4e85-b13c-4902f14737bc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:18.532612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8251e19f-2d3f-4e85-b13c-4902f14737bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:18.548594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaa8ff-d6c9-48c9-b0a2-8bb80c78e9a1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:18.548941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaa8ff-d6c9-48c9-b0a2-8bb80c78e9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:18.549429 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edaa8ff-d6c9-48c9-b0a2-8bb80c78e9a1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:18.551534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 6/11] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:03:18.554472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8251e19f-2d3f-4e85-b13c-4902f14737bc None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:18.555687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8251e19f-2d3f-4e85-b13c-4902f14737bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:18.558002 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31a5ac-f511-43c3-a611-4eb56ce273a1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:18.558284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31a5ac-f511-43c3-a611-4eb56ce273a1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:18.558555 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e31a5ac-f511-43c3-a611-4eb56ce273a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:18.601348 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG passlib.handlers.bcrypt [None req-0e31a5ac-f511-43c3-a611-4eb56ce273a1 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81626) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 15 19:03:18.601735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG passlib.handlers.bcrypt [None req-0e31a5ac-f511-43c3-a611-4eb56ce273a1 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81626) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 15 19:03:18.641682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 6/12] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:18.652151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0e31a5ac-f511-43c3-a611-4eb56ce273a1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:18.653805 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0e31a5ac-f511-43c3-a611-4eb56ce273a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:18.757155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 7/13] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:18.933164 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251e19f-2d3f-4e85-b13c-4902f14737bc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:18.959707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:19.019357 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31a5ac-f511-43c3-a611-4eb56ce273a1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:19.047181 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8251e19f-2d3f-4e85-b13c-4902f14737bc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:19.083059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e72b89-7751-4130-b5d9-0d408ea10547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:19.083724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e72b89-7751-4130-b5d9-0d408ea10547 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:19.084020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e72b89-7751-4130-b5d9-0d408ea10547 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:19.084294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e72b89-7751-4130-b5d9-0d408ea10547 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:19.095956 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e72b89-7751-4130-b5d9-0d408ea10547 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-59e72b89-7751-4130-b5d9-0d408ea10547 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:19.105278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:19.106402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:19.107226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:19.107226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:19.107226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:19.107226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:19.107226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:19.107226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:19.107226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:19.107226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:19.107226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:19.107226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:19.107226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:19.107226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:19.107226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 7/14] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:03:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:19.112947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e72b89-7751-4130-b5d9-0d408ea10547 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:19.125774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e31a5ac-f511-43c3-a611-4eb56ce273a1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:19.128129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:19.167139 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7b70b-c1b9-46a9-b957-a5a240cdc153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:19.168089 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7b70b-c1b9-46a9-b957-a5a240cdc153 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:19.168400 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7b70b-c1b9-46a9-b957-a5a240cdc153 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:19.168681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a7b70b-c1b9-46a9-b957-a5a240cdc153 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:19.194568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:19.213078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e72b89-7751-4130-b5d9-0d408ea10547 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:19.238293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7b70b-c1b9-46a9-b957-a5a240cdc153 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:19.239949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a7b70b-c1b9-46a9-b957-a5a240cdc153 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:19.247567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d94ae4-cfa1-4691-926c-7dfc3cdabcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:19.248202 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d94ae4-cfa1-4691-926c-7dfc3cdabcce None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:19.248475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d94ae4-cfa1-4691-926c-7dfc3cdabcce None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:19.248747 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d94ae4-cfa1-4691-926c-7dfc3cdabcce None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:19.249428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d94ae4-cfa1-4691-926c-7dfc3cdabcce None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:19.249730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d94ae4-cfa1-4691-926c-7dfc3cdabcce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:19.251185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d94ae4-cfa1-4691-926c-7dfc3cdabcce None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:19.263696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 8/15] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:19.270010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d94ae4-cfa1-4691-926c-7dfc3cdabcce None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:19.350182 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 8/16] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:03:19.356086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7b70b-c1b9-46a9-b957-a5a240cdc153 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:19.359616 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:19.373602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d94ae4-cfa1-4691-926c-7dfc3cdabcce None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:19.408393 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de8fab-e03a-473c-8f8a-782395faea65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:19.409050 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de8fab-e03a-473c-8f8a-782395faea65 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:19.409324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de8fab-e03a-473c-8f8a-782395faea65 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:19.409590 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24de8fab-e03a-473c-8f8a-782395faea65 None admin] PATH_INFO: `/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:19.410730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de8fab-e03a-473c-8f8a-782395faea65 None admin] RBAC: Authorizing `identity:get_user(user_id=ec63c21fc22648d4ac6ebbc9ee1cd9d1)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:19.412222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24de8fab-e03a-473c-8f8a-782395faea65 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:19.413942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 9/17] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:19 2022] GET /identity/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1 => generated 247 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:19.419347 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de8fab-e03a-473c-8f8a-782395faea65 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:19.434771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:19.461263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a7b70b-c1b9-46a9-b957-a5a240cdc153 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:19.499197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550781ba-9526-49fd-87ad-8115983b809c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:19.500152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550781ba-9526-49fd-87ad-8115983b809c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:19.500442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550781ba-9526-49fd-87ad-8115983b809c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:19.500751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550781ba-9526-49fd-87ad-8115983b809c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:19.518488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24de8fab-e03a-473c-8f8a-782395faea65 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:19.521134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550781ba-9526-49fd-87ad-8115983b809c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:19.522683 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550781ba-9526-49fd-87ad-8115983b809c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-550781ba-9526-49fd-87ad-8115983b809c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:03:19.541088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:19.542481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:03:19.543269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:03:19.543269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:03:19.543269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:03:19.543269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 9/18] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:03:19.548209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550781ba-9526-49fd-87ad-8115983b809c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:19.557591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413d141-a70e-45a7-98cb-80588f464630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:19.558362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413d141-a70e-45a7-98cb-80588f464630 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:19.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413d141-a70e-45a7-98cb-80588f464630 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:19.558949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0413d141-a70e-45a7-98cb-80588f464630 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:19.560176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413d141-a70e-45a7-98cb-80588f464630 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:19.561738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0413d141-a70e-45a7-98cb-80588f464630 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:19.563485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 10/19] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:19.570193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413d141-a70e-45a7-98cb-80588f464630 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:19.609439 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:19.659007 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550781ba-9526-49fd-87ad-8115983b809c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:19.659204 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:19.680663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0413d141-a70e-45a7-98cb-80588f464630 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:19.695945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacbccf5-82b5-40c0-aa88-d78f29d0b7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:19.696595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbccf5-82b5-40c0-aa88-d78f29d0b7f9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:19.696904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbccf5-82b5-40c0-aa88-d78f29d0b7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:19.697201 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacbccf5-82b5-40c0-aa88-d78f29d0b7f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:19.697905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbccf5-82b5-40c0-aa88-d78f29d0b7f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:19.698216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbccf5-82b5-40c0-aa88-d78f29d0b7f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:19.699716 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dacbccf5-82b5-40c0-aa88-d78f29d0b7f9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:19.715644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4506ab05-d337-4f01-91dc-eb8def1f4324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:19.716225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506ab05-d337-4f01-91dc-eb8def1f4324 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:19.716510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506ab05-d337-4f01-91dc-eb8def1f4324 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:19.716783 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4506ab05-d337-4f01-91dc-eb8def1f4324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:19.717555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506ab05-d337-4f01-91dc-eb8def1f4324 None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.domain.id=default, user.id=ec63c21fc22648d4ac6ebbc9ee1cd9d1) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:19.717904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506ab05-d337-4f01-91dc-eb8def1f4324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:19.718800 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 10/20] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:03:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:19.719427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4506ab05-d337-4f01-91dc-eb8def1f4324 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:19.727381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 11/21] 10.222.0.25 () {56 vars in 1322 bytes} [Thu Sep 15 19:03:19 2022] GET /identity/v3/role_assignments?user.id=ec63c21fc22648d4ac6ebbc9ee1cd9d1&scope.domain.id=default&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 233 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:22.497831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f92c2-62a0-468d-895f-d42a04708725 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:22.498730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f92c2-62a0-468d-895f-d42a04708725 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:22.499134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134f92c2-62a0-468d-895f-d42a04708725 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:22.500973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 11/22] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:22.507208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62b3c-ed4d-47bb-980f-cb3394ab0f79 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:22.508068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62b3c-ed4d-47bb-980f-cb3394ab0f79 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:22.508478 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf62b3c-ed4d-47bb-980f-cb3394ab0f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:22.518171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90745cc7-f9e3-4ff0-9fb1-32bddc01881f None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:22.519821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90745cc7-f9e3-4ff0-9fb1-32bddc01881f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:22.520353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90745cc7-f9e3-4ff0-9fb1-32bddc01881f None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:22.522063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 12/23] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:03:22.528882 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377bcb3-90de-42f0-b980-2ca675d57c32 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:22.529472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377bcb3-90de-42f0-b980-2ca675d57c32 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:22.530118 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b377bcb3-90de-42f0-b980-2ca675d57c32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:22.534156 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4cf62b3c-ed4d-47bb-980f-cb3394ab0f79 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:22.535366 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4cf62b3c-ed4d-47bb-980f-cb3394ab0f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:22.550423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b377bcb3-90de-42f0-b980-2ca675d57c32 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:22.551948 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b377bcb3-90de-42f0-b980-2ca675d57c32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:22.648027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 12/24] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:22.668123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 13/25] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:03:22.669754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c2b3a-c008-411f-970e-6695faefd412 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:22.670265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c2b3a-c008-411f-970e-6695faefd412 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:22.670729 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811c2b3a-c008-411f-970e-6695faefd412 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:22.672245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 13/26] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:22.677812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b0606-d6ea-45be-9232-f111a38105f3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:22.678103 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b0606-d6ea-45be-9232-f111a38105f3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:22.678382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b0606-d6ea-45be-9232-f111a38105f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:22.707877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-186b0606-d6ea-45be-9232-f111a38105f3 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:22.709059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-186b0606-d6ea-45be-9232-f111a38105f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:22.764034 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccfc73-83db-4b84-8045-b3642b762b7a None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:22.764826 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccfc73-83db-4b84-8045-b3642b762b7a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:22.765401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bccfc73-83db-4b84-8045-b3642b762b7a None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:22.767804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 14/27] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:22.774421 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb579-874a-4cb1-98ab-f51908f06272 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:22.775729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:22.776197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb579-874a-4cb1-98ab-f51908f06272 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:22.776716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ceb579-874a-4cb1-98ab-f51908f06272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:22.815274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-57ceb579-874a-4cb1-98ab-f51908f06272 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:22.817083 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-57ceb579-874a-4cb1-98ab-f51908f06272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:22.819349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 14/28] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:22.950214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 15/29] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:23.056263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b0606-d6ea-45be-9232-f111a38105f3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:23.186985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceb579-874a-4cb1-98ab-f51908f06272 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:23.191208 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b0606-d6ea-45be-9232-f111a38105f3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:23.197808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:23.238568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61693c-e9b0-46d6-8217-03612657a9a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:23.239221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61693c-e9b0-46d6-8217-03612657a9a3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:23.239494 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61693c-e9b0-46d6-8217-03612657a9a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:23.239762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61693c-e9b0-46d6-8217-03612657a9a3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:23.263012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61693c-e9b0-46d6-8217-03612657a9a3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9e61693c-e9b0-46d6-8217-03612657a9a3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:23.269513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:23.270377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:23.271110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:23.271110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:23.271110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:23.271110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:23.271110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:23.271110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:23.271110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:23.271110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:23.271110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:23.271110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:23.271110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:23.271110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:03:23.271110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 15/30] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:03:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:23.271726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61693c-e9b0-46d6-8217-03612657a9a3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:23.313081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:23.385416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61693c-e9b0-46d6-8217-03612657a9a3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:23.413730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ceb579-874a-4cb1-98ab-f51908f06272 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:23.425417 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5232d71-0d92-4d79-b192-10dce410cc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:23.426331 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5232d71-0d92-4d79-b192-10dce410cc37 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:23.426820 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5232d71-0d92-4d79-b192-10dce410cc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:23.427230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5232d71-0d92-4d79-b192-10dce410cc37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:23.440791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5232d71-0d92-4d79-b192-10dce410cc37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:23.442890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5232d71-0d92-4d79-b192-10dce410cc37 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:23.451722 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfdf48-df34-4f48-9293-366473965ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:23.452380 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfdf48-df34-4f48-9293-366473965ef3 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:23.452770 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfdf48-df34-4f48-9293-366473965ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:23.453137 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dfdf48-df34-4f48-9293-366473965ef3 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:23.453966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfdf48-df34-4f48-9293-366473965ef3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:23.455481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70dfdf48-df34-4f48-9293-366473965ef3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d5232d71-0d92-4d79-b192-10dce410cc37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:03:23.461048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:23.462070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:03:23.463058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:03:23.463058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:03:23.463058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:03:23.464737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 16/31] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:23.465923 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5232d71-0d92-4d79-b192-10dce410cc37 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:23.565595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:23.578496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5232d71-0d92-4d79-b192-10dce410cc37 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:23.599191 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 16/32] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 15 19:03:23 2022] POST /identity/v3/roles => generated 219 bytes in 413 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:03:23.600931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfdf48-df34-4f48-9293-366473965ef3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:23.617859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ca6dc-99ed-4f61-8d4d-12199628aedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:23.617859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ca6dc-99ed-4f61-8d4d-12199628aedc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:23.617859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ca6dc-99ed-4f61-8d4d-12199628aedc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:23.617859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1ca6dc-99ed-4f61-8d4d-12199628aedc None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:23.618280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ca6dc-99ed-4f61-8d4d-12199628aedc None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:23.618280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ca6dc-99ed-4f61-8d4d-12199628aedc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:23.618399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1ca6dc-99ed-4f61-8d4d-12199628aedc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:23.633833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 17/33] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:23.633833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ca6dc-99ed-4f61-8d4d-12199628aedc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:23.753550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1ca6dc-99ed-4f61-8d4d-12199628aedc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:23.754455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:23.795538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4bcfb-d397-4c1d-8155-33127978f274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:23.796173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4bcfb-d397-4c1d-8155-33127978f274 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:23.796455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4bcfb-d397-4c1d-8155-33127978f274 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:23.796728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4bcfb-d397-4c1d-8155-33127978f274 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:23.797388 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4bcfb-d397-4c1d-8155-33127978f274 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:23.797694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4bcfb-d397-4c1d-8155-33127978f274 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:23.799145 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4bcfb-d397-4c1d-8155-33127978f274 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:23.812156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 18/34] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:03:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:23.813221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4bcfb-d397-4c1d-8155-33127978f274 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:23.827824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:23.855534 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70dfdf48-df34-4f48-9293-366473965ef3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:23.920178 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8b34b-384c-40c4-ae9a-4f119fdaec96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:23.924916 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8b34b-384c-40c4-ae9a-4f119fdaec96 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:23.925394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8b34b-384c-40c4-ae9a-4f119fdaec96 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:23.925899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8b34b-384c-40c4-ae9a-4f119fdaec96 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:23.927089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8b34b-384c-40c4-ae9a-4f119fdaec96 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:23.930256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac8b34b-384c-40c4-ae9a-4f119fdaec96 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:23.956273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 17/35] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 15 19:03:23 2022] POST /identity/v3/roles => generated 225 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:03:23.958346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8b34b-384c-40c4-ae9a-4f119fdaec96 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:23.980718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4bcfb-d397-4c1d-8155-33127978f274 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:24.032048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acef6564-f5b9-4101-bdc4-147e53339e6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:24.033150 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef6564-f5b9-4101-bdc4-147e53339e6b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:24.033613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef6564-f5b9-4101-bdc4-147e53339e6b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:24.034298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acef6564-f5b9-4101-bdc4-147e53339e6b None admin] PATH_INFO: `/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:24.036607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef6564-f5b9-4101-bdc4-147e53339e6b None admin] RBAC: Authorizing `identity:get_user(user_id=ec63c21fc22648d4ac6ebbc9ee1cd9d1)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:24.038696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acef6564-f5b9-4101-bdc4-147e53339e6b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:24.042767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 19/36] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:23 2022] GET /identity/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1 => generated 247 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:24.049034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee7fb-2a8e-4796-ad06-dc1e1388eb69 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:24.049605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee7fb-2a8e-4796-ad06-dc1e1388eb69 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:24.050065 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1ee7fb-2a8e-4796-ad06-dc1e1388eb69 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:24.052031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 20/37] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:24 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:24.053641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee7fb-2a8e-4796-ad06-dc1e1388eb69 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:24.124983 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac8b34b-384c-40c4-ae9a-4f119fdaec96 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:24.159570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:24.173742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:24.179228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fca1013-6924-4c3d-83e6-a73e73c7c431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:24.180405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca1013-6924-4c3d-83e6-a73e73c7c431 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:24.180867 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca1013-6924-4c3d-83e6-a73e73c7c431 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:24.181287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fca1013-6924-4c3d-83e6-a73e73c7c431 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:24.182220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca1013-6924-4c3d-83e6-a73e73c7c431 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:24.184062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fca1013-6924-4c3d-83e6-a73e73c7c431 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:24.214482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1ee7fb-2a8e-4796-ad06-dc1e1388eb69 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:24.233511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 18/38] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:03:23 2022] POST /identity/v3/projects => generated 301 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:03:24.233904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67ff1-e646-4ca6-aa13-0cc7364126d6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:24.234251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67ff1-e646-4ca6-aa13-0cc7364126d6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:24.234519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e67ff1-e646-4ca6-aa13-0cc7364126d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:24.259087 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c7e67ff1-e646-4ca6-aa13-0cc7364126d6 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:24.260664 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c7e67ff1-e646-4ca6-aa13-0cc7364126d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:24.286417 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fcdeb-b3dd-4cc8-a0bf-978dff71210a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:24.287750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fcdeb-b3dd-4cc8-a0bf-978dff71210a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:24.288107 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fcdeb-b3dd-4cc8-a0bf-978dff71210a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:24.288544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fcdeb-b3dd-4cc8-a0bf-978dff71210a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:24.290715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fcdeb-b3dd-4cc8-a0bf-978dff71210a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:24.292822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fcdeb-b3dd-4cc8-a0bf-978dff71210a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:24.295040 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 21/39] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:24.300722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fcdeb-b3dd-4cc8-a0bf-978dff71210a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:24.361907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 19/40] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:24.361907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf31a3f-295b-4c99-98e1-24d4b82a7122 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:24.361907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf31a3f-295b-4c99-98e1-24d4b82a7122 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:24.361907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf31a3f-295b-4c99-98e1-24d4b82a7122 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:24.361907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 20/41] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:24.367922 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab7873-a2ac-4361-a23d-ba8a4d18a4c7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:24.368212 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab7873-a2ac-4361-a23d-ba8a4d18a4c7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:24.368495 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab7873-a2ac-4361-a23d-ba8a4d18a4c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:24.387856 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-adab7873-a2ac-4361-a23d-ba8a4d18a4c7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:24.389147 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-adab7873-a2ac-4361-a23d-ba8a4d18a4c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:24.432498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fcdeb-b3dd-4cc8-a0bf-978dff71210a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:24.470926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7f51b-b75e-481e-b73c-322815beee46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:24.471492 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 21/42] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:03:24.472440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f51b-b75e-481e-b73c-322815beee46 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:24.472718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f51b-b75e-481e-b73c-322815beee46 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:24.472993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b7f51b-b75e-481e-b73c-322815beee46 None admin] PATH_INFO: `/v3/domains/default/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:24.475008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7f51b-b75e-481e-b73c-322815beee46 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=ec63c21fc22648d4ac6ebbc9ee1cd9d1, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:24.476552 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b7f51b-b75e-481e-b73c-322815beee46 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:24.605292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 22/43] 10.222.0.25 () {58 vars in 1361 bytes} [Thu Sep 15 19:03:24 2022] PUT /identity/v3/domains/default/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:03:24.656317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab7873-a2ac-4361-a23d-ba8a4d18a4c7 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:24.699389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:24.744276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7f51b-b75e-481e-b73c-322815beee46 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:24.754561 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:24.795878 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab7873-a2ac-4361-a23d-ba8a4d18a4c7 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:24.846945 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607b478-bf4f-46cd-90ab-1957b327e269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:24.848019 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b478-bf4f-46cd-90ab-1957b327e269 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:24.848441 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b478-bf4f-46cd-90ab-1957b327e269 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:24.848849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e607b478-bf4f-46cd-90ab-1957b327e269 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:24.849933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607b478-bf4f-46cd-90ab-1957b327e269 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:24.851154 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e607b478-bf4f-46cd-90ab-1957b327e269 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:24.867910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 22/44] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 15 19:03:24 2022] POST /identity/v3/roles => generated 223 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:03:24.880910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b7f51b-b75e-481e-b73c-322815beee46 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:24.925267 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df049f7-1a4c-4e52-853d-3a2d17452515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:24.926306 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df049f7-1a4c-4e52-853d-3a2d17452515 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:24.926724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df049f7-1a4c-4e52-853d-3a2d17452515 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:24.927156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df049f7-1a4c-4e52-853d-3a2d17452515 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:24.928888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df049f7-1a4c-4e52-853d-3a2d17452515 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:24.930998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df049f7-1a4c-4e52-853d-3a2d17452515 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:24.936935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 23/45] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:24.945172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607b478-bf4f-46cd-90ab-1957b327e269 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:25.173639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:25.181097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e607b478-bf4f-46cd-90ab-1957b327e269 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:25.217687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1776f7-01ec-4656-898e-98de272c9a34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:25.218348 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1776f7-01ec-4656-898e-98de272c9a34 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:25.218631 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1776f7-01ec-4656-898e-98de272c9a34 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:25.218909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1776f7-01ec-4656-898e-98de272c9a34 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:25.219583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1776f7-01ec-4656-898e-98de272c9a34 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:25.221037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1776f7-01ec-4656-898e-98de272c9a34 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:25.249529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 23/46] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:03:24 2022] POST /identity/v3/projects => generated 312 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:03:26.855330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f169-019a-4148-9fd4-5166dc007a70 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:26.855866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f169-019a-4148-9fd4-5166dc007a70 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:26.855866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8815f169-019a-4148-9fd4-5166dc007a70 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:26.857212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 24/47] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:26.863279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752e4c4-4064-4b29-a6fb-4d535f315ab7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:26.863709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752e4c4-4064-4b29-a6fb-4d535f315ab7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:26.864149 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a752e4c4-4064-4b29-a6fb-4d535f315ab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:26.885272 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a752e4c4-4064-4b29-a6fb-4d535f315ab7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:26.886731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a752e4c4-4064-4b29-a6fb-4d535f315ab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:26.960103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 24/48] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:27.228246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f169-019a-4148-9fd4-5166dc007a70 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:27.309016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:27.337847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8815f169-019a-4148-9fd4-5166dc007a70 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:27.376948 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb42dd-be3c-4348-b6c8-e975b848a59f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:27.377595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb42dd-be3c-4348-b6c8-e975b848a59f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:27.377867 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb42dd-be3c-4348-b6c8-e975b848a59f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:27.378166 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb42dd-be3c-4348-b6c8-e975b848a59f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:27.389642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cb42dd-be3c-4348-b6c8-e975b848a59f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-27cb42dd-be3c-4348-b6c8-e975b848a59f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:27.394559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:27.395445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:27.396173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:27.396173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:27.396173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:27.396173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:27.396173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:27.396173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:27.396173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:27.396173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:27.396173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:27.396173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:27.396173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:27.396173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:03:27.396173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 25/49] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:03:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:27.401800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752e4c4-4064-4b29-a6fb-4d535f315ab7 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:27.453515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3ae63-7dcb-48d2-a9c0-b83518a3ebb7 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:27.453844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3ae63-7dcb-48d2-a9c0-b83518a3ebb7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:27.454146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f3ae63-7dcb-48d2-a9c0-b83518a3ebb7 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:27.455518 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 26/50] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:27.460890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b9ecd-6953-4a2a-8bd5-f63838ceeedb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:27.461197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b9ecd-6953-4a2a-8bd5-f63838ceeedb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:27.461473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b9ecd-6953-4a2a-8bd5-f63838ceeedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:27.480992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-045b9ecd-6953-4a2a-8bd5-f63838ceeedb None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:27.482492 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-045b9ecd-6953-4a2a-8bd5-f63838ceeedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:27.485133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:27.508840 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a752e4c4-4064-4b29-a6fb-4d535f315ab7 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:27.544744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54ad2f-97ed-4101-b420-eaf68a519b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:27.545296 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54ad2f-97ed-4101-b420-eaf68a519b1e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:27.545604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54ad2f-97ed-4101-b420-eaf68a519b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:27.545886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a54ad2f-97ed-4101-b420-eaf68a519b1e None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:27.546568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54ad2f-97ed-4101-b420-eaf68a519b1e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:27.546879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54ad2f-97ed-4101-b420-eaf68a519b1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:27.548275 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a54ad2f-97ed-4101-b420-eaf68a519b1e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:27.553234 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 27/51] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:27.556608 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 25/52] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:27.562408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b9ecd-6953-4a2a-8bd5-f63838ceeedb None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:27.634363 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:27.675340 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b9ecd-6953-4a2a-8bd5-f63838ceeedb None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:27.713317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c0280-2030-49f6-a5de-0284f1dcf41f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:27.714036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c0280-2030-49f6-a5de-0284f1dcf41f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:27.714321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c0280-2030-49f6-a5de-0284f1dcf41f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:27.714747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9c0280-2030-49f6-a5de-0284f1dcf41f None admin] PATH_INFO: `/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:27.716249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c0280-2030-49f6-a5de-0284f1dcf41f None admin] RBAC: Authorizing `identity:get_user(user_id=ec63c21fc22648d4ac6ebbc9ee1cd9d1)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:27.717924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9c0280-2030-49f6-a5de-0284f1dcf41f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:27.719524 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 28/53] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:27 2022] GET /identity/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1 => generated 247 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:27.726000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54ad2f-97ed-4101-b420-eaf68a519b1e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:27.828040 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c0280-2030-49f6-a5de-0284f1dcf41f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:27.831599 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a54ad2f-97ed-4101-b420-eaf68a519b1e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:27.873440 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697a8dd-296f-44f8-bf10-6d860c26ed97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:27.874280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a8dd-296f-44f8-bf10-6d860c26ed97 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:27.874444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a8dd-296f-44f8-bf10-6d860c26ed97 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:27.874729 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4697a8dd-296f-44f8-bf10-6d860c26ed97 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:27.875946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697a8dd-296f-44f8-bf10-6d860c26ed97 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:27.877584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4697a8dd-296f-44f8-bf10-6d860c26ed97 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:27.879448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 26/54] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:27.885436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697a8dd-296f-44f8-bf10-6d860c26ed97 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:27.899426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:27.941038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9c0280-2030-49f6-a5de-0284f1dcf41f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:27.995422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4697a8dd-296f-44f8-bf10-6d860c26ed97 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:28.033114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deefbb-34c4-4fb4-83cb-a9b8f4149411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:28.033765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deefbb-34c4-4fb4-83cb-a9b8f4149411 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:28.034075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deefbb-34c4-4fb4-83cb-a9b8f4149411 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:28.034344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88deefbb-34c4-4fb4-83cb-a9b8f4149411 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:28.035090 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88deefbb-34c4-4fb4-83cb-a9b8f4149411 None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.domain.id=default, user.id=ec63c21fc22648d4ac6ebbc9ee1cd9d1) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:28.035397 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88deefbb-34c4-4fb4-83cb-a9b8f4149411 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:28.036868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88deefbb-34c4-4fb4-83cb-a9b8f4149411 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:28.044150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 27/55] 10.222.0.25 () {56 vars in 1322 bytes} [Thu Sep 15 19:03:27 2022] GET /identity/v3/role_assignments?user.id=ec63c21fc22648d4ac6ebbc9ee1cd9d1&scope.domain.id=default&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 530 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:28.083150 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:28.089735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d130d8-6dd6-49ef-83f3-9853d0a1e6e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:28.090426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d130d8-6dd6-49ef-83f3-9853d0a1e6e2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:28.090704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d130d8-6dd6-49ef-83f3-9853d0a1e6e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:28.090973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d130d8-6dd6-49ef-83f3-9853d0a1e6e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:28.092126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d130d8-6dd6-49ef-83f3-9853d0a1e6e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:28.093592 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d130d8-6dd6-49ef-83f3-9853d0a1e6e2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:28.095398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 29/56] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:28.101581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deefbb-34c4-4fb4-83cb-a9b8f4149411 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:28.183978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:28.220003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88deefbb-34c4-4fb4-83cb-a9b8f4149411 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:28.263320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e50785-c2b0-4fda-b219-d26135ef29e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:28.263954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e50785-c2b0-4fda-b219-d26135ef29e3 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:28.264238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e50785-c2b0-4fda-b219-d26135ef29e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:28.264514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e50785-c2b0-4fda-b219-d26135ef29e3 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:28.265228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e50785-c2b0-4fda-b219-d26135ef29e3 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:28.266727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e50785-c2b0-4fda-b219-d26135ef29e3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:28.295495 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 28/57] 10.222.0.25 () {60 vars in 1140 bytes} [Thu Sep 15 19:03:28 2022] POST /identity/v3/projects => generated 298 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:03:30.439067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ccc2d-6118-411d-8dc0-3a811d4479d8 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:30.439607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ccc2d-6118-411d-8dc0-3a811d4479d8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:30.439607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051ccc2d-6118-411d-8dc0-3a811d4479d8 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:30.440959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 30/58] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:30.446304 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314dae-0926-4c74-b3be-eb5e643e72b4 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:30.446721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314dae-0926-4c74-b3be-eb5e643e72b4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:30.446803 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89314dae-0926-4c74-b3be-eb5e643e72b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:30.465828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-89314dae-0926-4c74-b3be-eb5e643e72b4 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:30.467033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-89314dae-0926-4c74-b3be-eb5e643e72b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:30.536697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 29/59] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:30.804481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ccc2d-6118-411d-8dc0-3a811d4479d8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:30.911059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051ccc2d-6118-411d-8dc0-3a811d4479d8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:30.946409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ec97e7-fdad-4a94-b766-5d2f9def96bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:30.947060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec97e7-fdad-4a94-b766-5d2f9def96bd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:30.947335 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec97e7-fdad-4a94-b766-5d2f9def96bd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:30.947601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ec97e7-fdad-4a94-b766-5d2f9def96bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:30.948772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec97e7-fdad-4a94-b766-5d2f9def96bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:30.950235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ec97e7-fdad-4a94-b766-5d2f9def96bd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:30.951822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 31/60] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:30.957825 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314dae-0926-4c74-b3be-eb5e643e72b4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:31.016698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:31.062524 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89314dae-0926-4c74-b3be-eb5e643e72b4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:31.097434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc58180-6831-4660-aaee-666ac4b5d4b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:31.098092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc58180-6831-4660-aaee-666ac4b5d4b6 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:31.098372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc58180-6831-4660-aaee-666ac4b5d4b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:31.098644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc58180-6831-4660-aaee-666ac4b5d4b6 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:31.099293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc58180-6831-4660-aaee-666ac4b5d4b6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:31.100746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc58180-6831-4660-aaee-666ac4b5d4b6 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:31.129508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 30/61] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:03:30 2022] POST /identity/v3/users => generated 275 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:03:34.506787 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469293e9-0f91-4b05-ac99-7538546b739e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:34.507386 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469293e9-0f91-4b05-ac99-7538546b739e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:34.507731 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469293e9-0f91-4b05-ac99-7538546b739e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:34.509698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 32/62] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:34.515565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9390c9b-7937-4cb0-ba86-5074dfd1c3a5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:34.516023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9390c9b-7937-4cb0-ba86-5074dfd1c3a5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:34.516206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9390c9b-7937-4cb0-ba86-5074dfd1c3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:34.543111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a9390c9b-7937-4cb0-ba86-5074dfd1c3a5 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:34.544384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a9390c9b-7937-4cb0-ba86-5074dfd1c3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:34.589520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aa4ab-7d1a-42f2-9d74-94bef1a54e4c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:34.589864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aa4ab-7d1a-42f2-9d74-94bef1a54e4c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:34.590180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762aa4ab-7d1a-42f2-9d74-94bef1a54e4c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:34.592254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 33/63] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:34.599286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5e208-7476-468c-92e0-216f7fd617af None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:34.599286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5e208-7476-468c-92e0-216f7fd617af None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:34.599286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc5e208-7476-468c-92e0-216f7fd617af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:34.618120 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bdc5e208-7476-468c-92e0-216f7fd617af None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:34.619350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bdc5e208-7476-468c-92e0-216f7fd617af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:34.672445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 31/64] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:34.700883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 34/65] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:34.701237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:34.864719 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887a333-f082-4e75-8cdf-9a2619747502 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:34.865064 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887a333-f082-4e75-8cdf-9a2619747502 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:34.865177 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a887a333-f082-4e75-8cdf-9a2619747502 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:34.867062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 32/66] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:34.873199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25dda0-ec6b-43ae-8d93-f9636c116bac None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:34.873530 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25dda0-ec6b-43ae-8d93-f9636c116bac None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:34.873832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c25dda0-ec6b-43ae-8d93-f9636c116bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:34.897200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1c25dda0-ec6b-43ae-8d93-f9636c116bac None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:34.898645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1c25dda0-ec6b-43ae-8d93-f9636c116bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:34.968217 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 35/67] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:35.011710 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887a333-f082-4e75-8cdf-9a2619747502 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:35.060910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25dda0-ec6b-43ae-8d93-f9636c116bac None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:35.061669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:35.173630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c25dda0-ec6b-43ae-8d93-f9636c116bac None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:35.175620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a887a333-f082-4e75-8cdf-9a2619747502 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:35.206200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:35.216679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280dd2d-f5c5-4af0-9c61-d908c678b3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:35.217340 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280dd2d-f5c5-4af0-9c61-d908c678b3e5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:35.217627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280dd2d-f5c5-4af0-9c61-d908c678b3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:35.217928 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f280dd2d-f5c5-4af0-9c61-d908c678b3e5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:35.229686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f280dd2d-f5c5-4af0-9c61-d908c678b3e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-f280dd2d-f5c5-4af0-9c61-d908c678b3e5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:35.234947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:35.235784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:35.236544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:35.236544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:35.236544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:35.236544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:35.236544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:35.236544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:35.236544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:35.236544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:35.236544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:35.236544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:35.236544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:35.236544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:03:35.236544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 36/68] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:03:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:35.243721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280dd2d-f5c5-4af0-9c61-d908c678b3e5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:35.256308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa629667-8895-4d23-9bf7-b840e7dcac97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:35.257172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa629667-8895-4d23-9bf7-b840e7dcac97 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:35.257553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa629667-8895-4d23-9bf7-b840e7dcac97 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:35.257858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa629667-8895-4d23-9bf7-b840e7dcac97 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:35.278127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa629667-8895-4d23-9bf7-b840e7dcac97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-aa629667-8895-4d23-9bf7-b840e7dcac97 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:35.291141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:35.293217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:35.295132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:35.295132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:35.295132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:35.295132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:35.295132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:35.295132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:35.295132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:35.295132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:35.295132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:35.295132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:35.295132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:35.295132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:35.295132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 33/69] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:35.306170 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa629667-8895-4d23-9bf7-b840e7dcac97 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:35.352928 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f280dd2d-f5c5-4af0-9c61-d908c678b3e5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:35.391254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9fd3ae-42ee-42f5-8811-36c4852572d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:35.391879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fd3ae-42ee-42f5-8811-36c4852572d4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:35.392164 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fd3ae-42ee-42f5-8811-36c4852572d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:35.392435 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9fd3ae-42ee-42f5-8811-36c4852572d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:35.393266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fd3ae-42ee-42f5-8811-36c4852572d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:35.393573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fd3ae-42ee-42f5-8811-36c4852572d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:35.395010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9fd3ae-42ee-42f5-8811-36c4852572d4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:35.405571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 37/70] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:35.407193 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de28612-cb45-48e6-8147-51463162a1fa None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:35.407676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de28612-cb45-48e6-8147-51463162a1fa None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:35.408135 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de28612-cb45-48e6-8147-51463162a1fa None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:35.409537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 38/71] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:35.411211 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de28612-cb45-48e6-8147-51463162a1fa None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:35.426599 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:35.430390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa629667-8895-4d23-9bf7-b840e7dcac97 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:35.470677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:35.478834 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327fd3e-d7f2-432c-a8eb-ea69fa3f6e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:35.479455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327fd3e-d7f2-432c-a8eb-ea69fa3f6e93 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:35.479739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327fd3e-d7f2-432c-a8eb-ea69fa3f6e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:35.480025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6327fd3e-d7f2-432c-a8eb-ea69fa3f6e93 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:35.480688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327fd3e-d7f2-432c-a8eb-ea69fa3f6e93 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:35.481003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327fd3e-d7f2-432c-a8eb-ea69fa3f6e93 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:35.482449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6327fd3e-d7f2-432c-a8eb-ea69fa3f6e93 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:35.490709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 34/72] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:03:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:35.491598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327fd3e-d7f2-432c-a8eb-ea69fa3f6e93 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:35.534336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de28612-cb45-48e6-8147-51463162a1fa None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:35.571414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95aeb85-7efe-4de9-9279-8b80d9250ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:35.572060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aeb85-7efe-4de9-9279-8b80d9250ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:35.572336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aeb85-7efe-4de9-9279-8b80d9250ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:35.572609 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95aeb85-7efe-4de9-9279-8b80d9250ae8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:35.584132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95aeb85-7efe-4de9-9279-8b80d9250ae8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-f95aeb85-7efe-4de9-9279-8b80d9250ae8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:35.589591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:35.590998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:35.592296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:35.592296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:35.592296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:35.592296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:35.592296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:35.592296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:35.592296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:35.592296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:35.592296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:35.592296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:35.592296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:03:35.592296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:03:35.592296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 39/73] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:03:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:35.593390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60480b7e-a5b8-4cd3-8d74-4d0624f1fe82 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:35.593390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60480b7e-a5b8-4cd3-8d74-4d0624f1fe82 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:35.593390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60480b7e-a5b8-4cd3-8d74-4d0624f1fe82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:35.606066 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6327fd3e-d7f2-432c-a8eb-ea69fa3f6e93 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:35.613000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-60480b7e-a5b8-4cd3-8d74-4d0624f1fe82 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:35.614259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-60480b7e-a5b8-4cd3-8d74-4d0624f1fe82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:35.641187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12382aff-76bb-4fd5-883a-5ec2ebd4694b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:35.641876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12382aff-76bb-4fd5-883a-5ec2ebd4694b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:35.642162 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12382aff-76bb-4fd5-883a-5ec2ebd4694b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:35.642440 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12382aff-76bb-4fd5-883a-5ec2ebd4694b None admin] PATH_INFO: `/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:35.643616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12382aff-76bb-4fd5-883a-5ec2ebd4694b None admin] RBAC: Authorizing `identity:get_user(user_id=ec63c21fc22648d4ac6ebbc9ee1cd9d1)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:35.645091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12382aff-76bb-4fd5-883a-5ec2ebd4694b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:35.646738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 35/74] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:35 2022] GET /identity/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:35.647598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12382aff-76bb-4fd5-883a-5ec2ebd4694b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:35.680615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:35.689611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 40/75] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:35.692567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3cc32-6e47-4b60-85de-4a6ad5c40d84 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:35.692860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3cc32-6e47-4b60-85de-4a6ad5c40d84 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:35.693581 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3cc32-6e47-4b60-85de-4a6ad5c40d84 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:35.695568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 41/76] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:35.696427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3cc32-6e47-4b60-85de-4a6ad5c40d84 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:35.757372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12382aff-76bb-4fd5-883a-5ec2ebd4694b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:35.761659 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:35.796081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a20d86-9a4a-4df6-b51d-b5c3fdd8dea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:35.796850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a20d86-9a4a-4df6-b51d-b5c3fdd8dea9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:35.797325 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a20d86-9a4a-4df6-b51d-b5c3fdd8dea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:35.797705 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a20d86-9a4a-4df6-b51d-b5c3fdd8dea9 None admin] PATH_INFO: `/v3/users/b7178f44ee68469b88cc62895e6492a6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:35.814900 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a20d86-9a4a-4df6-b51d-b5c3fdd8dea9 None admin] RBAC: Authorizing `identity:get_user(user_id=b7178f44ee68469b88cc62895e6492a6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:35.816674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a20d86-9a4a-4df6-b51d-b5c3fdd8dea9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:35.818485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 36/77] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:35 2022] GET /identity/v3/users/b7178f44ee68469b88cc62895e6492a6 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:35.819429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a20d86-9a4a-4df6-b51d-b5c3fdd8dea9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:35.858948 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3cc32-6e47-4b60-85de-4a6ad5c40d84 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:35.907567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a8c2a8-914a-4541-a538-7ae9d2cc6ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:35.908748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8c2a8-914a-4541-a538-7ae9d2cc6ee0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:35.909895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8c2a8-914a-4541-a538-7ae9d2cc6ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:35.910593 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a8c2a8-914a-4541-a538-7ae9d2cc6ee0 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:35.911454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8c2a8-914a-4541-a538-7ae9d2cc6ee0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:35.912066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8c2a8-914a-4541-a538-7ae9d2cc6ee0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:35.914642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a8c2a8-914a-4541-a538-7ae9d2cc6ee0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:35.925989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 42/78] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:03:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:35.931855 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76197b-f4d4-446b-a694-1c7c8a6f72ad None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:35.932096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76197b-f4d4-446b-a694-1c7c8a6f72ad None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:35.932346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e76197b-f4d4-446b-a694-1c7c8a6f72ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:35.946035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:35.953733 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9e76197b-f4d4-446b-a694-1c7c8a6f72ad None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:35.954992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9e76197b-f4d4-446b-a694-1c7c8a6f72ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:35.961537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a20d86-9a4a-4df6-b51d-b5c3fdd8dea9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:36.001072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a2fdf-16a8-464c-98f3-830ab8421aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:36.001922 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a2fdf-16a8-464c-98f3-830ab8421aed None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:36.002244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a2fdf-16a8-464c-98f3-830ab8421aed None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:36.002560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a2fdf-16a8-464c-98f3-830ab8421aed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:36.044057 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 43/79] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:36.044920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76197b-f4d4-446b-a694-1c7c8a6f72ad None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:36.077186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a2fdf-16a8-464c-98f3-830ab8421aed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:36.078725 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a2fdf-16a8-464c-98f3-830ab8421aed None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:36.092452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:36.180294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:36.187886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e76197b-f4d4-446b-a694-1c7c8a6f72ad None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:36.199059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 37/80] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:03:36.200519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a2fdf-16a8-464c-98f3-830ab8421aed None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:36.229504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c632c-665e-488d-bc78-89ed8234effb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:36.230172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c632c-665e-488d-bc78-89ed8234effb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:36.230560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c632c-665e-488d-bc78-89ed8234effb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:36.230911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39c632c-665e-488d-bc78-89ed8234effb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:36.311088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c632c-665e-488d-bc78-89ed8234effb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:36.312672 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39c632c-665e-488d-bc78-89ed8234effb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:36.326791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a2fdf-16a8-464c-98f3-830ab8421aed None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:36.348828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:36.366793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a88d1-114a-47f1-a608-676f1376cbd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:36.367492 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a88d1-114a-47f1-a608-676f1376cbd7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:36.367850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a88d1-114a-47f1-a608-676f1376cbd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:36.368131 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2a88d1-114a-47f1-a608-676f1376cbd7 None admin] PATH_INFO: `/v3/users/b7178f44ee68469b88cc62895e6492a6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:36.369375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a88d1-114a-47f1-a608-676f1376cbd7 None admin] RBAC: Authorizing `identity:get_user(user_id=b7178f44ee68469b88cc62895e6492a6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:36.371034 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2a88d1-114a-47f1-a608-676f1376cbd7 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:36.372783 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 38/81] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:36 2022] GET /identity/v3/users/b7178f44ee68469b88cc62895e6492a6 => generated 275 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:36.373652 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a88d1-114a-47f1-a608-676f1376cbd7 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:36.424371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 44/82] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:03:36.425236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c632c-665e-488d-bc78-89ed8234effb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:36.443273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:36.498025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2a88d1-114a-47f1-a608-676f1376cbd7 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:36.539992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39c632c-665e-488d-bc78-89ed8234effb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:36.542505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14150b-f1ff-41e9-82a9-bcc38e4d0ae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:36.543400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14150b-f1ff-41e9-82a9-bcc38e4d0ae6 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:36.543723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14150b-f1ff-41e9-82a9-bcc38e4d0ae6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:36.544017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14150b-f1ff-41e9-82a9-bcc38e4d0ae6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:36.559269 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14150b-f1ff-41e9-82a9-bcc38e4d0ae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-1e14150b-f1ff-41e9-82a9-bcc38e4d0ae6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:36.566489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:36.567741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 39/83] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:36.570774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14150b-f1ff-41e9-82a9-bcc38e4d0ae6 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:36.582540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:36.589154 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4044826-a7f0-4075-aef9-c97fb77ff6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:36.589833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044826-a7f0-4075-aef9-c97fb77ff6dd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:36.590118 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044826-a7f0-4075-aef9-c97fb77ff6dd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:36.590390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4044826-a7f0-4075-aef9-c97fb77ff6dd None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:36.591557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4044826-a7f0-4075-aef9-c97fb77ff6dd None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:36.592997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4044826-a7f0-4075-aef9-c97fb77ff6dd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:36.594684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 45/84] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:36 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:36.595446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4044826-a7f0-4075-aef9-c97fb77ff6dd None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:36.690450 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14150b-f1ff-41e9-82a9-bcc38e4d0ae6 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:36.711370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:36.722771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4044826-a7f0-4075-aef9-c97fb77ff6dd None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:36.732740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb885bc-8819-48fc-b282-470c3305b835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:36.733474 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb885bc-8819-48fc-b282-470c3305b835 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:36.733837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb885bc-8819-48fc-b282-470c3305b835 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:36.734181 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb885bc-8819-48fc-b282-470c3305b835 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:36.735487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb885bc-8819-48fc-b282-470c3305b835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:36.737238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb885bc-8819-48fc-b282-470c3305b835 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:36.739784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 40/85] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:36.740004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb885bc-8819-48fc-b282-470c3305b835 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:36.761566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b5d42-b8b2-4a67-8af1-ad5c9b9be21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:36.762247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b5d42-b8b2-4a67-8af1-ad5c9b9be21f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:36.762558 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b5d42-b8b2-4a67-8af1-ad5c9b9be21f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:36.762796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20b5d42-b8b2-4a67-8af1-ad5c9b9be21f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:36.850301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:36.853409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b5d42-b8b2-4a67-8af1-ad5c9b9be21f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:36.855958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20b5d42-b8b2-4a67-8af1-ad5c9b9be21f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:36.864903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb885bc-8819-48fc-b282-470c3305b835 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:36.900642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecaa11-ab49-48ea-a5df-f86ead275eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:36.901304 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecaa11-ab49-48ea-a5df-f86ead275eac None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:36.901632 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecaa11-ab49-48ea-a5df-f86ead275eac None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:36.901937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ecaa11-ab49-48ea-a5df-f86ead275eac None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:36.903103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecaa11-ab49-48ea-a5df-f86ead275eac None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:36.904598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ecaa11-ab49-48ea-a5df-f86ead275eac None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:36.906258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 41/86] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:36 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:36.907027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecaa11-ab49-48ea-a5df-f86ead275eac None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:36.968913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:36.969668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 46/87] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:03:36.975562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b5d42-b8b2-4a67-8af1-ad5c9b9be21f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:37.020755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ecaa11-ab49-48ea-a5df-f86ead275eac None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:37.061217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53affbb8-81c1-4b6d-b887-87d563981e88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:37.061974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53affbb8-81c1-4b6d-b887-87d563981e88 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:37.062256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53affbb8-81c1-4b6d-b887-87d563981e88 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:37.062628 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53affbb8-81c1-4b6d-b887-87d563981e88 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:37.063205 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53affbb8-81c1-4b6d-b887-87d563981e88 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:37.063512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53affbb8-81c1-4b6d-b887-87d563981e88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:37.064906 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53affbb8-81c1-4b6d-b887-87d563981e88 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:37.073980 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 42/88] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:03:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:37.074789 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53affbb8-81c1-4b6d-b887-87d563981e88 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:37.082880 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:37.086380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20b5d42-b8b2-4a67-8af1-ad5c9b9be21f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:37.123981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfc1e7-7b4b-49e3-acb5-0841f45d15f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:37.124652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfc1e7-7b4b-49e3-acb5-0841f45d15f9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:37.124861 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfc1e7-7b4b-49e3-acb5-0841f45d15f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:37.125127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadfc1e7-7b4b-49e3-acb5-0841f45d15f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:37.125972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfc1e7-7b4b-49e3-acb5-0841f45d15f9 None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=23a9c71b85984efe850d28405efb5998, user.id=ec63c21fc22648d4ac6ebbc9ee1cd9d1) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:37.126442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfc1e7-7b4b-49e3-acb5-0841f45d15f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:37.127978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadfc1e7-7b4b-49e3-acb5-0841f45d15f9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:37.136645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 47/89] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:03:36 2022] GET /identity/v3/role_assignments?user.id=ec63c21fc22648d4ac6ebbc9ee1cd9d1&scope.project.id=23a9c71b85984efe850d28405efb5998&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:37.137633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfc1e7-7b4b-49e3-acb5-0841f45d15f9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:37.192291 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53affbb8-81c1-4b6d-b887-87d563981e88 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:37.209940 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:37.236472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8aeec-05d5-4eb7-974c-d13b72430518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:37.237098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8aeec-05d5-4eb7-974c-d13b72430518 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:37.237889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8aeec-05d5-4eb7-974c-d13b72430518 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:37.237889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f8aeec-05d5-4eb7-974c-d13b72430518 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:37.238357 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8aeec-05d5-4eb7-974c-d13b72430518 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:37.239891 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f8aeec-05d5-4eb7-974c-d13b72430518 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:37.270006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 43/90] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:03:37 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:03:37.271483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8aeec-05d5-4eb7-974c-d13b72430518 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:37.288361 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadfc1e7-7b4b-49e3-acb5-0841f45d15f9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:37.352768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232c8f8-6524-47da-b2cc-665f925fd274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:37.353536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232c8f8-6524-47da-b2cc-665f925fd274 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:37.353892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232c8f8-6524-47da-b2cc-665f925fd274 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:37.354152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c232c8f8-6524-47da-b2cc-665f925fd274 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:37.355065 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232c8f8-6524-47da-b2cc-665f925fd274 None admin] RBAC: Adding query filter params (role.id=1e24ea020d1a46989b4f460308a32229, scope.project.id=23a9c71b85984efe850d28405efb5998, user.id=b7178f44ee68469b88cc62895e6492a6) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:37.355378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232c8f8-6524-47da-b2cc-665f925fd274 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:37.357219 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c232c8f8-6524-47da-b2cc-665f925fd274 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:37.366835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 48/91] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:03:37 2022] GET /identity/v3/role_assignments?user.id=b7178f44ee68469b88cc62895e6492a6&scope.project.id=23a9c71b85984efe850d28405efb5998&role.id=1e24ea020d1a46989b4f460308a32229 => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:37.376148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232c8f8-6524-47da-b2cc-665f925fd274 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:37.462221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:37.495346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f8aeec-05d5-4eb7-974c-d13b72430518 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:37.538560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae653cc2-e565-461c-a374-5472b74c7c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:37.539241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae653cc2-e565-461c-a374-5472b74c7c9d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:37.539521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae653cc2-e565-461c-a374-5472b74c7c9d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:37.539793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae653cc2-e565-461c-a374-5472b74c7c9d None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:37.541062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae653cc2-e565-461c-a374-5472b74c7c9d None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:37.542649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae653cc2-e565-461c-a374-5472b74c7c9d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:37.544616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 44/92] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:37 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:37.551208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae653cc2-e565-461c-a374-5472b74c7c9d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:37.572644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c232c8f8-6524-47da-b2cc-665f925fd274 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:37.613392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:37.622783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f61f03-3bf8-4750-a3b7-ac3af09901ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:37.623711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61f03-3bf8-4750-a3b7-ac3af09901ed None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:37.624177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61f03-3bf8-4750-a3b7-ac3af09901ed None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:37.624574 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f61f03-3bf8-4750-a3b7-ac3af09901ed None admin] PATH_INFO: `/v3/users/b7178f44ee68469b88cc62895e6492a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:37.627586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f61f03-3bf8-4750-a3b7-ac3af09901ed None admin] RBAC: Authorizing `identity:get_user(user_id=b7178f44ee68469b88cc62895e6492a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:37.629274 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f61f03-3bf8-4750-a3b7-ac3af09901ed None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:37.631917 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 49/93] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:37 2022] GET /identity/v3/users/b7178f44ee68469b88cc62895e6492a6 => generated 275 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:37.640055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f61f03-3bf8-4750-a3b7-ac3af09901ed None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:37.697901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae653cc2-e565-461c-a374-5472b74c7c9d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:37.742130 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf7c05-914d-449b-8097-b406040c86dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:37.742852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf7c05-914d-449b-8097-b406040c86dc None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:37.743299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf7c05-914d-449b-8097-b406040c86dc None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:37.743575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bdf7c05-914d-449b-8097-b406040c86dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:37.744357 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf7c05-914d-449b-8097-b406040c86dc None admin] RBAC: Adding query filter params (role.id=568edd5e60424ffaa076d1c402c72b19, scope.project.id=23a9c71b85984efe850d28405efb5998, user.id=b7178f44ee68469b88cc62895e6492a6) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:37.744711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf7c05-914d-449b-8097-b406040c86dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:37.749062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bdf7c05-914d-449b-8097-b406040c86dc None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:37.755470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 45/94] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:03:37 2022] GET /identity/v3/role_assignments?user.id=b7178f44ee68469b88cc62895e6492a6&scope.project.id=23a9c71b85984efe850d28405efb5998&role.id=568edd5e60424ffaa076d1c402c72b19 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:37.758005 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:37.767347 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f61f03-3bf8-4750-a3b7-ac3af09901ed None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:37.820530 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0cb5c-9744-4f8f-b99f-102eb27da7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:37.821495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0cb5c-9744-4f8f-b99f-102eb27da7e3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:37.821982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0cb5c-9744-4f8f-b99f-102eb27da7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:37.822426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0cb5c-9744-4f8f-b99f-102eb27da7e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:37.912829 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0cb5c-9744-4f8f-b99f-102eb27da7e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:37.914793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0cb5c-9744-4f8f-b99f-102eb27da7e3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:38.041444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:38.050114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 50/95] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 19:03:38.056496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf7c05-914d-449b-8097-b406040c86dc None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:38.213580 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bdf7c05-914d-449b-8097-b406040c86dc None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:38.215456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:38.262419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae933964-c8c3-4e5a-8323-962cd391df97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:38.263077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae933964-c8c3-4e5a-8323-962cd391df97 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:38.263358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae933964-c8c3-4e5a-8323-962cd391df97 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:38.263631 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae933964-c8c3-4e5a-8323-962cd391df97 None admin] PATH_INFO: `/v3/projects/1b01798ddc534b5e88c0fab03617d77a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:38.264801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae933964-c8c3-4e5a-8323-962cd391df97 None admin] RBAC: Authorizing `identity:get_project(project_id=1b01798ddc534b5e88c0fab03617d77a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:38.266485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae933964-c8c3-4e5a-8323-962cd391df97 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:38.268684 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 46/96] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:38 2022] GET /identity/v3/projects/1b01798ddc534b5e88c0fab03617d77a => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:38.277103 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0cb5c-9744-4f8f-b99f-102eb27da7e3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:38.398245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0cb5c-9744-4f8f-b99f-102eb27da7e3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:38.439391 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d623cc-8fe4-4dd6-8f1f-721e5007cf54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:38.440311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d623cc-8fe4-4dd6-8f1f-721e5007cf54 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:38.440756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d623cc-8fe4-4dd6-8f1f-721e5007cf54 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:38.441192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d623cc-8fe4-4dd6-8f1f-721e5007cf54 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:38.442136 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d623cc-8fe4-4dd6-8f1f-721e5007cf54 None admin] RBAC: Adding query filter params (role.id=1e24ea020d1a46989b4f460308a32229, scope.project.id=1b01798ddc534b5e88c0fab03617d77a, user.id=b7178f44ee68469b88cc62895e6492a6) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:38.442668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d623cc-8fe4-4dd6-8f1f-721e5007cf54 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:38.444330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d623cc-8fe4-4dd6-8f1f-721e5007cf54 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:38.450592 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 51/97] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:03:38 2022] GET /identity/v3/role_assignments?user.id=b7178f44ee68469b88cc62895e6492a6&scope.project.id=1b01798ddc534b5e88c0fab03617d77a&role.id=1e24ea020d1a46989b4f460308a32229 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:39.921304 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639566c-82ef-418f-b32d-bed827d220e1 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:39.921880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639566c-82ef-418f-b32d-bed827d220e1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:39.921880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f639566c-82ef-418f-b32d-bed827d220e1 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:39.923239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 47/98] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:39.928974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d8ca3-039f-42bb-a425-892c5562bedb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:39.929938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d8ca3-039f-42bb-a425-892c5562bedb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:39.930426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04d8ca3-039f-42bb-a425-892c5562bedb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:39.952562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c04d8ca3-039f-42bb-a425-892c5562bedb None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:39.954111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c04d8ca3-039f-42bb-a425-892c5562bedb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:40.018449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:40.030917 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 52/99] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:40.436889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367acf5b-f280-46a0-98ef-82af4d1b2841 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:40.437176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367acf5b-f280-46a0-98ef-82af4d1b2841 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:40.437451 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367acf5b-f280-46a0-98ef-82af4d1b2841 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:40.438846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 48/100] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:40.444169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03011853-a55d-49d6-8fb0-1821473bb6a8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:40.444655 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03011853-a55d-49d6-8fb0-1821473bb6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:40.445041 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03011853-a55d-49d6-8fb0-1821473bb6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:40.474464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-03011853-a55d-49d6-8fb0-1821473bb6a8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:40.475781 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-03011853-a55d-49d6-8fb0-1821473bb6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:40.560619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 53/101] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:40.579297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367acf5b-f280-46a0-98ef-82af4d1b2841 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:40.739048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367acf5b-f280-46a0-98ef-82af4d1b2841 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:40.785073 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0611329-a845-4cfd-9a0d-fa23972189d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:40.785718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0611329-a845-4cfd-9a0d-fa23972189d9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:40.786031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0611329-a845-4cfd-9a0d-fa23972189d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:40.786303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0611329-a845-4cfd-9a0d-fa23972189d9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:40.802746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0611329-a845-4cfd-9a0d-fa23972189d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c0611329-a845-4cfd-9a0d-fa23972189d9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:40.807846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:40.808793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:40.809937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:40.809937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:40.809937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:40.809937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:40.809937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:40.809937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:40.809937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:40.809937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:40.809937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:40.809937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:40.809937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:40.809937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:40.809937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 49/102] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:03:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:40.816865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03011853-a55d-49d6-8fb0-1821473bb6a8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:40.881213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0611329-a845-4cfd-9a0d-fa23972189d9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:40.929704 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:41.058143 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0611329-a845-4cfd-9a0d-fa23972189d9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:41.116584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03011853-a55d-49d6-8fb0-1821473bb6a8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:41.140200 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1988581-e745-457d-bee1-04993301b9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:41.141302 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988581-e745-457d-bee1-04993301b9b2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.142025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988581-e745-457d-bee1-04993301b9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.142686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1988581-e745-457d-bee1-04993301b9b2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.160367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:41.166869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1988581-e745-457d-bee1-04993301b9b2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:41.181823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0f50d-b3cf-45ec-aabb-fffbc3b8b200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:41.181823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0f50d-b3cf-45ec-aabb-fffbc3b8b200 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.181823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0f50d-b3cf-45ec-aabb-fffbc3b8b200 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.181823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0f50d-b3cf-45ec-aabb-fffbc3b8b200 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.182229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0f50d-b3cf-45ec-aabb-fffbc3b8b200 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:41.182229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0f50d-b3cf-45ec-aabb-fffbc3b8b200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:41.182229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0f50d-b3cf-45ec-aabb-fffbc3b8b200 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-d1988581-e745-457d-bee1-04993301b9b2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:41.182881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:41.183911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:41.184837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:41.184837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:41.184837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:41.184837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:41.184837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:41.184837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:41.184837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:41.184837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:41.184837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:41.184837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:41.184837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:41.184837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:41.187565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 50/103] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:41.189618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05551ee-e3c2-4af3-a119-e60fa6434a30 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.190169 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05551ee-e3c2-4af3-a119-e60fa6434a30 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.190674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05551ee-e3c2-4af3-a119-e60fa6434a30 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.192541 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 51/104] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:41.199521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4a414-797f-4da0-b90d-53f0b7ba544c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.200055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 54/105] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 384 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:41.200272 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4a414-797f-4da0-b90d-53f0b7ba544c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.200727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d4a414-797f-4da0-b90d-53f0b7ba544c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.201280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0f50d-b3cf-45ec-aabb-fffbc3b8b200 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:41.230688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-70d4a414-797f-4da0-b90d-53f0b7ba544c None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:41.232496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-70d4a414-797f-4da0-b90d-53f0b7ba544c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:41.349178 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 52/106] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:41.350072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4a414-797f-4da0-b90d-53f0b7ba544c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:41.373229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:41.384694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0f50d-b3cf-45ec-aabb-fffbc3b8b200 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:41.425180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59837caa-0f59-4c12-8a0d-f417bb272a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:41.426101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59837caa-0f59-4c12-8a0d-f417bb272a84 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.426101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59837caa-0f59-4c12-8a0d-f417bb272a84 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.426427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59837caa-0f59-4c12-8a0d-f417bb272a84 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.427091 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59837caa-0f59-4c12-8a0d-f417bb272a84 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:41.427444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59837caa-0f59-4c12-8a0d-f417bb272a84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:41.428860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59837caa-0f59-4c12-8a0d-f417bb272a84 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:41.438430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 55/107] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:03:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:41.439759 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673587e6-65cd-4926-9657-dd6ea56fb681 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.440043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673587e6-65cd-4926-9657-dd6ea56fb681 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.440319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673587e6-65cd-4926-9657-dd6ea56fb681 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.441509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 56/108] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:41.446703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b050d-8c0a-4739-99f5-f85f2f0201f9 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.446984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b050d-8c0a-4739-99f5-f85f2f0201f9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.447258 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b050d-8c0a-4739-99f5-f85f2f0201f9 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.448508 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 57/109] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:41.449308 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b050d-8c0a-4739-99f5-f85f2f0201f9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:41.467945 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d4a414-797f-4da0-b90d-53f0b7ba544c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:41.503711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83cd1e78-75a8-4262-890e-08cc34f81d9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:41.504351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd1e78-75a8-4262-890e-08cc34f81d9d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.504628 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd1e78-75a8-4262-890e-08cc34f81d9d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.504899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83cd1e78-75a8-4262-890e-08cc34f81d9d None admin] PATH_INFO: `/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.506071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd1e78-75a8-4262-890e-08cc34f81d9d None admin] RBAC: Authorizing `identity:get_user(user_id=ec63c21fc22648d4ac6ebbc9ee1cd9d1)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:41.508012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83cd1e78-75a8-4262-890e-08cc34f81d9d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:41.509400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 53/110] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:41 2022] GET /identity/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1 => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:41.510607 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2294f-461f-4653-961f-82bf5f3862f0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.510854 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2294f-461f-4653-961f-82bf5f3862f0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.511130 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c2294f-461f-4653-961f-82bf5f3862f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.512988 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:41.532761 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-03c2294f-461f-4653-961f-82bf5f3862f0 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:41.533974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-03c2294f-461f-4653-961f-82bf5f3862f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:41.600507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3b050d-8c0a-4739-99f5-f85f2f0201f9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:41.602425 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 54/111] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:41.610909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7146a-a7af-4411-b7af-0a1bd51e49ed None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.611286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7146a-a7af-4411-b7af-0a1bd51e49ed None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.611812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f7146a-a7af-4411-b7af-0a1bd51e49ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.635817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-33f7146a-a7af-4411-b7af-0a1bd51e49ed None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:41.636930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-33f7146a-a7af-4411-b7af-0a1bd51e49ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:41.642864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1389424-db44-4c1e-b18a-eb8a4170d601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:41.643783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1389424-db44-4c1e-b18a-eb8a4170d601 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.644240 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1389424-db44-4c1e-b18a-eb8a4170d601 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.644692 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1389424-db44-4c1e-b18a-eb8a4170d601 None admin] PATH_INFO: `/v3/users/b7178f44ee68469b88cc62895e6492a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.646654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1389424-db44-4c1e-b18a-eb8a4170d601 None admin] RBAC: Authorizing `identity:get_user(user_id=b7178f44ee68469b88cc62895e6492a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:41.649296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1389424-db44-4c1e-b18a-eb8a4170d601 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:41.651995 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:41.652421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 58/112] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:41 2022] GET /identity/v3/users/b7178f44ee68469b88cc62895e6492a6 => generated 275 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:41.655084 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1389424-db44-4c1e-b18a-eb8a4170d601 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:41.718234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 55/113] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:41.719434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7146a-a7af-4411-b7af-0a1bd51e49ed None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:41.832792 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1389424-db44-4c1e-b18a-eb8a4170d601 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:41.849330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:41.867762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33f7146a-a7af-4411-b7af-0a1bd51e49ed None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:41.875988 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb52ae0-c990-4b39-9f78-9acd05c3fb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:41.876641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb52ae0-c990-4b39-9f78-9acd05c3fb8f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.876927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb52ae0-c990-4b39-9f78-9acd05c3fb8f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.877207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb52ae0-c990-4b39-9f78-9acd05c3fb8f None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.879644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb52ae0-c990-4b39-9f78-9acd05c3fb8f None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:41.879910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb52ae0-c990-4b39-9f78-9acd05c3fb8f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:41.881857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 59/114] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:41 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:41.883553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb52ae0-c990-4b39-9f78-9acd05c3fb8f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:41.906703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7eeb2d-0fab-4a80-97a3-c63cf3712061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:41.907266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7eeb2d-0fab-4a80-97a3-c63cf3712061 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.907548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7eeb2d-0fab-4a80-97a3-c63cf3712061 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.907818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7eeb2d-0fab-4a80-97a3-c63cf3712061 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.922738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7eeb2d-0fab-4a80-97a3-c63cf3712061 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-9d7eeb2d-0fab-4a80-97a3-c63cf3712061 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:41.928321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:41.929273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:41.930905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:41.930905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:41.930905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:41.930905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:41.930905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:41.930905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:41.930905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:41.930905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:41.930905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:41.930905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:41.930905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:03:41.930905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:41.931938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 56/115] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:41.934017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374367fe-2355-44fa-928d-35292ccb9e46 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:41.934206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374367fe-2355-44fa-928d-35292ccb9e46 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:41.934454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374367fe-2355-44fa-928d-35292ccb9e46 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:41.935883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 57/116] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:41.936620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374367fe-2355-44fa-928d-35292ccb9e46 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:41.950368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:41.999214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb52ae0-c990-4b39-9f78-9acd05c3fb8f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:42.038291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3a6df-a557-4867-9374-8c3cda9c696f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:42.039112 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3a6df-a557-4867-9374-8c3cda9c696f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:42.039535 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3a6df-a557-4867-9374-8c3cda9c696f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:42.039705 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee3a6df-a557-4867-9374-8c3cda9c696f None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:42.040951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3a6df-a557-4867-9374-8c3cda9c696f None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:42.042523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee3a6df-a557-4867-9374-8c3cda9c696f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:42.043109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374367fe-2355-44fa-928d-35292ccb9e46 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:42.044096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 60/117] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:41 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:42.044886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3a6df-a557-4867-9374-8c3cda9c696f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:42.077491 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4cb38-5620-4b37-b40b-3fa4073df4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:42.078174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4cb38-5620-4b37-b40b-3fa4073df4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:42.078452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4cb38-5620-4b37-b40b-3fa4073df4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:42.078718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f4cb38-5620-4b37-b40b-3fa4073df4d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:42.090304 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f4cb38-5620-4b37-b40b-3fa4073df4d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-27f4cb38-5620-4b37-b40b-3fa4073df4d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:42.095210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:42.096125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:42.096893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:42.096893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:42.096893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:42.096893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:42.096893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:42.096893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:42.096893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:42.096893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:42.096893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:42.096893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:42.096893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:03:42.096893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:42.096893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 58/118] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:03:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:42.097911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4cb38-5620-4b37-b40b-3fa4073df4d5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:42.098602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:42.154596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee3a6df-a557-4867-9374-8c3cda9c696f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:42.174327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:42.198122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b5e5d-999e-4f72-b99b-c03e9229fd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:42.198816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b5e5d-999e-4f72-b99b-c03e9229fd0d None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:42.199100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b5e5d-999e-4f72-b99b-c03e9229fd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:42.199378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b5e5d-999e-4f72-b99b-c03e9229fd0d None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:42.201420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b5e5d-999e-4f72-b99b-c03e9229fd0d None admin] RBAC: Authorizing `identity:create_grant(project_id=23a9c71b85984efe850d28405efb5998, user_id=ec63c21fc22648d4ac6ebbc9ee1cd9d1, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:42.203997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b5e5d-999e-4f72-b99b-c03e9229fd0d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:42.216613 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f4cb38-5620-4b37-b40b-3fa4073df4d5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:42.221485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 61/119] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:03:42 2022] PUT /identity/v3/projects/23a9c71b85984efe850d28405efb5998/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:03:42.234042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4132-0eeb-44aa-b9c5-0009673e79b1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:42.234042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4132-0eeb-44aa-b9c5-0009673e79b1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:42.234042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978d4132-0eeb-44aa-b9c5-0009673e79b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:42.255312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-978d4132-0eeb-44aa-b9c5-0009673e79b1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:42.256601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-978d4132-0eeb-44aa-b9c5-0009673e79b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:42.258345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf6a22-f00e-4729-9952-8556e4ed8760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:42.258997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf6a22-f00e-4729-9952-8556e4ed8760 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:42.259414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf6a22-f00e-4729-9952-8556e4ed8760 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:42.259521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaf6a22-f00e-4729-9952-8556e4ed8760 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:42.260222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf6a22-f00e-4729-9952-8556e4ed8760 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:42.260538 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf6a22-f00e-4729-9952-8556e4ed8760 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:42.262072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfaf6a22-f00e-4729-9952-8556e4ed8760 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:42.277195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 59/120] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:03:42 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:42.277195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf6a22-f00e-4729-9952-8556e4ed8760 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:42.356833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 62/121] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:42.358073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d4132-0eeb-44aa-b9c5-0009673e79b1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:42.407648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:42.426503 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaf6a22-f00e-4729-9952-8556e4ed8760 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:42.462754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:42.474129 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7ff10-f9c4-4582-8d3a-15abc2327425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:42.474781 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7ff10-f9c4-4582-8d3a-15abc2327425 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:42.475058 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7ff10-f9c4-4582-8d3a-15abc2327425 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:42.475328 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b7ff10-f9c4-4582-8d3a-15abc2327425 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:42.477298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7ff10-f9c4-4582-8d3a-15abc2327425 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:42.478802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b7ff10-f9c4-4582-8d3a-15abc2327425 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:42.480483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 60/122] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:42.481256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7ff10-f9c4-4582-8d3a-15abc2327425 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:42.487926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978d4132-0eeb-44aa-b9c5-0009673e79b1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:42.538726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df78ee-68d7-40e6-bab0-de2ec7634a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:42.539886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df78ee-68d7-40e6-bab0-de2ec7634a3b None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:42.540451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df78ee-68d7-40e6-bab0-de2ec7634a3b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:42.540909 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98df78ee-68d7-40e6-bab0-de2ec7634a3b None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998/users/b7178f44ee68469b88cc62895e6492a6/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:42.543357 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df78ee-68d7-40e6-bab0-de2ec7634a3b None admin] RBAC: Authorizing `identity:create_grant(project_id=23a9c71b85984efe850d28405efb5998, user_id=b7178f44ee68469b88cc62895e6492a6, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:42.545411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98df78ee-68d7-40e6-bab0-de2ec7634a3b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:42.565316 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 63/123] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:03:42 2022] PUT /identity/v3/projects/23a9c71b85984efe850d28405efb5998/users/b7178f44ee68469b88cc62895e6492a6/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:03:42.566634 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df78ee-68d7-40e6-bab0-de2ec7634a3b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:42.607400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b7ff10-f9c4-4582-8d3a-15abc2327425 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:42.653175 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f559d-0d00-4c6a-a4cd-cb58bbf6449c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:42.654741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f559d-0d00-4c6a-a4cd-cb58bbf6449c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:42.655021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f559d-0d00-4c6a-a4cd-cb58bbf6449c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:42.655303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09f559d-0d00-4c6a-a4cd-cb58bbf6449c None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:42.657605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f559d-0d00-4c6a-a4cd-cb58bbf6449c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:42.657605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f559d-0d00-4c6a-a4cd-cb58bbf6449c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:42.658765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09f559d-0d00-4c6a-a4cd-cb58bbf6449c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:42.682289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 61/124] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:03:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:42.684390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f559d-0d00-4c6a-a4cd-cb58bbf6449c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:42.719806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:42.727196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98df78ee-68d7-40e6-bab0-de2ec7634a3b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:42.774996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:42.780956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e261d-9240-4397-9990-4d4ffedec061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:42.782143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e261d-9240-4397-9990-4d4ffedec061 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:42.782636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e261d-9240-4397-9990-4d4ffedec061 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:42.783482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e261d-9240-4397-9990-4d4ffedec061 None admin] PATH_INFO: `/v3/users/fce6a133c1a342db8e07bf740a1c5877` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:42.805379 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e261d-9240-4397-9990-4d4ffedec061 None admin] RBAC: Authorizing `identity:get_user(user_id=fce6a133c1a342db8e07bf740a1c5877)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:42.807620 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e261d-9240-4397-9990-4d4ffedec061 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:42.811329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 64/125] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:42 2022] GET /identity/v3/users/fce6a133c1a342db8e07bf740a1c5877 => generated 289 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:42.816178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e261d-9240-4397-9990-4d4ffedec061 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:42.844389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09f559d-0d00-4c6a-a4cd-cb58bbf6449c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:42.887846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc4304-99d6-4dbc-b26c-0cc2f7144484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:42.888939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc4304-99d6-4dbc-b26c-0cc2f7144484 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:42.889422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc4304-99d6-4dbc-b26c-0cc2f7144484 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:42.889929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cc4304-99d6-4dbc-b26c-0cc2f7144484 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:42.890812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc4304-99d6-4dbc-b26c-0cc2f7144484 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:42.892511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cc4304-99d6-4dbc-b26c-0cc2f7144484 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:42.930594 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 62/126] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:03:42 2022] POST /identity/v3/projects => generated 302 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:03:42.932503 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc4304-99d6-4dbc-b26c-0cc2f7144484 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:42.946486 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e261d-9240-4397-9990-4d4ffedec061 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:42.988449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4698a41-4528-4867-a24f-1bd3e24b3b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:42.989120 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4698a41-4528-4867-a24f-1bd3e24b3b29 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:42.989423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4698a41-4528-4867-a24f-1bd3e24b3b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:42.989764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4698a41-4528-4867-a24f-1bd3e24b3b29 None admin] PATH_INFO: `/v3/users/b7178f44ee68469b88cc62895e6492a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:42.996400 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4698a41-4528-4867-a24f-1bd3e24b3b29 None admin] RBAC: Authorizing `identity:get_user(user_id=b7178f44ee68469b88cc62895e6492a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:42.998081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4698a41-4528-4867-a24f-1bd3e24b3b29 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:43.000066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 65/127] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:42 2022] GET /identity/v3/users/b7178f44ee68469b88cc62895e6492a6 => generated 275 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:43.000694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4698a41-4528-4867-a24f-1bd3e24b3b29 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:43.066184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:43.112296 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cc4304-99d6-4dbc-b26c-0cc2f7144484 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:43.128050 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:43.157415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ce8ad-56b2-4814-8481-b614c62d1711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:43.158306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ce8ad-56b2-4814-8481-b614c62d1711 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:43.158590 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ce8ad-56b2-4814-8481-b614c62d1711 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:43.158866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4ce8ad-56b2-4814-8481-b614c62d1711 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:43.174106 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4ce8ad-56b2-4814-8481-b614c62d1711 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-4b4ce8ad-56b2-4814-8481-b614c62d1711 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:43.180040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:43.181003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:43.181885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:43.181885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:43.181885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:43.181885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:43.181885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:43.181885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:43.181885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:43.181885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:43.181885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:43.181885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:43.181885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:43.181885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:43.181885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 63/128] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:43.182584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ce8ad-56b2-4814-8481-b614c62d1711 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:43.228423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4698a41-4528-4867-a24f-1bd3e24b3b29 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:43.278927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f608-5229-42fb-9f26-3bd24620180d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:43.278927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f608-5229-42fb-9f26-3bd24620180d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:43.278927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f608-5229-42fb-9f26-3bd24620180d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:43.279272 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f608-5229-42fb-9f26-3bd24620180d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:43.352562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0f608-5229-42fb-9f26-3bd24620180d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:43.354272 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0f608-5229-42fb-9f26-3bd24620180d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:43.357372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4ce8ad-56b2-4814-8481-b614c62d1711 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:43.383830 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:43.413374 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19c2a3-6be6-4ffd-ad77-f448e599bedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:43.414321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c2a3-6be6-4ffd-ad77-f448e599bedc None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:43.414748 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c2a3-6be6-4ffd-ad77-f448e599bedc None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:43.415174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c2a3-6be6-4ffd-ad77-f448e599bedc None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:43.417467 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19c2a3-6be6-4ffd-ad77-f448e599bedc None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:43.420582 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19c2a3-6be6-4ffd-ad77-f448e599bedc None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:43.426170 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 64/129] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:43 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:43.428229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19c2a3-6be6-4ffd-ad77-f448e599bedc None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:43.490679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 66/130] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 490 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:03:43.491790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f608-5229-42fb-9f26-3bd24620180d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:43.530190 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:43.592062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f608-5229-42fb-9f26-3bd24620180d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:43.622195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:43.631350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfd302-424a-46ed-af17-3dc324f233cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:43.632496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfd302-424a-46ed-af17-3dc324f233cc None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:43.632963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfd302-424a-46ed-af17-3dc324f233cc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:43.634106 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cfd302-424a-46ed-af17-3dc324f233cc None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998/users/b7178f44ee68469b88cc62895e6492a6/roles/568edd5e60424ffaa076d1c402c72b19` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:43.638451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfd302-424a-46ed-af17-3dc324f233cc None admin] RBAC: Authorizing `identity:create_grant(project_id=23a9c71b85984efe850d28405efb5998, user_id=b7178f44ee68469b88cc62895e6492a6, role_id=568edd5e60424ffaa076d1c402c72b19)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:43.640169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cfd302-424a-46ed-af17-3dc324f233cc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:43.666774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19c2a3-6be6-4ffd-ad77-f448e599bedc None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:43.676393 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 67/131] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:03:43 2022] PUT /identity/v3/projects/23a9c71b85984efe850d28405efb5998/users/b7178f44ee68469b88cc62895e6492a6/roles/568edd5e60424ffaa076d1c402c72b19 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:03:43.677502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfd302-424a-46ed-af17-3dc324f233cc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:43.716358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08128977-3e72-4a1f-9eec-d4dc4168476f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:43.717331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08128977-3e72-4a1f-9eec-d4dc4168476f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:43.717618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08128977-3e72-4a1f-9eec-d4dc4168476f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:43.717969 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08128977-3e72-4a1f-9eec-d4dc4168476f None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:43.719255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08128977-3e72-4a1f-9eec-d4dc4168476f None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:43.719647 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08128977-3e72-4a1f-9eec-d4dc4168476f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:43.721471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08128977-3e72-4a1f-9eec-d4dc4168476f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:43.740201 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 65/132] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:03:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:43.747752 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08128977-3e72-4a1f-9eec-d4dc4168476f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:43.928490 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08128977-3e72-4a1f-9eec-d4dc4168476f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:43.931282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:44.015741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5961313-6cf7-422a-b8d5-4f6a1872f6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:44.016462 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5961313-6cf7-422a-b8d5-4f6a1872f6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:44.016759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5961313-6cf7-422a-b8d5-4f6a1872f6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:44.017193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5961313-6cf7-422a-b8d5-4f6a1872f6d2 None admin] PATH_INFO: `/v3/users/b7178f44ee68469b88cc62895e6492a6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:44.024959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5961313-6cf7-422a-b8d5-4f6a1872f6d2 None admin] RBAC: Authorizing `identity:get_user(user_id=b7178f44ee68469b88cc62895e6492a6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:44.026502 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5961313-6cf7-422a-b8d5-4f6a1872f6d2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:44.029569 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 66/133] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:43 2022] GET /identity/v3/users/b7178f44ee68469b88cc62895e6492a6 => generated 275 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:44.035114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5961313-6cf7-422a-b8d5-4f6a1872f6d2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:44.038044 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cfd302-424a-46ed-af17-3dc324f233cc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:44.117328 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e447f79-e0d7-490f-8ae2-92244046e7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:44.118041 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447f79-e0d7-490f-8ae2-92244046e7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:44.118337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447f79-e0d7-490f-8ae2-92244046e7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:44.118616 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e447f79-e0d7-490f-8ae2-92244046e7c2 None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:44.121115 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e447f79-e0d7-490f-8ae2-92244046e7c2 None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:44.122679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e447f79-e0d7-490f-8ae2-92244046e7c2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:44.127480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 68/134] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:43 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 450 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:44.134072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e447f79-e0d7-490f-8ae2-92244046e7c2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:44.248820 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5961313-6cf7-422a-b8d5-4f6a1872f6d2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:44.250159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:44.333093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256ac60-5fc1-4803-8479-6033052a4d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:44.334302 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256ac60-5fc1-4803-8479-6033052a4d1b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:44.334878 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256ac60-5fc1-4803-8479-6033052a4d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:44.335292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2256ac60-5fc1-4803-8479-6033052a4d1b None admin] PATH_INFO: `/v3/projects/1b01798ddc534b5e88c0fab03617d77a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:44.339095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256ac60-5fc1-4803-8479-6033052a4d1b None admin] RBAC: Authorizing `identity:get_project(project_id=1b01798ddc534b5e88c0fab03617d77a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:44.340735 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2256ac60-5fc1-4803-8479-6033052a4d1b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:44.343088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 67/135] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:44 2022] GET /identity/v3/projects/1b01798ddc534b5e88c0fab03617d77a => generated 312 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:44.349680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256ac60-5fc1-4803-8479-6033052a4d1b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:44.375712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e447f79-e0d7-490f-8ae2-92244046e7c2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:44.432775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:44.450566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fda3e2-8cf7-471f-a30c-4d7de70932f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:44.451203 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda3e2-8cf7-471f-a30c-4d7de70932f4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:44.451483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda3e2-8cf7-471f-a30c-4d7de70932f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:44.451757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fda3e2-8cf7-471f-a30c-4d7de70932f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:44.452501 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fda3e2-8cf7-471f-a30c-4d7de70932f4 None admin] RBAC: Adding query filter params (role.id=b4a71464f9e64fa2bf52e7cbdec257c8, scope.project.id=23a9c71b85984efe850d28405efb5998, user.id=fce6a133c1a342db8e07bf740a1c5877) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:44.452809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fda3e2-8cf7-471f-a30c-4d7de70932f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:44.454735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fda3e2-8cf7-471f-a30c-4d7de70932f4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:44.466598 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 69/136] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:03:44 2022] GET /identity/v3/role_assignments?user.id=fce6a133c1a342db8e07bf740a1c5877&scope.project.id=23a9c71b85984efe850d28405efb5998&role.id=b4a71464f9e64fa2bf52e7cbdec257c8 => generated 259 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:44.575950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2256ac60-5fc1-4803-8479-6033052a4d1b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:44.621972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d20364b-ea35-49b8-ae13-c72bf7e6b6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:44.622964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20364b-ea35-49b8-ae13-c72bf7e6b6bb None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:44.623446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20364b-ea35-49b8-ae13-c72bf7e6b6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:44.623895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d20364b-ea35-49b8-ae13-c72bf7e6b6bb None admin] PATH_INFO: `/v3/projects/1b01798ddc534b5e88c0fab03617d77a/users/b7178f44ee68469b88cc62895e6492a6/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:44.627103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20364b-ea35-49b8-ae13-c72bf7e6b6bb None admin] RBAC: Authorizing `identity:create_grant(project_id=1b01798ddc534b5e88c0fab03617d77a, user_id=b7178f44ee68469b88cc62895e6492a6, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:44.628819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d20364b-ea35-49b8-ae13-c72bf7e6b6bb None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:44.655605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 68/137] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:03:44 2022] PUT /identity/v3/projects/1b01798ddc534b5e88c0fab03617d77a/users/b7178f44ee68469b88cc62895e6492a6/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:03:45.097642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432b48d-ecfd-4807-8eb7-1e19164c2e01 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:45.098076 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432b48d-ecfd-4807-8eb7-1e19164c2e01 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:45.098246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f432b48d-ecfd-4807-8eb7-1e19164c2e01 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:45.099784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 70/138] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:45.106077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bf434-e926-426e-9c83-ee5451811774 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:45.106557 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bf434-e926-426e-9c83-ee5451811774 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:45.106653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545bf434-e926-426e-9c83-ee5451811774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:45.130608 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-545bf434-e926-426e-9c83-ee5451811774 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:45.131865 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-545bf434-e926-426e-9c83-ee5451811774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:45.212010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 69/139] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:45.566123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432b48d-ecfd-4807-8eb7-1e19164c2e01 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:45.576830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d3108-e72e-4837-bb0e-ce54caaa7573 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:45.577166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d3108-e72e-4837-bb0e-ce54caaa7573 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:45.577376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8d3108-e72e-4837-bb0e-ce54caaa7573 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:45.578949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 70/140] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:45.588039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd08bf-e87d-4f9d-be9a-0b222788e67a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:45.588343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd08bf-e87d-4f9d-be9a-0b222788e67a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:45.588593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6dd08bf-e87d-4f9d-be9a-0b222788e67a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:45.620432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e6dd08bf-e87d-4f9d-be9a-0b222788e67a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:45.621640 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e6dd08bf-e87d-4f9d-be9a-0b222788e67a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:45.670160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:45.760598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 71/141] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:45.767432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f432b48d-ecfd-4807-8eb7-1e19164c2e01 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:45.802238 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:45.822643 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c0a9d1-9380-4fc3-b4a0-f7d71cfe8c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:45.823217 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a9d1-9380-4fc3-b4a0-f7d71cfe8c06 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:45.823499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a9d1-9380-4fc3-b4a0-f7d71cfe8c06 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:45.823772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c0a9d1-9380-4fc3-b4a0-f7d71cfe8c06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:45.847000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c0a9d1-9380-4fc3-b4a0-f7d71cfe8c06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-30c0a9d1-9380-4fc3-b4a0-f7d71cfe8c06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:45.852785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:45.853721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:45.854499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:45.854499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:45.854499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:45.854499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:45.854499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:45.854499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:45.854499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:45.854499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:45.854499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:45.854499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:45.854499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:45.854499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:03:45.854499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 71/142] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:03:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:03:45.861614 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd08bf-e87d-4f9d-be9a-0b222788e67a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:45.906008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adc972-8945-420b-a744-7145aca5e51a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:45.906665 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adc972-8945-420b-a744-7145aca5e51a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:45.907138 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65adc972-8945-420b-a744-7145aca5e51a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:45.908717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 72/143] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:45.915913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3c458-9500-4f8c-a24a-0b6b705d045a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:45.916484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3c458-9500-4f8c-a24a-0b6b705d045a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:45.916955 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f3c458-9500-4f8c-a24a-0b6b705d045a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:45.937094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e5f3c458-9500-4f8c-a24a-0b6b705d045a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:45.938803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e5f3c458-9500-4f8c-a24a-0b6b705d045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:46.018435 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 73/144] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:03:46.031126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6dd08bf-e87d-4f9d-be9a-0b222788e67a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:46.074510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9efeb-4311-43a9-a574-a5dbe0810e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:46.075085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9efeb-4311-43a9-a574-a5dbe0810e1c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:46.075362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9efeb-4311-43a9-a574-a5dbe0810e1c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:46.075682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b9efeb-4311-43a9-a574-a5dbe0810e1c None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:46.076357 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9efeb-4311-43a9-a574-a5dbe0810e1c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:46.076653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9efeb-4311-43a9-a574-a5dbe0810e1c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:46.082150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b9efeb-4311-43a9-a574-a5dbe0810e1c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:46.091521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 72/145] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:46.097101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3c458-9500-4f8c-a24a-0b6b705d045a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:46.190196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9efeb-4311-43a9-a574-a5dbe0810e1c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:46.234287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f3c458-9500-4f8c-a24a-0b6b705d045a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:46.244617 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:46.258359 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:46.308640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be23320-cb1c-435c-a156-0774cc615d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:46.308640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be23320-cb1c-435c-a156-0774cc615d9b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:46.308640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be23320-cb1c-435c-a156-0774cc615d9b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:46.308640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be23320-cb1c-435c-a156-0774cc615d9b None admin] PATH_INFO: `/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:46.310304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be23320-cb1c-435c-a156-0774cc615d9b None admin] RBAC: Authorizing `identity:get_user(user_id=ec63c21fc22648d4ac6ebbc9ee1cd9d1)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:46.311840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be23320-cb1c-435c-a156-0774cc615d9b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:46.314483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 74/146] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:46 2022] GET /identity/v3/users/ec63c21fc22648d4ac6ebbc9ee1cd9d1 => generated 247 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:46.321423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be23320-cb1c-435c-a156-0774cc615d9b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:46.358287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b9efeb-4311-43a9-a574-a5dbe0810e1c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:46.414174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed8af8-a8a1-487a-a2e2-2913baf2c734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:46.415227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed8af8-a8a1-487a-a2e2-2913baf2c734 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:46.415701 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed8af8-a8a1-487a-a2e2-2913baf2c734 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:46.416157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ed8af8-a8a1-487a-a2e2-2913baf2c734 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:46.435053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ed8af8-a8a1-487a-a2e2-2913baf2c734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-f4ed8af8-a8a1-487a-a2e2-2913baf2c734 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:46.444893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:46.446335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:46.447600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:46.447600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:46.447600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:46.447600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:46.447600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:46.447600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:46.447600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:46.447600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:46.447600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:46.447600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:46.447600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:46.447600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:46.458856 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 73/147] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:46.460172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed8af8-a8a1-487a-a2e2-2913baf2c734 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:46.521842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be23320-cb1c-435c-a156-0774cc615d9b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:46.558807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7421b72-c65e-40c6-bd7a-141810704051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:46.559436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7421b72-c65e-40c6-bd7a-141810704051 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:46.559714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7421b72-c65e-40c6-bd7a-141810704051 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:46.559984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7421b72-c65e-40c6-bd7a-141810704051 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:46.602875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:46.610726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:46.641878 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7421b72-c65e-40c6-bd7a-141810704051 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:46.643858 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7421b72-c65e-40c6-bd7a-141810704051 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:46.648991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ed8af8-a8a1-487a-a2e2-2913baf2c734 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:46.723986 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c382c8-bbf2-4b04-8519-0dbd1431dc76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:46.725020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c382c8-bbf2-4b04-8519-0dbd1431dc76 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:46.725543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c382c8-bbf2-4b04-8519-0dbd1431dc76 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:46.727400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c382c8-bbf2-4b04-8519-0dbd1431dc76 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:46.730082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c382c8-bbf2-4b04-8519-0dbd1431dc76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:46.731836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c382c8-bbf2-4b04-8519-0dbd1431dc76 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:46.739772 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 74/148] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:46.740466 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c382c8-bbf2-4b04-8519-0dbd1431dc76 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:46.780783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 75/149] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 460 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 19:03:46.781998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7421b72-c65e-40c6-bd7a-141810704051 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:46.862980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:46.893606 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7421b72-c65e-40c6-bd7a-141810704051 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:46.938168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c382c8-bbf2-4b04-8519-0dbd1431dc76 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:46.938718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf2441-134e-4cb7-a141-2db224eef4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:46.940325 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf2441-134e-4cb7-a141-2db224eef4d4 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:46.941070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf2441-134e-4cb7-a141-2db224eef4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:46.941902 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babf2441-134e-4cb7-a141-2db224eef4d4 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:46.943431 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf2441-134e-4cb7-a141-2db224eef4d4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:46.946547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babf2441-134e-4cb7-a141-2db224eef4d4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:46.995927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 76/150] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:03:46 2022] POST /identity/v3/users => generated 283 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:03:46.997955 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf2441-134e-4cb7-a141-2db224eef4d4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:47.027700 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9287c-2952-46de-847f-ab3b4b97c005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:47.028359 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9287c-2952-46de-847f-ab3b4b97c005 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:47.028616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9287c-2952-46de-847f-ab3b4b97c005 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:47.028885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a9287c-2952-46de-847f-ab3b4b97c005 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:47.029815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9287c-2952-46de-847f-ab3b4b97c005 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:47.029943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9287c-2952-46de-847f-ab3b4b97c005 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:47.031470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a9287c-2952-46de-847f-ab3b4b97c005 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:47.050028 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 75/151] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:03:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:47.058193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9287c-2952-46de-847f-ab3b4b97c005 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:47.079535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:47.146677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babf2441-134e-4cb7-a141-2db224eef4d4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:47.185684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:47.195735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b345ef8-f3cb-410b-99dc-26a7b2a4b620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:47.196868 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b345ef8-f3cb-410b-99dc-26a7b2a4b620 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:47.197335 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b345ef8-f3cb-410b-99dc-26a7b2a4b620 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:47.197816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b345ef8-f3cb-410b-99dc-26a7b2a4b620 None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:47.200449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b345ef8-f3cb-410b-99dc-26a7b2a4b620 None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:47.202337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b345ef8-f3cb-410b-99dc-26a7b2a4b620 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:47.204712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 77/152] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:46 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:47.230658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b345ef8-f3cb-410b-99dc-26a7b2a4b620 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:47.270151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a9287c-2952-46de-847f-ab3b4b97c005 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:47.349985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533dea-9632-483a-bd56-f9930dfbfab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:47.350710 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533dea-9632-483a-bd56-f9930dfbfab9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:47.351002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533dea-9632-483a-bd56-f9930dfbfab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:47.351281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8533dea-9632-483a-bd56-f9930dfbfab9 None admin] PATH_INFO: `/v3/users/b7178f44ee68469b88cc62895e6492a6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:47.352461 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8533dea-9632-483a-bd56-f9930dfbfab9 None admin] RBAC: Authorizing `identity:get_user(user_id=b7178f44ee68469b88cc62895e6492a6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:47.355385 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b345ef8-f3cb-410b-99dc-26a7b2a4b620 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:47.358021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8533dea-9632-483a-bd56-f9930dfbfab9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:47.360091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 76/153] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:47 2022] GET /identity/v3/users/b7178f44ee68469b88cc62895e6492a6 => generated 275 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:47.365377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533dea-9632-483a-bd56-f9930dfbfab9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:47.399997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924dd726-2e21-4d8e-8f84-78128689662b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:47.402015 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dd726-2e21-4d8e-8f84-78128689662b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:47.402768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dd726-2e21-4d8e-8f84-78128689662b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:47.406296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924dd726-2e21-4d8e-8f84-78128689662b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:47.407104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dd726-2e21-4d8e-8f84-78128689662b None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=23a9c71b85984efe850d28405efb5998, user.id=ec63c21fc22648d4ac6ebbc9ee1cd9d1) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:47.407422 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dd726-2e21-4d8e-8f84-78128689662b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:47.408981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924dd726-2e21-4d8e-8f84-78128689662b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:47.421368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 78/154] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:03:47 2022] GET /identity/v3/role_assignments?user.id=ec63c21fc22648d4ac6ebbc9ee1cd9d1&scope.project.id=23a9c71b85984efe850d28405efb5998&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:47.423242 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aef8e-8c98-40ef-afec-10dc4f7f5252 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:47.423771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aef8e-8c98-40ef-afec-10dc4f7f5252 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:47.424229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344aef8e-8c98-40ef-afec-10dc4f7f5252 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:47.427484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 79/155] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:47.436772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab851aa8-e8c5-4b35-a908-0a1362d3e8a4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:47.437468 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab851aa8-e8c5-4b35-a908-0a1362d3e8a4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:47.437967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab851aa8-e8c5-4b35-a908-0a1362d3e8a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:47.469846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ab851aa8-e8c5-4b35-a908-0a1362d3e8a4 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:47.472947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ab851aa8-e8c5-4b35-a908-0a1362d3e8a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:47.526114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:47.583771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8533dea-9632-483a-bd56-f9930dfbfab9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:47.601897 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:47.628066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 80/156] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:47.643316 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c944392-4b10-4ac5-bedc-67041fe51799 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:47.643621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c944392-4b10-4ac5-bedc-67041fe51799 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:47.643859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c944392-4b10-4ac5-bedc-67041fe51799 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:47.645729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 81/157] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:47.651383 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918884f-a23f-4408-8b98-1c4ee3140f4e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:47.651890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918884f-a23f-4408-8b98-1c4ee3140f4e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:47.652372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a918884f-a23f-4408-8b98-1c4ee3140f4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:47.669669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c4c08-83ed-4574-96a7-3079bbbf1f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:47.670469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c4c08-83ed-4574-96a7-3079bbbf1f42 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:47.674297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c4c08-83ed-4574-96a7-3079bbbf1f42 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:47.674578 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219c4c08-83ed-4574-96a7-3079bbbf1f42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:47.688668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a918884f-a23f-4408-8b98-1c4ee3140f4e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:47.689929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a918884f-a23f-4408-8b98-1c4ee3140f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:47.783013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c4c08-83ed-4574-96a7-3079bbbf1f42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:47.784881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-219c4c08-83ed-4574-96a7-3079bbbf1f42 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:47.820894 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 82/158] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:47.906659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:47.934648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 77/159] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 570 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 19:03:47.940369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918884f-a23f-4408-8b98-1c4ee3140f4e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:48.019549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c4c08-83ed-4574-96a7-3079bbbf1f42 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:48.082415 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a918884f-a23f-4408-8b98-1c4ee3140f4e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:48.135595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:48.156930 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7c91f-75dc-4787-9301-3a54dd9cd2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:48.158128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7c91f-75dc-4787-9301-3a54dd9cd2fb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:48.158664 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7c91f-75dc-4787-9301-3a54dd9cd2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:48.159188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b7c91f-75dc-4787-9301-3a54dd9cd2fb None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:48.160579 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7c91f-75dc-4787-9301-3a54dd9cd2fb None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:48.162371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b7c91f-75dc-4787-9301-3a54dd9cd2fb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:48.164543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 83/160] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:47 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:48.173702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7c91f-75dc-4787-9301-3a54dd9cd2fb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:48.234291 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219c4c08-83ed-4574-96a7-3079bbbf1f42 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:48.302654 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee579ac-83f3-414b-b53c-9f0b105d96c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:48.305451 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee579ac-83f3-414b-b53c-9f0b105d96c6 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:48.308683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee579ac-83f3-414b-b53c-9f0b105d96c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:48.309206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee579ac-83f3-414b-b53c-9f0b105d96c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:48.332572 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee579ac-83f3-414b-b53c-9f0b105d96c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:48.340334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b7c91f-75dc-4787-9301-3a54dd9cd2fb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-0ee579ac-83f3-414b-b53c-9f0b105d96c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:48.341338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:48.342294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:48.343240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:48.343240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:48.343240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:48.343240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:48.343240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:48.343240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:48.343240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:48.343240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:48.343240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:48.343240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:48.343240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:03:48.343240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:48.345385 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 78/161] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:03:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:48.346463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee579ac-83f3-414b-b53c-9f0b105d96c6 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:48.386104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe6c3e-d0e2-4a2a-bf21-45e49c8b852c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:48.386730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe6c3e-d0e2-4a2a-bf21-45e49c8b852c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:48.387022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe6c3e-d0e2-4a2a-bf21-45e49c8b852c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:48.387285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe6c3e-d0e2-4a2a-bf21-45e49c8b852c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:48.388059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe6c3e-d0e2-4a2a-bf21-45e49c8b852c None admin] RBAC: Adding query filter params (role.id=1e24ea020d1a46989b4f460308a32229, scope.project.id=23a9c71b85984efe850d28405efb5998, user.id=b7178f44ee68469b88cc62895e6492a6) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:48.388371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe6c3e-d0e2-4a2a-bf21-45e49c8b852c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:48.391120 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe6c3e-d0e2-4a2a-bf21-45e49c8b852c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:48.397929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 84/162] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:03:48 2022] GET /identity/v3/role_assignments?user.id=b7178f44ee68469b88cc62895e6492a6&scope.project.id=23a9c71b85984efe850d28405efb5998&role.id=1e24ea020d1a46989b4f460308a32229 => generated 608 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:48.397929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe6c3e-d0e2-4a2a-bf21-45e49c8b852c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:48.416839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:48.490093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:48.503225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee579ac-83f3-414b-b53c-9f0b105d96c6 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:48.554398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3bbe27-31a2-49a0-abea-90a034d1d7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:48.555354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bbe27-31a2-49a0-abea-90a034d1d7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:48.555726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bbe27-31a2-49a0-abea-90a034d1d7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:48.556075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3bbe27-31a2-49a0-abea-90a034d1d7e4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:48.569907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3bbe27-31a2-49a0-abea-90a034d1d7e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:48.574323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe6c3e-d0e2-4a2a-bf21-45e49c8b852c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ec3bbe27-31a2-49a0-abea-90a034d1d7e4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:48.575339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:48.576418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:48.577378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:48.577378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:48.577378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:48.577378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:48.577378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:48.577378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:48.577378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:48.577378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:48.577378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:48.577378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:48.577378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:03:48.577378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:48.579539 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 79/163] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:48.584514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f442c-b586-4a50-9c24-47d51428c57d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:48.584514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f442c-b586-4a50-9c24-47d51428c57d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:48.584514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9f442c-b586-4a50-9c24-47d51428c57d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:48.585158 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 80/164] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:48.585627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f442c-b586-4a50-9c24-47d51428c57d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:48.648518 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453cf7a6-91a2-472a-8ef3-149e78789b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:48.650802 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cf7a6-91a2-472a-8ef3-149e78789b99 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:48.651188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cf7a6-91a2-472a-8ef3-149e78789b99 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:48.651462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453cf7a6-91a2-472a-8ef3-149e78789b99 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:48.652340 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cf7a6-91a2-472a-8ef3-149e78789b99 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:48.652754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cf7a6-91a2-472a-8ef3-149e78789b99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:48.654718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-453cf7a6-91a2-472a-8ef3-149e78789b99 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:48.670759 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 85/165] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:03:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:48.671817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29a18-ebbb-4359-b660-8e6f59018c17 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:48.672105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29a18-ebbb-4359-b660-8e6f59018c17 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:48.672365 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a29a18-ebbb-4359-b660-8e6f59018c17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:48.703030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c4a29a18-ebbb-4359-b660-8e6f59018c17 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:48.704247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c4a29a18-ebbb-4359-b660-8e6f59018c17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:48.739762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:48.746954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9f442c-b586-4a50-9c24-47d51428c57d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:48.786269 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f892c-fa6f-4232-bc76-6c0112af717e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:48.786849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f892c-fa6f-4232-bc76-6c0112af717e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:48.787124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f892c-fa6f-4232-bc76-6c0112af717e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:48.787388 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4f892c-fa6f-4232-bc76-6c0112af717e None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:48.788421 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f892c-fa6f-4232-bc76-6c0112af717e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:48.788721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f892c-fa6f-4232-bc76-6c0112af717e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:48.790496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4f892c-fa6f-4232-bc76-6c0112af717e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:48.796389 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 86/166] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:48.801936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 81/167] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:03:48 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:48.802125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a29a18-ebbb-4359-b660-8e6f59018c17 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:48.811174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f892c-fa6f-4232-bc76-6c0112af717e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:48.921596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:49.043175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a29a18-ebbb-4359-b660-8e6f59018c17 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:49.052069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4f892c-fa6f-4232-bc76-6c0112af717e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:49.088870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2ebad-2fd9-40fc-b209-e3a98b8d56f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:49.090239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2ebad-2fd9-40fc-b209-e3a98b8d56f0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:49.091023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2ebad-2fd9-40fc-b209-e3a98b8d56f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:49.091746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd2ebad-2fd9-40fc-b209-e3a98b8d56f0 None admin] PATH_INFO: `/v3/users/b7178f44ee68469b88cc62895e6492a6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:49.095461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2ebad-2fd9-40fc-b209-e3a98b8d56f0 None admin] RBAC: Authorizing `identity:get_user(user_id=b7178f44ee68469b88cc62895e6492a6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:49.097815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd2ebad-2fd9-40fc-b209-e3a98b8d56f0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:49.099727 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 87/168] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:48 2022] GET /identity/v3/users/b7178f44ee68469b88cc62895e6492a6 => generated 275 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:49.107644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2ebad-2fd9-40fc-b209-e3a98b8d56f0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:49.151171 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d9cc1-dab2-4bb9-8e5c-7f9a2daac693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:49.151840 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d9cc1-dab2-4bb9-8e5c-7f9a2daac693 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:49.152118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d9cc1-dab2-4bb9-8e5c-7f9a2daac693 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:49.152391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9d9cc1-dab2-4bb9-8e5c-7f9a2daac693 None admin] PATH_INFO: `/v3/users/fce6a133c1a342db8e07bf740a1c5877` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:49.154574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d9cc1-dab2-4bb9-8e5c-7f9a2daac693 None admin] RBAC: Authorizing `identity:get_user(user_id=fce6a133c1a342db8e07bf740a1c5877)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:49.156360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9d9cc1-dab2-4bb9-8e5c-7f9a2daac693 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:49.157867 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 82/169] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:48 2022] GET /identity/v3/users/fce6a133c1a342db8e07bf740a1c5877 => generated 289 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:49.163732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d9cc1-dab2-4bb9-8e5c-7f9a2daac693 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:49.219945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd2ebad-2fd9-40fc-b209-e3a98b8d56f0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:49.242910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:49.245684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:49.261037 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bf6c6-f366-4a0c-8b26-10c512021a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:49.261674 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bf6c6-f366-4a0c-8b26-10c512021a38 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:49.262005 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bf6c6-f366-4a0c-8b26-10c512021a38 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:49.262282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488bf6c6-f366-4a0c-8b26-10c512021a38 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:49.347691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bf6c6-f366-4a0c-8b26-10c512021a38 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:49.352684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488bf6c6-f366-4a0c-8b26-10c512021a38 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:49.411401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9d9cc1-dab2-4bb9-8e5c-7f9a2daac693 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:49.461012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc50e38-d01d-4652-8f7a-de42bcf88235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:49.461906 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc50e38-d01d-4652-8f7a-de42bcf88235 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:49.462378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc50e38-d01d-4652-8f7a-de42bcf88235 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:49.462654 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc50e38-d01d-4652-8f7a-de42bcf88235 None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:49.464062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc50e38-d01d-4652-8f7a-de42bcf88235 None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:49.465600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc50e38-d01d-4652-8f7a-de42bcf88235 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:49.467376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 83/170] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:49 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:49.468168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc50e38-d01d-4652-8f7a-de42bcf88235 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:49.572454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 88/171] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 19:03:49.573756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bf6c6-f366-4a0c-8b26-10c512021a38 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:49.592895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:49.689922 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:49.698513 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc50e38-d01d-4652-8f7a-de42bcf88235 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:49.715717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488bf6c6-f366-4a0c-8b26-10c512021a38 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:49.758274 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da4bc6-e735-42fa-a0e5-4bb4e562ae3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:49.758972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da4bc6-e735-42fa-a0e5-4bb4e562ae3c None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:49.759250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da4bc6-e735-42fa-a0e5-4bb4e562ae3c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:49.759524 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13da4bc6-e735-42fa-a0e5-4bb4e562ae3c None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998/users/fce6a133c1a342db8e07bf740a1c5877/roles/b4a71464f9e64fa2bf52e7cbdec257c8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:49.762372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da4bc6-e735-42fa-a0e5-4bb4e562ae3c None admin] RBAC: Authorizing `identity:create_grant(project_id=23a9c71b85984efe850d28405efb5998, user_id=fce6a133c1a342db8e07bf740a1c5877, role_id=b4a71464f9e64fa2bf52e7cbdec257c8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:49.765287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13da4bc6-e735-42fa-a0e5-4bb4e562ae3c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:49.775222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349c660-07ae-4cd6-8171-0945dbf3d439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:49.775894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349c660-07ae-4cd6-8171-0945dbf3d439 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:49.776226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349c660-07ae-4cd6-8171-0945dbf3d439 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:49.776521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5349c660-07ae-4cd6-8171-0945dbf3d439 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:49.791362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 89/172] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:03:49 2022] PUT /identity/v3/projects/23a9c71b85984efe850d28405efb5998/users/fce6a133c1a342db8e07bf740a1c5877/roles/b4a71464f9e64fa2bf52e7cbdec257c8 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:03:49.792270 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da4bc6-e735-42fa-a0e5-4bb4e562ae3c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:49.800100 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5349c660-07ae-4cd6-8171-0945dbf3d439 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-5349c660-07ae-4cd6-8171-0945dbf3d439 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:49.806127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:49.807101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:49.807899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:49.807899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:49.807899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:49.807899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:49.807899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:49.807899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:49.807899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:49.807899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:49.807899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:49.807899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:49.807899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:49.807899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:49.807899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 84/173] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:49.819114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349c660-07ae-4cd6-8171-0945dbf3d439 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:49.945165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:50.044788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13da4bc6-e735-42fa-a0e5-4bb4e562ae3c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:50.046227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5349c660-07ae-4cd6-8171-0945dbf3d439 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:50.104923 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ca143-c211-433e-9fd6-ba9742cf864a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:50.105583 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ca143-c211-433e-9fd6-ba9742cf864a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:50.105886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ca143-c211-433e-9fd6-ba9742cf864a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:50.106159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315ca143-c211-433e-9fd6-ba9742cf864a None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:50.109081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ca143-c211-433e-9fd6-ba9742cf864a None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:50.110597 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315ca143-c211-433e-9fd6-ba9742cf864a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:50.112368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 90/174] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:49 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:50.118983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ca143-c211-433e-9fd6-ba9742cf864a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:50.119919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bd1ac-e077-4ea9-8f6f-33e16c534559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:50.120565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd1ac-e077-4ea9-8f6f-33e16c534559 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:50.120850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd1ac-e077-4ea9-8f6f-33e16c534559 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:50.121119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508bd1ac-e077-4ea9-8f6f-33e16c534559 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:50.121906 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bd1ac-e077-4ea9-8f6f-33e16c534559 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:50.122216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bd1ac-e077-4ea9-8f6f-33e16c534559 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:50.123666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-508bd1ac-e077-4ea9-8f6f-33e16c534559 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:50.143917 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 85/175] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:03:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:50.152118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bd1ac-e077-4ea9-8f6f-33e16c534559 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:50.193192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:50.230013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315ca143-c211-433e-9fd6-ba9742cf864a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:50.274848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8848c7-2e1c-41c4-8768-040fd3b1e21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:50.275482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8848c7-2e1c-41c4-8768-040fd3b1e21d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:50.275763 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8848c7-2e1c-41c4-8768-040fd3b1e21d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:50.276037 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8848c7-2e1c-41c4-8768-040fd3b1e21d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:50.276808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8848c7-2e1c-41c4-8768-040fd3b1e21d None admin] RBAC: Adding query filter params (role.id=568edd5e60424ffaa076d1c402c72b19, scope.project.id=23a9c71b85984efe850d28405efb5998, user.id=b7178f44ee68469b88cc62895e6492a6) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:50.277117 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8848c7-2e1c-41c4-8768-040fd3b1e21d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:50.278648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8848c7-2e1c-41c4-8768-040fd3b1e21d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:50.288446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 91/176] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:03:50 2022] GET /identity/v3/role_assignments?user.id=b7178f44ee68469b88cc62895e6492a6&scope.project.id=23a9c71b85984efe850d28405efb5998&role.id=568edd5e60424ffaa076d1c402c72b19 => generated 608 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:50.428598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508bd1ac-e077-4ea9-8f6f-33e16c534559 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:50.486698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a090055-04eb-4ada-abd9-761cf3051825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:50.487274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a090055-04eb-4ada-abd9-761cf3051825 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:50.487553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a090055-04eb-4ada-abd9-761cf3051825 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:50.487823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a090055-04eb-4ada-abd9-761cf3051825 None admin] PATH_INFO: `/v3/users/b7178f44ee68469b88cc62895e6492a6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:50.494687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a090055-04eb-4ada-abd9-761cf3051825 None admin] RBAC: Authorizing `identity:get_user(user_id=b7178f44ee68469b88cc62895e6492a6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:50.496293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a090055-04eb-4ada-abd9-761cf3051825 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:50.498284 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 86/177] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:50 2022] GET /identity/v3/users/b7178f44ee68469b88cc62895e6492a6 => generated 275 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:50.504248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8848c7-2e1c-41c4-8768-040fd3b1e21d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:50.518958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:50.649569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8848c7-2e1c-41c4-8768-040fd3b1e21d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:50.686082 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ee0c6-1e3b-4b7b-b774-05eaf1286c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:50.686706 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ee0c6-1e3b-4b7b-b774-05eaf1286c7e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:50.686985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ee0c6-1e3b-4b7b-b774-05eaf1286c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:50.687258 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30ee0c6-1e3b-4b7b-b774-05eaf1286c7e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:50.751480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221888-af89-495d-8621-106ca021810c None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:50.751766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221888-af89-495d-8621-106ca021810c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:50.752001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47221888-af89-495d-8621-106ca021810c None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:50.753536 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 87/178] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:50.762404 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff1404-8745-4ccb-aea5-585ef0459b66 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:50.762726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff1404-8745-4ccb-aea5-585ef0459b66 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:50.762958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aff1404-8745-4ccb-aea5-585ef0459b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:50.770403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ee0c6-1e3b-4b7b-b774-05eaf1286c7e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:50.771905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30ee0c6-1e3b-4b7b-b774-05eaf1286c7e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:50.790235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:50.800807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5aff1404-8745-4ccb-aea5-585ef0459b66 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:50.802236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5aff1404-8745-4ccb-aea5-585ef0459b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:50.892395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 92/179] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:03:50.899099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ee0c6-1e3b-4b7b-b774-05eaf1286c7e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:50.967003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 88/180] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:51.007976 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30ee0c6-1e3b-4b7b-b774-05eaf1286c7e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:51.016543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:51.047336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9acb3-d2b9-43ae-9a85-46964a58bd12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:51.047992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9acb3-d2b9-43ae-9a85-46964a58bd12 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:51.048273 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9acb3-d2b9-43ae-9a85-46964a58bd12 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:51.048546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f9acb3-d2b9-43ae-9a85-46964a58bd12 None admin] PATH_INFO: `/v3/projects/1b01798ddc534b5e88c0fab03617d77a` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:51.049707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9acb3-d2b9-43ae-9a85-46964a58bd12 None admin] RBAC: Authorizing `identity:get_project(project_id=1b01798ddc534b5e88c0fab03617d77a)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:51.051214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f9acb3-d2b9-43ae-9a85-46964a58bd12 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:51.054992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 93/181] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:50 2022] GET /identity/v3/projects/1b01798ddc534b5e88c0fab03617d77a => generated 312 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:51.060151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff1404-8745-4ccb-aea5-585ef0459b66 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:51.079537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:51.186704 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aff1404-8745-4ccb-aea5-585ef0459b66 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:51.237448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10244ea-9031-475f-9520-a387bbe4b908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:51.238116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10244ea-9031-475f-9520-a387bbe4b908 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:51.238390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10244ea-9031-475f-9520-a387bbe4b908 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:51.238660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10244ea-9031-475f-9520-a387bbe4b908 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:51.239409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10244ea-9031-475f-9520-a387bbe4b908 None admin] RBAC: Adding query filter params (role.id=1e24ea020d1a46989b4f460308a32229, scope.project.id=1b01798ddc534b5e88c0fab03617d77a, user.id=b7178f44ee68469b88cc62895e6492a6) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:51.239711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10244ea-9031-475f-9520-a387bbe4b908 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:51.241245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10244ea-9031-475f-9520-a387bbe4b908 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:51.252217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 89/182] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:03:51 2022] GET /identity/v3/role_assignments?user.id=b7178f44ee68469b88cc62895e6492a6&scope.project.id=1b01798ddc534b5e88c0fab03617d77a&role.id=1e24ea020d1a46989b4f460308a32229 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:51.414869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9acb3-d2b9-43ae-9a85-46964a58bd12 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:51.518123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab4d87-5460-4ce6-b6f4-4d52391f4bb3 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:51.519308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab4d87-5460-4ce6-b6f4-4d52391f4bb3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:51.520226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ab4d87-5460-4ce6-b6f4-4d52391f4bb3 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:51.522096 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 90/183] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:51.535383 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5a702-43b6-4bc4-87fe-a23e516b2618 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:51.536014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5a702-43b6-4bc4-87fe-a23e516b2618 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:51.536475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5a702-43b6-4bc4-87fe-a23e516b2618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:51.548183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f9acb3-d2b9-43ae-9a85-46964a58bd12 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:51.556773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0fc5a702-43b6-4bc4-87fe-a23e516b2618 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:51.558377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0fc5a702-43b6-4bc4-87fe-a23e516b2618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:51.592824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38c355a-7ffe-4fc3-bb4c-c933286ff07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:51.593484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c355a-7ffe-4fc3-bb4c-c933286ff07f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:51.593764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c355a-7ffe-4fc3-bb4c-c933286ff07f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:51.594715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38c355a-7ffe-4fc3-bb4c-c933286ff07f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:51.608257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38c355a-7ffe-4fc3-bb4c-c933286ff07f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d38c355a-7ffe-4fc3-bb4c-c933286ff07f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:51.614771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:51.615714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:51.616528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:51.616528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:51.616528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:51.616528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:51.616528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:51.616528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:51.616528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:51.616528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:51.616528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:51.616528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:51.616528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:51.616528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:03:51.617603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 94/184] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:03:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:51.619517 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aa819-ab41-48b2-b774-452781851346 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:51.619803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aa819-ab41-48b2-b774-452781851346 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:51.620074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9aa819-ab41-48b2-b774-452781851346 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:51.622577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 95/185] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:51.625187 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9aa819-ab41-48b2-b774-452781851346 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:51.659623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 91/186] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:51.661552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32588ef1-290c-4b4e-9de6-bbe2096f2923 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:51.662049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32588ef1-290c-4b4e-9de6-bbe2096f2923 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:51.662578 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32588ef1-290c-4b4e-9de6-bbe2096f2923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:51.667099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:51.686424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-32588ef1-290c-4b4e-9de6-bbe2096f2923 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:51.688115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-32588ef1-290c-4b4e-9de6-bbe2096f2923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:51.691677 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:51.748918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9aa819-ab41-48b2-b774-452781851346 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:51.792990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 92/187] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:51.800932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f33e8-f0ed-4dd3-b34d-4c203bac078e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:51.802366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f33e8-f0ed-4dd3-b34d-4c203bac078e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:51.802836 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f33e8-f0ed-4dd3-b34d-4c203bac078e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:51.803345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018f33e8-f0ed-4dd3-b34d-4c203bac078e None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:51.804228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f33e8-f0ed-4dd3-b34d-4c203bac078e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:51.804929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f33e8-f0ed-4dd3-b34d-4c203bac078e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:51.806580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018f33e8-f0ed-4dd3-b34d-4c203bac078e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:51.816282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 96/188] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:51.825103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32588ef1-290c-4b4e-9de6-bbe2096f2923 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:51.936539 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32588ef1-290c-4b4e-9de6-bbe2096f2923 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:51.972708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e293e2-4634-4fc1-a35c-6d37b6381b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:51.973686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e293e2-4634-4fc1-a35c-6d37b6381b7a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:51.974178 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e293e2-4634-4fc1-a35c-6d37b6381b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:51.974634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e293e2-4634-4fc1-a35c-6d37b6381b7a None admin] PATH_INFO: `/v3/users/db200033d5e543d3b1d3c4600c15bd61` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:51.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f33e8-f0ed-4dd3-b34d-4c203bac078e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:51.989266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:51.993163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e293e2-4634-4fc1-a35c-6d37b6381b7a None admin] RBAC: Authorizing `identity:get_user(user_id=db200033d5e543d3b1d3c4600c15bd61)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:51.995193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e293e2-4634-4fc1-a35c-6d37b6381b7a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:51.997572 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 93/189] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:51 2022] GET /identity/v3/users/db200033d5e543d3b1d3c4600c15bd61 => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:52.007520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e293e2-4634-4fc1-a35c-6d37b6381b7a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:52.097097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:52.104741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018f33e8-f0ed-4dd3-b34d-4c203bac078e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:52.130238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e293e2-4634-4fc1-a35c-6d37b6381b7a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:52.143600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d3cb2-f4d9-4926-9da7-271bf25e02fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:52.144307 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d3cb2-f4d9-4926-9da7-271bf25e02fa None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:52.144850 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d3cb2-f4d9-4926-9da7-271bf25e02fa None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:52.145158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4d3cb2-f4d9-4926-9da7-271bf25e02fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:52.147221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d3cb2-f4d9-4926-9da7-271bf25e02fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:52.149149 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4d3cb2-f4d9-4926-9da7-271bf25e02fa None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:52.150884 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 97/190] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:52.151680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d3cb2-f4d9-4926-9da7-271bf25e02fa None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:52.170697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fefae-48eb-4f08-8d68-f59d8cb4e4a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:52.171329 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fefae-48eb-4f08-8d68-f59d8cb4e4a9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:52.171609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fefae-48eb-4f08-8d68-f59d8cb4e4a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:52.171880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86fefae-48eb-4f08-8d68-f59d8cb4e4a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:52.242778 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:52.247226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fefae-48eb-4f08-8d68-f59d8cb4e4a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:52.249775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86fefae-48eb-4f08-8d68-f59d8cb4e4a9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:52.269233 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4d3cb2-f4d9-4926-9da7-271bf25e02fa None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:52.312528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265af9f-0a35-4b0f-b8cc-d60196cbfc37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:52.313180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265af9f-0a35-4b0f-b8cc-d60196cbfc37 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:52.313633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265af9f-0a35-4b0f-b8cc-d60196cbfc37 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:52.313937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b265af9f-0a35-4b0f-b8cc-d60196cbfc37 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:52.324998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b265af9f-0a35-4b0f-b8cc-d60196cbfc37 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b265af9f-0a35-4b0f-b8cc-d60196cbfc37 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:52.330523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:52.331460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:52.332266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:52.332266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:52.332266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:52.332266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:52.332266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:52.332266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:52.332266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:52.332266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:52.332266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:52.332266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:52.332266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:03:52.332266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:03:52.336889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 98/191] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:03:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:52.337947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265af9f-0a35-4b0f-b8cc-d60196cbfc37 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:52.363441 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 94/192] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:03:52.364243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fefae-48eb-4f08-8d68-f59d8cb4e4a9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:52.368069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:52.452498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b265af9f-0a35-4b0f-b8cc-d60196cbfc37 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:52.469470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:52.475372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86fefae-48eb-4f08-8d68-f59d8cb4e4a9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:52.493499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32ed19-4441-41eb-8de7-83763bfb213e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:52.494169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ed19-4441-41eb-8de7-83763bfb213e None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:52.494434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ed19-4441-41eb-8de7-83763bfb213e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:52.494709 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32ed19-4441-41eb-8de7-83763bfb213e None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:52.495377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32ed19-4441-41eb-8de7-83763bfb213e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:52.496857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32ed19-4441-41eb-8de7-83763bfb213e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:52.517087 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af376a-500c-4f48-8b81-419db7789221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:52.517699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af376a-500c-4f48-8b81-419db7789221 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:52.518011 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af376a-500c-4f48-8b81-419db7789221 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:52.518326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95af376a-500c-4f48-8b81-419db7789221 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:52.518962 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af376a-500c-4f48-8b81-419db7789221 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:52.519267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af376a-500c-4f48-8b81-419db7789221 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:52.520660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95af376a-500c-4f48-8b81-419db7789221 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:52.522284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 99/193] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:03:52 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:03:52.530320 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32ed19-4441-41eb-8de7-83763bfb213e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:52.538705 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 95/194] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:03:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:52.544829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af376a-500c-4f48-8b81-419db7789221 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:52.631095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:52.655578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32ed19-4441-41eb-8de7-83763bfb213e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:52.676585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95af376a-500c-4f48-8b81-419db7789221 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:52.699303 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe88d40f-4cec-458b-a312-7dcc0ec42674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:52.699967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d40f-4cec-458b-a312-7dcc0ec42674 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:52.700252 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d40f-4cec-458b-a312-7dcc0ec42674 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:52.700530 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe88d40f-4cec-458b-a312-7dcc0ec42674 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:52.701735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88d40f-4cec-458b-a312-7dcc0ec42674 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:52.704353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe88d40f-4cec-458b-a312-7dcc0ec42674 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:52.706455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 100/195] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:52 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:52.711413 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9a5b4-6a1c-4f4d-9648-f51356f4ba5b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:52.711726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9a5b4-6a1c-4f4d-9648-f51356f4ba5b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:52.711934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd9a5b4-6a1c-4f4d-9648-f51356f4ba5b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:52.713400 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 101/196] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:52.714249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9a5b4-6a1c-4f4d-9648-f51356f4ba5b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:52.721433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34de107-e226-4f0f-94aa-33976f214293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:52.722512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de107-e226-4f0f-94aa-33976f214293 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:52.722801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de107-e226-4f0f-94aa-33976f214293 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:52.723076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34de107-e226-4f0f-94aa-33976f214293 None admin] PATH_INFO: `/v3/users/db200033d5e543d3b1d3c4600c15bd61` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:52.724349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34de107-e226-4f0f-94aa-33976f214293 None admin] RBAC: Authorizing `identity:get_user(user_id=db200033d5e543d3b1d3c4600c15bd61)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:52.726251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34de107-e226-4f0f-94aa-33976f214293 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:52.727792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 96/197] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:52 2022] GET /identity/v3/users/db200033d5e543d3b1d3c4600c15bd61 => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:52.729163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95882c4-3850-4402-8b60-e36fecbb0a00 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:52.729454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95882c4-3850-4402-8b60-e36fecbb0a00 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:52.729725 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95882c4-3850-4402-8b60-e36fecbb0a00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:52.750990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c95882c4-3850-4402-8b60-e36fecbb0a00 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:52.752251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c95882c4-3850-4402-8b60-e36fecbb0a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:52.781328 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:52.833674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 97/198] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:52.834940 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95882c4-3850-4402-8b60-e36fecbb0a00 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:52.848174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd9a5b4-6a1c-4f4d-9648-f51356f4ba5b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:52.903757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c29f09-6e05-4345-b8bf-ed381d13ff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:52.904409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c29f09-6e05-4345-b8bf-ed381d13ff28 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:52.905129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c29f09-6e05-4345-b8bf-ed381d13ff28 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:52.905129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c29f09-6e05-4345-b8bf-ed381d13ff28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:52.905869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c29f09-6e05-4345-b8bf-ed381d13ff28 None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=93aa5a059e0e48fcacea630bab923912, user.id=db200033d5e543d3b1d3c4600c15bd61) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:52.906251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c29f09-6e05-4345-b8bf-ed381d13ff28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:52.907805 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c29f09-6e05-4345-b8bf-ed381d13ff28 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:52.919974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 102/199] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:03:52 2022] GET /identity/v3/role_assignments?user.id=db200033d5e543d3b1d3c4600c15bd61&scope.project.id=93aa5a059e0e48fcacea630bab923912&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 259 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:52.983433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95882c4-3850-4402-8b60-e36fecbb0a00 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:53.026411 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838b6fc-d378-434a-bc29-15d331815ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:53.027350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838b6fc-d378-434a-bc29-15d331815ee9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:53.027796 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838b6fc-d378-434a-bc29-15d331815ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:53.028231 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0838b6fc-d378-434a-bc29-15d331815ee9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:53.065265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:53.115322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838b6fc-d378-434a-bc29-15d331815ee9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:53.117359 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0838b6fc-d378-434a-bc29-15d331815ee9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:53.129160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c29f09-6e05-4345-b8bf-ed381d13ff28 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:53.170258 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:53.301553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c29f09-6e05-4345-b8bf-ed381d13ff28 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:53.328573 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 98/200] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:03:53.335307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838b6fc-d378-434a-bc29-15d331815ee9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:53.374151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231a6a3-179c-4e73-b24d-fa2b92577b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:53.376755 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a6a3-179c-4e73-b24d-fa2b92577b7a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:53.377035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a6a3-179c-4e73-b24d-fa2b92577b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:53.377308 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a231a6a3-179c-4e73-b24d-fa2b92577b7a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:53.402976 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a231a6a3-179c-4e73-b24d-fa2b92577b7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-a231a6a3-179c-4e73-b24d-fa2b92577b7a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:53.408828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:53.409860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:53.410632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:53.410632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:53.410632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:53.410632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:53.410632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:53.410632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:53.410632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:53.410632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:53.410632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:53.410632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:53.410632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:03:53.410632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:03:53.410632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 103/201] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:03:53.419004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231a6a3-179c-4e73-b24d-fa2b92577b7a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:53.451432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:53.514177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:53.557394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a231a6a3-179c-4e73-b24d-fa2b92577b7a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:53.560846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0838b6fc-d378-434a-bc29-15d331815ee9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:53.626377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bedbdb-dc82-45fa-922e-c9de4eb37fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:53.627017 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bedbdb-dc82-45fa-922e-c9de4eb37fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:53.627297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bedbdb-dc82-45fa-922e-c9de4eb37fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:53.627568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bedbdb-dc82-45fa-922e-c9de4eb37fd3 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:53.628251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bedbdb-dc82-45fa-922e-c9de4eb37fd3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:53.628557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bedbdb-dc82-45fa-922e-c9de4eb37fd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:53.631353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bedbdb-dc82-45fa-922e-c9de4eb37fd3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:53.633363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73007d47-a31e-4128-98f9-feea5281a37a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:53.634139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73007d47-a31e-4128-98f9-feea5281a37a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:53.634419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73007d47-a31e-4128-98f9-feea5281a37a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:53.634687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73007d47-a31e-4128-98f9-feea5281a37a None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:53.636754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73007d47-a31e-4128-98f9-feea5281a37a None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:53.638269 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73007d47-a31e-4128-98f9-feea5281a37a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:53.644314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 99/202] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:53 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:53.648183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 104/203] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:03:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:53.649319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73007d47-a31e-4128-98f9-feea5281a37a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:53.656053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bedbdb-dc82-45fa-922e-c9de4eb37fd3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:53.813676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bedbdb-dc82-45fa-922e-c9de4eb37fd3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:53.879256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73007d47-a31e-4128-98f9-feea5281a37a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:53.886195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d507fe-3901-4a38-b6c8-147045e94651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:53.886854 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d507fe-3901-4a38-b6c8-147045e94651 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:53.887133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d507fe-3901-4a38-b6c8-147045e94651 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:53.887404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d507fe-3901-4a38-b6c8-147045e94651 None admin] PATH_INFO: `/v3/users/fce6a133c1a342db8e07bf740a1c5877` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:53.892763 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d507fe-3901-4a38-b6c8-147045e94651 None admin] RBAC: Authorizing `identity:get_user(user_id=fce6a133c1a342db8e07bf740a1c5877)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:53.894342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d507fe-3901-4a38-b6c8-147045e94651 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:53.896012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 105/204] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:53 2022] GET /identity/v3/users/fce6a133c1a342db8e07bf740a1c5877 => generated 289 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:53.904767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d507fe-3901-4a38-b6c8-147045e94651 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:53.926251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:53.946014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:53.964595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37601a31-d2b3-4fc6-911e-2dc1395e5729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:53.965275 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37601a31-d2b3-4fc6-911e-2dc1395e5729 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:53.965557 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37601a31-d2b3-4fc6-911e-2dc1395e5729 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:53.965845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37601a31-d2b3-4fc6-911e-2dc1395e5729 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:53.966587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37601a31-d2b3-4fc6-911e-2dc1395e5729 None admin] RBAC: Adding query filter params (role.id=568edd5e60424ffaa076d1c402c72b19, scope.project.id=93aa5a059e0e48fcacea630bab923912, user.id=db200033d5e543d3b1d3c4600c15bd61) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:53.966896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37601a31-d2b3-4fc6-911e-2dc1395e5729 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:53.968356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37601a31-d2b3-4fc6-911e-2dc1395e5729 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:53.978518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 100/205] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:03:53 2022] GET /identity/v3/role_assignments?user.id=db200033d5e543d3b1d3c4600c15bd61&scope.project.id=93aa5a059e0e48fcacea630bab923912&role.id=568edd5e60424ffaa076d1c402c72b19 => generated 259 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:54.098358 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d507fe-3901-4a38-b6c8-147045e94651 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:54.135994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f851b1-96da-4d88-8fa1-c69a97fe4708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:54.137582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f851b1-96da-4d88-8fa1-c69a97fe4708 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:54.138150 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f851b1-96da-4d88-8fa1-c69a97fe4708 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:54.138645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f851b1-96da-4d88-8fa1-c69a97fe4708 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:54.235202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f851b1-96da-4d88-8fa1-c69a97fe4708 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:54.237391 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f851b1-96da-4d88-8fa1-c69a97fe4708 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:54.239927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:54.353442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 106/206] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:03:54.354665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37601a31-d2b3-4fc6-911e-2dc1395e5729 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:54.505069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37601a31-d2b3-4fc6-911e-2dc1395e5729 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:54.550090 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8547ebb2-8fff-4abd-9e79-4eaa325c66ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:54.550744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547ebb2-8fff-4abd-9e79-4eaa325c66ca None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:54.551026 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547ebb2-8fff-4abd-9e79-4eaa325c66ca None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:54.551298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547ebb2-8fff-4abd-9e79-4eaa325c66ca None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:54.558451 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547ebb2-8fff-4abd-9e79-4eaa325c66ca None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:54.559951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8547ebb2-8fff-4abd-9e79-4eaa325c66ca None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:54.561673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 101/207] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:54 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:54.568476 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f851b1-96da-4d88-8fa1-c69a97fe4708 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:54.685251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f851b1-96da-4d88-8fa1-c69a97fe4708 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:54.686765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:54.729370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03afeab-4409-4e07-b5ff-9e0af99c3204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:54.730033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03afeab-4409-4e07-b5ff-9e0af99c3204 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:54.730308 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03afeab-4409-4e07-b5ff-9e0af99c3204 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:54.730576 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03afeab-4409-4e07-b5ff-9e0af99c3204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:54.731300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03afeab-4409-4e07-b5ff-9e0af99c3204 None admin] RBAC: Adding query filter params (role.id=b4a71464f9e64fa2bf52e7cbdec257c8, scope.project.id=23a9c71b85984efe850d28405efb5998, user.id=fce6a133c1a342db8e07bf740a1c5877) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:54.731602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03afeab-4409-4e07-b5ff-9e0af99c3204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:54.733045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03afeab-4409-4e07-b5ff-9e0af99c3204 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:54.743261 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 107/208] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:03:54 2022] GET /identity/v3/role_assignments?user.id=fce6a133c1a342db8e07bf740a1c5877&scope.project.id=23a9c71b85984efe850d28405efb5998&role.id=b4a71464f9e64fa2bf52e7cbdec257c8 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:55.385119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8551db6-6c47-4ad7-876d-92917a3472bb None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:55.385447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8551db6-6c47-4ad7-876d-92917a3472bb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:55.385688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8551db6-6c47-4ad7-876d-92917a3472bb None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:55.387313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 102/209] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:55.396037 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdef8c6-4b33-4f02-9391-a33b74c0cf23 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:55.396615 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdef8c6-4b33-4f02-9391-a33b74c0cf23 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:55.396615 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdef8c6-4b33-4f02-9391-a33b74c0cf23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:55.420890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5bdef8c6-4b33-4f02-9391-a33b74c0cf23 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:55.422295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5bdef8c6-4b33-4f02-9391-a33b74c0cf23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:55.505672 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 108/210] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:55.545456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9e99a-efbc-4826-9a7a-5211d8b53d5f None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:55.546120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9e99a-efbc-4826-9a7a-5211d8b53d5f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:55.546493 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31271e78-d2ce-4bf7-a058-374d73d6789b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:55.546781 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31271e78-d2ce-4bf7-a058-374d73d6789b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:55.547016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9e99a-efbc-4826-9a7a-5211d8b53d5f None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:55.547137 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31271e78-d2ce-4bf7-a058-374d73d6789b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:55.548749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 109/211] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:03:55.549118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 103/212] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:55 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:55.554501 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b224c-79f3-491f-883c-835a7b70df16 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:55.554738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a1f46-54f3-476f-b81d-544a10a8e454 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:55.554951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a1f46-54f3-476f-b81d-544a10a8e454 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:55.555224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a1f46-54f3-476f-b81d-544a10a8e454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:55.555706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b224c-79f3-491f-883c-835a7b70df16 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:55.556169 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2b224c-79f3-491f-883c-835a7b70df16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:55.577534 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5f2b224c-79f3-491f-883c-835a7b70df16 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:55.578234 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-479a1f46-54f3-476f-b81d-544a10a8e454 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:55.578799 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-479a1f46-54f3-476f-b81d-544a10a8e454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:55.579900 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5f2b224c-79f3-491f-883c-835a7b70df16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:55.646512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:55.661985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 110/213] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:03:55.668048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 104/214] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:55.771199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a1f46-54f3-476f-b81d-544a10a8e454 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:55.801627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:55.890142 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a1f46-54f3-476f-b81d-544a10a8e454 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:55.927301 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b224c-79f3-491f-883c-835a7b70df16 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:55.928485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3126fd7-b503-480c-b5a1-97734a28b0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:55.929146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3126fd7-b503-480c-b5a1-97734a28b0e7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:55.929419 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3126fd7-b503-480c-b5a1-97734a28b0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:55.929687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3126fd7-b503-480c-b5a1-97734a28b0e7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:55.930839 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3126fd7-b503-480c-b5a1-97734a28b0e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:55.932526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3126fd7-b503-480c-b5a1-97734a28b0e7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:55.934450 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 111/215] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:55.939489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3126fd7-b503-480c-b5a1-97734a28b0e7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:56.046545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2b224c-79f3-491f-883c-835a7b70df16 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:56.072164 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:56.080658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3126fd7-b503-480c-b5a1-97734a28b0e7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:56.082959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffa986-66a7-4fc9-98e9-6f5780027a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:56.083989 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffa986-66a7-4fc9-98e9-6f5780027a21 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:56.083989 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffa986-66a7-4fc9-98e9-6f5780027a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:56.084155 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbffa986-66a7-4fc9-98e9-6f5780027a21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:56.095309 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbffa986-66a7-4fc9-98e9-6f5780027a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-fbffa986-66a7-4fc9-98e9-6f5780027a21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:56.100581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:56.101545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:56.102372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:56.102372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:56.102372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:56.102372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:56.102372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:56.102372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:56.102372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:56.102372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:56.102372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:56.102372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:56.102372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:03:56.102372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:56.102372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 105/216] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:56.103006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffa986-66a7-4fc9-98e9-6f5780027a21 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:56.125030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746312f-bc38-49ac-ab7c-1fb526cbd2c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:56.125656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746312f-bc38-49ac-ab7c-1fb526cbd2c9 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:56.125969 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746312f-bc38-49ac-ab7c-1fb526cbd2c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:56.126238 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746312f-bc38-49ac-ab7c-1fb526cbd2c9 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:56.126896 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746312f-bc38-49ac-ab7c-1fb526cbd2c9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:56.128350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a746312f-bc38-49ac-ab7c-1fb526cbd2c9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:56.152619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 112/217] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:03:55 2022] POST /identity/v3/users => generated 297 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:03:56.153305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746312f-bc38-49ac-ab7c-1fb526cbd2c9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:56.174427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:56.264598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbffa986-66a7-4fc9-98e9-6f5780027a21 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:56.304020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7947a-cb0d-4fbe-81e6-2625755c1c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:56.304805 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7947a-cb0d-4fbe-81e6-2625755c1c5b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:56.305145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7947a-cb0d-4fbe-81e6-2625755c1c5b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:56.305505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed7947a-cb0d-4fbe-81e6-2625755c1c5b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:56.306046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746312f-bc38-49ac-ab7c-1fb526cbd2c9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:56.321659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed7947a-cb0d-4fbe-81e6-2625755c1c5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-bed7947a-cb0d-4fbe-81e6-2625755c1c5b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:56.328505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:56.329692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:56.330602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:56.330602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:56.330602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:56.330602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:56.330602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:56.330602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:56.330602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:56.330602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:56.330602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:56.330602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:56.330602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:03:56.330602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:56.331189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 106/218] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:03:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:56.340160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7947a-cb0d-4fbe-81e6-2625755c1c5b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:56.360408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab14994-d686-4fd3-8be4-048fd3bbbfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:56.361416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14994-d686-4fd3-8be4-048fd3bbbfbc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:56.362010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14994-d686-4fd3-8be4-048fd3bbbfbc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:56.362454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab14994-d686-4fd3-8be4-048fd3bbbfbc None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:56.363435 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab14994-d686-4fd3-8be4-048fd3bbbfbc None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:56.363926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab14994-d686-4fd3-8be4-048fd3bbbfbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:56.365580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab14994-d686-4fd3-8be4-048fd3bbbfbc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:56.377462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 113/219] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:03:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:56.384238 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab14994-d686-4fd3-8be4-048fd3bbbfbc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:56.400941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:56.479442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed7947a-cb0d-4fbe-81e6-2625755c1c5b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:56.493179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:56.521900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab14994-d686-4fd3-8be4-048fd3bbbfbc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:56.525319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd19707-a3db-4df4-a3e2-a4c5703eb79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:56.525996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd19707-a3db-4df4-a3e2-a4c5703eb79f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:56.526278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd19707-a3db-4df4-a3e2-a4c5703eb79f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:56.526553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd19707-a3db-4df4-a3e2-a4c5703eb79f None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:56.527237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd19707-a3db-4df4-a3e2-a4c5703eb79f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:56.527543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd19707-a3db-4df4-a3e2-a4c5703eb79f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:56.528972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd19707-a3db-4df4-a3e2-a4c5703eb79f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:56.541561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 107/220] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:56.543054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd4c8f-1c4d-4930-bdbc-5087767cfb25 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:56.543342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd4c8f-1c4d-4930-bdbc-5087767cfb25 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:56.543618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd4c8f-1c4d-4930-bdbc-5087767cfb25 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:56.544905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 108/221] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:56.547855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd4c8f-1c4d-4930-bdbc-5087767cfb25 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:56.564980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152fe2a7-e890-4a38-8088-f5c4fadaa7a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:56.566128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fe2a7-e890-4a38-8088-f5c4fadaa7a0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:56.566590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fe2a7-e890-4a38-8088-f5c4fadaa7a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:56.566863 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152fe2a7-e890-4a38-8088-f5c4fadaa7a0 None admin] PATH_INFO: `/v3/users/204a2b288a8642f396e3f34bc044c2e7` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:56.583455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fe2a7-e890-4a38-8088-f5c4fadaa7a0 None admin] RBAC: Authorizing `identity:get_user(user_id=204a2b288a8642f396e3f34bc044c2e7)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:56.585234 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152fe2a7-e890-4a38-8088-f5c4fadaa7a0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:56.587092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 114/222] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:56 2022] GET /identity/v3/users/204a2b288a8642f396e3f34bc044c2e7 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:56.588403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47d484-50c7-4d76-9164-be67436f79b1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:56.588677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47d484-50c7-4d76-9164-be67436f79b1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:56.589008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce47d484-50c7-4d76-9164-be67436f79b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:56.608002 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ce47d484-50c7-4d76-9164-be67436f79b1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:56.609245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ce47d484-50c7-4d76-9164-be67436f79b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:56.677511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd4c8f-1c4d-4930-bdbc-5087767cfb25 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:56.691690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:56.701932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 115/223] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:56.703924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47d484-50c7-4d76-9164-be67436f79b1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:56.734786 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c824-cac4-486b-ad12-5445fb47b1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:56.735999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c824-cac4-486b-ad12-5445fb47b1ee None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:56.737247 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c824-cac4-486b-ad12-5445fb47b1ee None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:56.737877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f734c824-cac4-486b-ad12-5445fb47b1ee None admin] PATH_INFO: `/v3/users/db200033d5e543d3b1d3c4600c15bd61` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:56.740642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734c824-cac4-486b-ad12-5445fb47b1ee None admin] RBAC: Authorizing `identity:get_user(user_id=db200033d5e543d3b1d3c4600c15bd61)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:56.743370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f734c824-cac4-486b-ad12-5445fb47b1ee None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:56.745497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 109/224] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:56 2022] GET /identity/v3/users/db200033d5e543d3b1d3c4600c15bd61 => generated 283 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:56.752904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c824-cac4-486b-ad12-5445fb47b1ee None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:56.831056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:56.885303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f734c824-cac4-486b-ad12-5445fb47b1ee None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:56.926683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6af78-e85a-43dd-bbea-143e95836de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:56.927747 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6af78-e85a-43dd-bbea-143e95836de4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:56.928280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6af78-e85a-43dd-bbea-143e95836de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:56.928903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e6af78-e85a-43dd-bbea-143e95836de4 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:56.930915 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6af78-e85a-43dd-bbea-143e95836de4 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:56.932593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e6af78-e85a-43dd-bbea-143e95836de4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:56.934536 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 110/225] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:56 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:56.942967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6af78-e85a-43dd-bbea-143e95836de4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:56.966003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce47d484-50c7-4d76-9164-be67436f79b1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:57.005671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152962b-48c1-4f92-bcbb-9136c1af990a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:57.006392 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152962b-48c1-4f92-bcbb-9136c1af990a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:57.006679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152962b-48c1-4f92-bcbb-9136c1af990a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:57.007146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f152962b-48c1-4f92-bcbb-9136c1af990a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:57.077399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:57.079700 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e6af78-e85a-43dd-bbea-143e95836de4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:57.079900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152962b-48c1-4f92-bcbb-9136c1af990a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:57.081398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f152962b-48c1-4f92-bcbb-9136c1af990a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:57.088871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:57.120707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c278f5-b074-45a2-b35a-1c89d76cb800 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:57.121395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c278f5-b074-45a2-b35a-1c89d76cb800 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:57.121672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c278f5-b074-45a2-b35a-1c89d76cb800 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:57.121976 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c278f5-b074-45a2-b35a-1c89d76cb800 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912/users/db200033d5e543d3b1d3c4600c15bd61/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:57.124046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c278f5-b074-45a2-b35a-1c89d76cb800 None admin] RBAC: Authorizing `identity:create_grant(project_id=93aa5a059e0e48fcacea630bab923912, user_id=db200033d5e543d3b1d3c4600c15bd61, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:57.125664 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c278f5-b074-45a2-b35a-1c89d76cb800 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:57.144562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 111/226] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:03:56 2022] PUT /identity/v3/projects/93aa5a059e0e48fcacea630bab923912/users/db200033d5e543d3b1d3c4600c15bd61/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:03:57.145615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c278f5-b074-45a2-b35a-1c89d76cb800 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:57.258705 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 116/227] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:03:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:03:57.266190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152962b-48c1-4f92-bcbb-9136c1af990a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:57.402560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c278f5-b074-45a2-b35a-1c89d76cb800 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:57.421513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:57.425315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f152962b-48c1-4f92-bcbb-9136c1af990a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:57.456419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a443e-128d-4cea-83da-d48ec9bbb9ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:57.458086 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a443e-128d-4cea-83da-d48ec9bbb9ef None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:57.458842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a443e-128d-4cea-83da-d48ec9bbb9ef None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:57.459306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3a443e-128d-4cea-83da-d48ec9bbb9ef None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:57.469485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75864f78-74e6-4951-9e69-96c014750dd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:57.470178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75864f78-74e6-4951-9e69-96c014750dd5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:57.470458 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75864f78-74e6-4951-9e69-96c014750dd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:57.470728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75864f78-74e6-4951-9e69-96c014750dd5 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:57.471899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75864f78-74e6-4951-9e69-96c014750dd5 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:57.473711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75864f78-74e6-4951-9e69-96c014750dd5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:57.474246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3a443e-128d-4cea-83da-d48ec9bbb9ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:57.475498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 117/228] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:57 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-5c3a443e-128d-4cea-83da-d48ec9bbb9ef None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:57.480179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:57.481079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:57.481914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:57.481914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:57.481914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:57.481914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:57.481914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:57.481914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:57.481914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:57.481914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:57.481914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:57.481914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:57.481914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:03:57.481914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:03:57.482533 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75864f78-74e6-4951-9e69-96c014750dd5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:57.484948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 112/229] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:03:57 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:57.490537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a443e-128d-4cea-83da-d48ec9bbb9ef None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:57.538274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:57.681590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75864f78-74e6-4951-9e69-96c014750dd5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:57.687730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3a443e-128d-4cea-83da-d48ec9bbb9ef None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:57.747580 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f409cd-683c-4832-ae83-8318124a863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:57.748205 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f409cd-683c-4832-ae83-8318124a863b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:57.748478 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f409cd-683c-4832-ae83-8318124a863b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:57.749005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f409cd-683c-4832-ae83-8318124a863b None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:57.749684 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f409cd-683c-4832-ae83-8318124a863b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:57.750013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f409cd-683c-4832-ae83-8318124a863b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:57.751403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f409cd-683c-4832-ae83-8318124a863b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:57.758430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128cacd-72f1-477a-8c07-1de050e71b09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:57.759059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128cacd-72f1-477a-8c07-1de050e71b09 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:57.759335 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128cacd-72f1-477a-8c07-1de050e71b09 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:57.759605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7128cacd-72f1-477a-8c07-1de050e71b09 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:57.760403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 113/230] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:03:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:57.760517 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128cacd-72f1-477a-8c07-1de050e71b09 None admin] RBAC: Adding query filter params (role.id=1e24ea020d1a46989b4f460308a32229, scope.project.id=93aa5a059e0e48fcacea630bab923912, user.id=204a2b288a8642f396e3f34bc044c2e7) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:57.760696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128cacd-72f1-477a-8c07-1de050e71b09 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:57.762104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7128cacd-72f1-477a-8c07-1de050e71b09 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:57.766130 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f409cd-683c-4832-ae83-8318124a863b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:57.777343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 118/231] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:03:57 2022] GET /identity/v3/role_assignments?user.id=204a2b288a8642f396e3f34bc044c2e7&scope.project.id=93aa5a059e0e48fcacea630bab923912&role.id=1e24ea020d1a46989b4f460308a32229 => generated 259 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:57.906727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:57.925268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f409cd-683c-4832-ae83-8318124a863b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:57.965150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8946907-cbe8-47a2-aeba-a9356217b44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:57.965764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8946907-cbe8-47a2-aeba-a9356217b44e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:57.966064 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8946907-cbe8-47a2-aeba-a9356217b44e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:57.966330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8946907-cbe8-47a2-aeba-a9356217b44e None admin] PATH_INFO: `/v3/users/db200033d5e543d3b1d3c4600c15bd61` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:57.967454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8946907-cbe8-47a2-aeba-a9356217b44e None admin] RBAC: Authorizing `identity:get_user(user_id=db200033d5e543d3b1d3c4600c15bd61)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:57.968984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8946907-cbe8-47a2-aeba-a9356217b44e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:57.970706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 114/232] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:57 2022] GET /identity/v3/users/db200033d5e543d3b1d3c4600c15bd61 => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:03:57.977022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128cacd-72f1-477a-8c07-1de050e71b09 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:58.012465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:58.093134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7128cacd-72f1-477a-8c07-1de050e71b09 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:58.128567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a563ab-418d-42d6-aee7-c5a0b01d13e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:58.129208 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a563ab-418d-42d6-aee7-c5a0b01d13e3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:58.129518 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a563ab-418d-42d6-aee7-c5a0b01d13e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:58.129803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a563ab-418d-42d6-aee7-c5a0b01d13e3 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:58.130973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a563ab-418d-42d6-aee7-c5a0b01d13e3 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:58.132495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a563ab-418d-42d6-aee7-c5a0b01d13e3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:58.134520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 119/233] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:03:57 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:58.140418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8946907-cbe8-47a2-aeba-a9356217b44e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:58.254042 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8946907-cbe8-47a2-aeba-a9356217b44e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:58.302890 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81eb7c4a-50a1-40a2-ac61-9f8735f85d50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:58.303871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7c4a-50a1-40a2-ac61-9f8735f85d50 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:58.304153 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7c4a-50a1-40a2-ac61-9f8735f85d50 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:58.304430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81eb7c4a-50a1-40a2-ac61-9f8735f85d50 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912/users/db200033d5e543d3b1d3c4600c15bd61/roles/568edd5e60424ffaa076d1c402c72b19` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:58.311822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb7c4a-50a1-40a2-ac61-9f8735f85d50 None admin] RBAC: Authorizing `identity:create_grant(project_id=93aa5a059e0e48fcacea630bab923912, user_id=db200033d5e543d3b1d3c4600c15bd61, role_id=568edd5e60424ffaa076d1c402c72b19)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:58.313327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81eb7c4a-50a1-40a2-ac61-9f8735f85d50 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:58.332331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 115/234] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:03:58 2022] PUT /identity/v3/projects/93aa5a059e0e48fcacea630bab923912/users/db200033d5e543d3b1d3c4600c15bd61/roles/568edd5e60424ffaa076d1c402c72b19 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:03:58.749913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7490b-29fa-4b91-a84d-419a44b8eba2 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:58.750438 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7490b-29fa-4b91-a84d-419a44b8eba2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:58.750438 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7490b-29fa-4b91-a84d-419a44b8eba2 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:58.752051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 120/235] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:58.757880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd820a09-d6c8-450a-b068-e52b1684937a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:58.758360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd820a09-d6c8-450a-b068-e52b1684937a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:58.758432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd820a09-d6c8-450a-b068-e52b1684937a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:58.778749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fd820a09-d6c8-450a-b068-e52b1684937a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:58.779965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fd820a09-d6c8-450a-b068-e52b1684937a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:58.792490 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:58.856622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 116/236] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:59.132891 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaab48-018a-4dae-b4f9-f3140a13e13e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:59.133304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaab48-018a-4dae-b4f9-f3140a13e13e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:59.133405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36eaab48-018a-4dae-b4f9-f3140a13e13e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:59.135122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 121/237] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:59.140730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c03c5-d1e5-4ee9-bf0c-654c4b48e062 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:59.141012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c03c5-d1e5-4ee9-bf0c-654c4b48e062 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:59.141281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9c03c5-d1e5-4ee9-bf0c-654c4b48e062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:59.159969 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8e9c03c5-d1e5-4ee9-bf0c-654c4b48e062 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:03:59.161158 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8e9c03c5-d1e5-4ee9-bf0c-654c4b48e062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:03:59.246051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 117/238] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:03:59.349835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaab48-018a-4dae-b4f9-f3140a13e13e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:59.478504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:59.481638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36eaab48-018a-4dae-b4f9-f3140a13e13e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:59.518367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195c2d3-70eb-4cfe-a428-4ffc5e161e13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:59.519010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195c2d3-70eb-4cfe-a428-4ffc5e161e13 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:59.519281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195c2d3-70eb-4cfe-a428-4ffc5e161e13 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:59.519546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9195c2d3-70eb-4cfe-a428-4ffc5e161e13 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:59.530364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9195c2d3-70eb-4cfe-a428-4ffc5e161e13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9195c2d3-70eb-4cfe-a428-4ffc5e161e13 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:03:59.535342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:03:59.536213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:03:59.537410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:03:59.537410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:03:59.537410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:03:59.537410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:03:59.537410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:03:59.537410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:03:59.537410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:03:59.537410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:03:59.537410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:03:59.537410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:03:59.537410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:03:59.537410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:03:59.537410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 122/239] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:03:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:03:59.542647 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c03c5-d1e5-4ee9-bf0c-654c4b48e062 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:59.559647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195c2d3-70eb-4cfe-a428-4ffc5e161e13 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:59.692005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:59.694402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9195c2d3-70eb-4cfe-a428-4ffc5e161e13 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:59.730882 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096e9ca-fcb8-492b-8217-7d3517794c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:59.731447 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096e9ca-fcb8-492b-8217-7d3517794c1c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:59.731719 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096e9ca-fcb8-492b-8217-7d3517794c1c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:59.731984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8096e9ca-fcb8-492b-8217-7d3517794c1c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:59.733162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096e9ca-fcb8-492b-8217-7d3517794c1c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:59.734711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8096e9ca-fcb8-492b-8217-7d3517794c1c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:59.736843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 123/240] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:03:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:59.743666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096e9ca-fcb8-492b-8217-7d3517794c1c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:59.746123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9c03c5-d1e5-4ee9-bf0c-654c4b48e062 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:59.793224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:03:59.807579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03815c54-c8e6-497a-ac63-297e5c8716ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:59.808834 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815c54-c8e6-497a-ac63-297e5c8716ed None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:59.809243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815c54-c8e6-497a-ac63-297e5c8716ed None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:59.809674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03815c54-c8e6-497a-ac63-297e5c8716ed None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:59.810637 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03815c54-c8e6-497a-ac63-297e5c8716ed None admin] RBAC: Adding query filter params (name=reader) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:03:59.811149 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03815c54-c8e6-497a-ac63-297e5c8716ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:59.812683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03815c54-c8e6-497a-ac63-297e5c8716ed None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:59.822103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 118/241] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:03:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:03:59.828384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfea52b-e790-46dc-903e-385f9f2dcd22 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:59.829035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfea52b-e790-46dc-903e-385f9f2dcd22 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:59.829477 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfea52b-e790-46dc-903e-385f9f2dcd22 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:59.831140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 119/242] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:03:59 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:03:59.832524 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfea52b-e790-46dc-903e-385f9f2dcd22 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:03:59.882966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8096e9ca-fcb8-492b-8217-7d3517794c1c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:03:59.922335 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e6995a-6e11-41fe-af62-0e9f9ef675e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:03:59.922960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6995a-6e11-41fe-af62-0e9f9ef675e0 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:59.923236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6995a-6e11-41fe-af62-0e9f9ef675e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:59.923503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e6995a-6e11-41fe-af62-0e9f9ef675e0 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:59.924167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6995a-6e11-41fe-af62-0e9f9ef675e0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:03:59.926078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e6995a-6e11-41fe-af62-0e9f9ef675e0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:03:59.957911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 124/243] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:03:59 2022] POST /identity/v3/users => generated 293 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:03:59.961382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be191c75-74c3-49a2-a7e0-f3def90f45f2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:03:59.962327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be191c75-74c3-49a2-a7e0-f3def90f45f2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:03:59.963578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be191c75-74c3-49a2-a7e0-f3def90f45f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:03:59.994322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfea52b-e790-46dc-903e-385f9f2dcd22 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:00.009165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-be191c75-74c3-49a2-a7e0-f3def90f45f2 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:00.011339 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-be191c75-74c3-49a2-a7e0-f3def90f45f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:00.077567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb329b-6457-4669-abfe-a1096571f95b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:00.081121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb329b-6457-4669-abfe-a1096571f95b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:00.083168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb329b-6457-4669-abfe-a1096571f95b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:00.085851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fbb329b-6457-4669-abfe-a1096571f95b None admin] PATH_INFO: `/v3/users/6abf2ab094a34b8896694b40c68a6448` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:00.103158 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:00.114252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb329b-6457-4669-abfe-a1096571f95b None admin] RBAC: Authorizing `identity:get_user(user_id=6abf2ab094a34b8896694b40c68a6448)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:00.117011 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fbb329b-6457-4669-abfe-a1096571f95b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:00.121561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 120/244] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:03:59 2022] GET /identity/v3/users/6abf2ab094a34b8896694b40c68a6448 => generated 297 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:00.129857 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb329b-6457-4669-abfe-a1096571f95b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:00.197364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 125/245] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:03:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:00.289189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fbb329b-6457-4669-abfe-a1096571f95b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:00.336659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efd52e-badf-4990-b6ba-9d7764a1c5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:00.337587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efd52e-badf-4990-b6ba-9d7764a1c5c9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:00.338079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efd52e-badf-4990-b6ba-9d7764a1c5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:00.338507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97efd52e-badf-4990-b6ba-9d7764a1c5c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:00.429811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:00.438340 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efd52e-badf-4990-b6ba-9d7764a1c5c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:00.439879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97efd52e-badf-4990-b6ba-9d7764a1c5c9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:00.504550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f711faf-4f76-4e79-98ec-a72912bbec8a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:00.504550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f711faf-4f76-4e79-98ec-a72912bbec8a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:00.504550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f711faf-4f76-4e79-98ec-a72912bbec8a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:00.505220 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 126/246] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:00.513995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc90520-20ba-4252-b9b6-be41fa729240 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:00.514710 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc90520-20ba-4252-b9b6-be41fa729240 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:00.515167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc90520-20ba-4252-b9b6-be41fa729240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:00.536637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-bbc90520-20ba-4252-b9b6-be41fa729240 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:00.538696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-bbc90520-20ba-4252-b9b6-be41fa729240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:00.549353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:00.568088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 121/247] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 19:04:00.574084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efd52e-badf-4990-b6ba-9d7764a1c5c9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:00.624981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 127/248] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:00.625903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc90520-20ba-4252-b9b6-be41fa729240 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:00.705691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:00.715957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97efd52e-badf-4990-b6ba-9d7764a1c5c9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:00.758237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1cd79-8904-4fc6-bafb-0e240ad36110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:00.758934 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1cd79-8904-4fc6-bafb-0e240ad36110 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:00.759214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1cd79-8904-4fc6-bafb-0e240ad36110 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:00.759489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1cd79-8904-4fc6-bafb-0e240ad36110 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:00.760674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1cd79-8904-4fc6-bafb-0e240ad36110 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:00.762168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d1cd79-8904-4fc6-bafb-0e240ad36110 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:00.764292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 122/249] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:00 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:00.766584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc90520-20ba-4252-b9b6-be41fa729240 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:00.771460 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1cd79-8904-4fc6-bafb-0e240ad36110 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:00.808668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2879bfb-d3b8-4567-9817-452cb29212b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:00.809379 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2879bfb-d3b8-4567-9817-452cb29212b7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:00.809664 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2879bfb-d3b8-4567-9817-452cb29212b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:00.809973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2879bfb-d3b8-4567-9817-452cb29212b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:00.824428 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2879bfb-d3b8-4567-9817-452cb29212b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c2879bfb-d3b8-4567-9817-452cb29212b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:00.831128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:00.832016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:00.832788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:00.832788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:00.832788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:00.832788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:00.832788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:00.832788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:00.832788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:00.832788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:00.832788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:00.832788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:00.832788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:04:00.832788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:00.832788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 128/250] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:04:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:00.838713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2879bfb-d3b8-4567-9817-452cb29212b7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:00.844914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:00.907373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1cd79-8904-4fc6-bafb-0e240ad36110 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:00.949611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cf735-6ff4-472f-9aab-408890bf893e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:00.950598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cf735-6ff4-472f-9aab-408890bf893e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:00.951043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cf735-6ff4-472f-9aab-408890bf893e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:00.951475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61cf735-6ff4-472f-9aab-408890bf893e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:00.952379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cf735-6ff4-472f-9aab-408890bf893e None admin] RBAC: Adding query filter params (role.id=b4a71464f9e64fa2bf52e7cbdec257c8, scope.project.id=93aa5a059e0e48fcacea630bab923912, user.id=6abf2ab094a34b8896694b40c68a6448) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:00.952872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cf735-6ff4-472f-9aab-408890bf893e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:00.954516 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61cf735-6ff4-472f-9aab-408890bf893e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:00.962312 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 123/251] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:00 2022] GET /identity/v3/role_assignments?user.id=6abf2ab094a34b8896694b40c68a6448&scope.project.id=93aa5a059e0e48fcacea630bab923912&role.id=b4a71464f9e64fa2bf52e7cbdec257c8 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:00.963426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cf735-6ff4-472f-9aab-408890bf893e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:01.013844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2879bfb-d3b8-4567-9817-452cb29212b7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:01.036872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:01.054554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90d8b-62ab-47a6-b78c-e620814e756b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:01.054989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90d8b-62ab-47a6-b78c-e620814e756b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:01.055260 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90d8b-62ab-47a6-b78c-e620814e756b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:01.055523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f90d8b-62ab-47a6-b78c-e620814e756b None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:01.056195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f90d8b-62ab-47a6-b78c-e620814e756b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:01.056492 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f90d8b-62ab-47a6-b78c-e620814e756b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:01.057933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f90d8b-62ab-47a6-b78c-e620814e756b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:01.067481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 129/252] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:01.074910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90d8b-62ab-47a6-b78c-e620814e756b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:01.180710 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:01.205326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61cf735-6ff4-472f-9aab-408890bf893e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:01.224216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f90d8b-62ab-47a6-b78c-e620814e756b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:01.265535 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c23a-71fd-436a-a8cb-30edda10264c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:01.266244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c23a-71fd-436a-a8cb-30edda10264c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:01.266525 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c23a-71fd-436a-a8cb-30edda10264c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:01.266796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b630c23a-71fd-436a-a8cb-30edda10264c None admin] PATH_INFO: `/v3/users/db200033d5e543d3b1d3c4600c15bd61` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:01.267999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630c23a-71fd-436a-a8cb-30edda10264c None admin] RBAC: Authorizing `identity:get_user(user_id=db200033d5e543d3b1d3c4600c15bd61)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:01.268214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f45578-3fdd-4027-a4d6-3351d0028c1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:01.269118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f45578-3fdd-4027-a4d6-3351d0028c1b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:01.269481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b630c23a-71fd-436a-a8cb-30edda10264c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:01.269871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f45578-3fdd-4027-a4d6-3351d0028c1b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:01.270352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f45578-3fdd-4027-a4d6-3351d0028c1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:01.276042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 130/253] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:04:01 2022] GET /identity/v3/users/db200033d5e543d3b1d3c4600c15bd61 => generated 283 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:01.279180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c23a-71fd-436a-a8cb-30edda10264c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:01.306469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f45578-3fdd-4027-a4d6-3351d0028c1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-16f45578-3fdd-4027-a4d6-3351d0028c1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:01.312033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:01.312985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:01.313823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:01.313823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:01.313823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:01.313823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:01.313823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:01.313823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:01.313823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:01.313823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:01.313823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:01.313823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:01.313823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:01.313823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:01.313823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 124/254] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:01.324372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f45578-3fdd-4027-a4d6-3351d0028c1b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:01.436147 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b630c23a-71fd-436a-a8cb-30edda10264c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:01.491743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df964f1e-e352-4dd3-a1e1-f3a819c452c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:01.492378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df964f1e-e352-4dd3-a1e1-f3a819c452c1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:01.492655 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df964f1e-e352-4dd3-a1e1-f3a819c452c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:01.493032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df964f1e-e352-4dd3-a1e1-f3a819c452c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:01.506333 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:01.543251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:01.569438 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f45578-3fdd-4027-a4d6-3351d0028c1b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:01.637159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df964f1e-e352-4dd3-a1e1-f3a819c452c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:01.638605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df964f1e-e352-4dd3-a1e1-f3a819c452c1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:01.643538 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead977df-d558-43af-8b2e-e47274beba02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:01.644165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead977df-d558-43af-8b2e-e47274beba02 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:01.644510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead977df-d558-43af-8b2e-e47274beba02 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:01.644784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead977df-d558-43af-8b2e-e47274beba02 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:01.645459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead977df-d558-43af-8b2e-e47274beba02 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:01.645830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead977df-d558-43af-8b2e-e47274beba02 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:01.648326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead977df-d558-43af-8b2e-e47274beba02 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:01.672117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 125/255] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:01.673521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf44af2-adb2-4bfe-aad1-b15122144f41 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:01.673821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf44af2-adb2-4bfe-aad1-b15122144f41 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:01.674102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf44af2-adb2-4bfe-aad1-b15122144f41 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:01.675362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 126/256] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:01.677744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf44af2-adb2-4bfe-aad1-b15122144f41 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:01.818622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 131/257] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 540 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:01.825027 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5770eb-9585-4f4b-ae01-e94d272a7f2d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:01.825362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5770eb-9585-4f4b-ae01-e94d272a7f2d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:01.825714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5770eb-9585-4f4b-ae01-e94d272a7f2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:01.856890 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf44af2-adb2-4bfe-aad1-b15122144f41 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:01.863056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ef5770eb-9585-4f4b-ae01-e94d272a7f2d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:01.868317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ef5770eb-9585-4f4b-ae01-e94d272a7f2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:01.918379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858368d-a32e-43be-9f72-08f75ccbed1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:01.920173 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858368d-a32e-43be-9f72-08f75ccbed1d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:01.920629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858368d-a32e-43be-9f72-08f75ccbed1d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:01.921099 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8858368d-a32e-43be-9f72-08f75ccbed1d None admin] PATH_INFO: `/v3/users/204a2b288a8642f396e3f34bc044c2e7` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:01.922645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858368d-a32e-43be-9f72-08f75ccbed1d None admin] RBAC: Authorizing `identity:get_user(user_id=204a2b288a8642f396e3f34bc044c2e7)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:01.926115 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:01.926445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8858368d-a32e-43be-9f72-08f75ccbed1d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:01.931835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 127/258] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:04:01 2022] GET /identity/v3/users/204a2b288a8642f396e3f34bc044c2e7 => generated 297 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:01.932671 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858368d-a32e-43be-9f72-08f75ccbed1d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:01.967927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:02.016098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 132/259] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:02.016964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5770eb-9585-4f4b-ae01-e94d272a7f2d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:02.067403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8858368d-a32e-43be-9f72-08f75ccbed1d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:02.141649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8691e7d-7aca-4650-ac9c-28dba25dc7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:02.143871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8691e7d-7aca-4650-ac9c-28dba25dc7f2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:02.145594 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8691e7d-7aca-4650-ac9c-28dba25dc7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:02.146093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8691e7d-7aca-4650-ac9c-28dba25dc7f2 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:02.148709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8691e7d-7aca-4650-ac9c-28dba25dc7f2 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:02.151604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8691e7d-7aca-4650-ac9c-28dba25dc7f2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:02.155732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 128/260] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:01 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:02.161853 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8691e7d-7aca-4650-ac9c-28dba25dc7f2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:02.202653 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5770eb-9585-4f4b-ae01-e94d272a7f2d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:02.243067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d2157-014e-4088-b7bf-261731786f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:02.244265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d2157-014e-4088-b7bf-261731786f80 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:02.244743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d2157-014e-4088-b7bf-261731786f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:02.245206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13d2157-014e-4088-b7bf-261731786f80 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:02.246602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d2157-014e-4088-b7bf-261731786f80 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:02.248294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13d2157-014e-4088-b7bf-261731786f80 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:02.250273 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 133/261] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:02 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:02.257281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d2157-014e-4088-b7bf-261731786f80 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:02.340753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:02.377661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:02.410042 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8691e7d-7aca-4650-ac9c-28dba25dc7f2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:02.460943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13d2157-014e-4088-b7bf-261731786f80 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:02.496947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f2e36-6857-4dc0-b519-405c6d5a22be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:02.497630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f2e36-6857-4dc0-b519-405c6d5a22be None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:02.497942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f2e36-6857-4dc0-b519-405c6d5a22be None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:02.498295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0f2e36-6857-4dc0-b519-405c6d5a22be None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912/users/204a2b288a8642f396e3f34bc044c2e7/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:02.500273 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f2e36-6857-4dc0-b519-405c6d5a22be None admin] RBAC: Authorizing `identity:create_grant(project_id=93aa5a059e0e48fcacea630bab923912, user_id=204a2b288a8642f396e3f34bc044c2e7, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:02.501986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0f2e36-6857-4dc0-b519-405c6d5a22be None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:02.502868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3ed4a-d0b7-46c6-83ff-3debab47e495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:02.503722 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3ed4a-d0b7-46c6-83ff-3debab47e495 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:02.504192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3ed4a-d0b7-46c6-83ff-3debab47e495 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:02.504692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b3ed4a-d0b7-46c6-83ff-3debab47e495 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:02.505629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3ed4a-d0b7-46c6-83ff-3debab47e495 None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=93aa5a059e0e48fcacea630bab923912, user.id=db200033d5e543d3b1d3c4600c15bd61) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:02.506150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3ed4a-d0b7-46c6-83ff-3debab47e495 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:02.507841 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b3ed4a-d0b7-46c6-83ff-3debab47e495 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:02.517803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 134/262] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:04:02 2022] PUT /identity/v3/projects/93aa5a059e0e48fcacea630bab923912/users/204a2b288a8642f396e3f34bc044c2e7/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:04:02.519704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f2e36-6857-4dc0-b519-405c6d5a22be None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:02.529016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 129/263] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:02 2022] GET /identity/v3/role_assignments?user.id=db200033d5e543d3b1d3c4600c15bd61&scope.project.id=93aa5a059e0e48fcacea630bab923912&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 608 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:02.631023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:02.640404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0f2e36-6857-4dc0-b519-405c6d5a22be None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:02.682355 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07967b0-3077-439a-8d46-2196af724e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:02.683223 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07967b0-3077-439a-8d46-2196af724e4b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:02.683603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07967b0-3077-439a-8d46-2196af724e4b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:02.683978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07967b0-3077-439a-8d46-2196af724e4b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:02.696940 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07967b0-3077-439a-8d46-2196af724e4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-e07967b0-3077-439a-8d46-2196af724e4b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:02.702432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:02.703375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:02.704170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:02.704170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:02.704170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:02.704170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:02.704170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:02.704170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:02.704170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:02.704170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:02.704170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:02.704170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:02.704170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:02.704170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:02.704170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 135/264] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:04:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:02.711749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3ed4a-d0b7-46c6-83ff-3debab47e495 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:02.868089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b3ed4a-d0b7-46c6-83ff-3debab47e495 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:02.913742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba9409-d750-45f9-af9c-fab02f6c422a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:02.914413 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9409-d750-45f9-af9c-fab02f6c422a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:02.914692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9409-d750-45f9-af9c-fab02f6c422a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:02.914966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ba9409-d750-45f9-af9c-fab02f6c422a None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:02.915646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba9409-d750-45f9-af9c-fab02f6c422a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:02.915951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba9409-d750-45f9-af9c-fab02f6c422a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:02.917352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ba9409-d750-45f9-af9c-fab02f6c422a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:02.929147 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 130/265] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:02.935782 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07967b0-3077-439a-8d46-2196af724e4b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:03.071551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07967b0-3077-439a-8d46-2196af724e4b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:03.117511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b8937c9-1492-467d-8392-7b3531e859c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:03.118583 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8937c9-1492-467d-8392-7b3531e859c8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:03.119061 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8937c9-1492-467d-8392-7b3531e859c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:03.119631 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b8937c9-1492-467d-8392-7b3531e859c8 None admin] PATH_INFO: `/v3/users/db200033d5e543d3b1d3c4600c15bd61` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:03.121098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8937c9-1492-467d-8392-7b3531e859c8 None admin] RBAC: Authorizing `identity:get_user(user_id=db200033d5e543d3b1d3c4600c15bd61)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:03.124783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b8937c9-1492-467d-8392-7b3531e859c8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:03.126986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 136/266] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:04:02 2022] GET /identity/v3/users/db200033d5e543d3b1d3c4600c15bd61 => generated 283 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:03.135021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba9409-d750-45f9-af9c-fab02f6c422a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:03.158695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:03.286507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ba9409-d750-45f9-af9c-fab02f6c422a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:03.353395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a314cf5-3340-48cf-91fc-1db0b810c8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:03.354012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a314cf5-3340-48cf-91fc-1db0b810c8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:03.354288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a314cf5-3340-48cf-91fc-1db0b810c8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:03.354557 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a314cf5-3340-48cf-91fc-1db0b810c8d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:03.398946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6131461-57c0-4b39-ab9f-12ad75337f3b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:03.399581 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6131461-57c0-4b39-ab9f-12ad75337f3b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:03.400073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6131461-57c0-4b39-ab9f-12ad75337f3b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:03.401737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 137/267] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:03.407091 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60842f-eca0-43a6-913e-a040df66c9ab None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:03.407654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60842f-eca0-43a6-913e-a040df66c9ab None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:03.408127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b60842f-eca0-43a6-913e-a040df66c9ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:03.438002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a314cf5-3340-48cf-91fc-1db0b810c8d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:03.439524 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a314cf5-3340-48cf-91fc-1db0b810c8d4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:03.446873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2b60842f-eca0-43a6-913e-a040df66c9ab None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:03.448063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2b60842f-eca0-43a6-913e-a040df66c9ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:03.463485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:03.474325 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:03.587629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 138/268] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:03.601942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 131/269] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:03.607650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60842f-eca0-43a6-913e-a040df66c9ab None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:03.733451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b60842f-eca0-43a6-913e-a040df66c9ab None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:03.768461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d239cf-52f5-4ed1-8e7d-22682f97f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:03.769118 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d239cf-52f5-4ed1-8e7d-22682f97f4be None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:03.769397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d239cf-52f5-4ed1-8e7d-22682f97f4be None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:03.769671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d239cf-52f5-4ed1-8e7d-22682f97f4be None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:03.771035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d239cf-52f5-4ed1-8e7d-22682f97f4be None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:03.772715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d239cf-52f5-4ed1-8e7d-22682f97f4be None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:03.774943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 139/270] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:03 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:03.783103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a314cf5-3340-48cf-91fc-1db0b810c8d4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:03.813939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2728d-0b9e-460a-9c76-a367ac6248be None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:03.814300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2728d-0b9e-460a-9c76-a367ac6248be None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:03.814487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e2728d-0b9e-460a-9c76-a367ac6248be None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:03.815999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 140/271] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:04:03.822004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593f2dd-0825-412a-b0e8-c476a2da240c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:03.822305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593f2dd-0825-412a-b0e8-c476a2da240c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:03.822608 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7593f2dd-0825-412a-b0e8-c476a2da240c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:03.849313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7593f2dd-0825-412a-b0e8-c476a2da240c None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:03.850601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7593f2dd-0825-412a-b0e8-c476a2da240c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:03.890590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:03.941570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 141/272] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:04:03.975069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a314cf5-3340-48cf-91fc-1db0b810c8d4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:03.982608 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593f2dd-0825-412a-b0e8-c476a2da240c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:04.006054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:04.042689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4e8676-5dce-4f02-abea-0860832a9031 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:04.043366 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e8676-5dce-4f02-abea-0860832a9031 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:04.043647 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e8676-5dce-4f02-abea-0860832a9031 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:04.043920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4e8676-5dce-4f02-abea-0860832a9031 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:04.044674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e8676-5dce-4f02-abea-0860832a9031 None admin] RBAC: Adding query filter params (role.id=568edd5e60424ffaa076d1c402c72b19, scope.project.id=93aa5a059e0e48fcacea630bab923912, user.id=db200033d5e543d3b1d3c4600c15bd61) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:04.044986 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e8676-5dce-4f02-abea-0860832a9031 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:04.046546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4e8676-5dce-4f02-abea-0860832a9031 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:04.063449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 132/273] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:03 2022] GET /identity/v3/role_assignments?user.id=db200033d5e543d3b1d3c4600c15bd61&scope.project.id=93aa5a059e0e48fcacea630bab923912&role.id=568edd5e60424ffaa076d1c402c72b19 => generated 608 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:04.132008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7593f2dd-0825-412a-b0e8-c476a2da240c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:04.169231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c171cf-ee7f-4606-8c8d-b7396000a03b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:04.169851 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c171cf-ee7f-4606-8c8d-b7396000a03b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:04.170134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c171cf-ee7f-4606-8c8d-b7396000a03b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:04.170406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c171cf-ee7f-4606-8c8d-b7396000a03b None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:04.186064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c171cf-ee7f-4606-8c8d-b7396000a03b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-22c171cf-ee7f-4606-8c8d-b7396000a03b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:04.195081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:04.196016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:04.196793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:04.196793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:04.196793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:04.196793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:04.196793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:04.196793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:04.196793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:04.196793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:04.196793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:04.196793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:04.196793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:04.196793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:04.196793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 142/274] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:04.200386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809da9b-6a58-42e7-bbc0-8f8f414449dc None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:04.200386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809da9b-6a58-42e7-bbc0-8f8f414449dc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:04.200386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809da9b-6a58-42e7-bbc0-8f8f414449dc None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:04.200386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 133/275] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:04 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:04:04.203678 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c171cf-ee7f-4606-8c8d-b7396000a03b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:04.206685 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863c84f-a181-41a8-849e-2d851b7546ab None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:04.207462 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863c84f-a181-41a8-849e-2d851b7546ab None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:04.207928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a863c84f-a181-41a8-849e-2d851b7546ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:04.219931 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:04.252108 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a863c84f-a181-41a8-849e-2d851b7546ab None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:04.255427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a863c84f-a181-41a8-849e-2d851b7546ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:04.358395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 134/276] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:04:04.359319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863c84f-a181-41a8-849e-2d851b7546ab None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:04.366847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c171cf-ee7f-4606-8c8d-b7396000a03b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:04.412342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe7618-8d02-4434-8107-3e26f16da431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:04.413755 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe7618-8d02-4434-8107-3e26f16da431 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:04.414596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe7618-8d02-4434-8107-3e26f16da431 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:04.415074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe7618-8d02-4434-8107-3e26f16da431 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:04.417697 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe7618-8d02-4434-8107-3e26f16da431 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:04.418546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe7618-8d02-4434-8107-3e26f16da431 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:04.420596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe7618-8d02-4434-8107-3e26f16da431 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:04.437034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 143/277] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:04.439370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe7618-8d02-4434-8107-3e26f16da431 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:04.492674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a863c84f-a181-41a8-849e-2d851b7546ab None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:04.503863 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:04.540446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:04.548326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50e88a-66bd-47c6-a4b2-bd57433c2b03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:04.549346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50e88a-66bd-47c6-a4b2-bd57433c2b03 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:04.549846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50e88a-66bd-47c6-a4b2-bd57433c2b03 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:04.550862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd50e88a-66bd-47c6-a4b2-bd57433c2b03 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:04.552190 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50e88a-66bd-47c6-a4b2-bd57433c2b03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:04.555077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd50e88a-66bd-47c6-a4b2-bd57433c2b03 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:04.557387 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 135/278] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:04.563684 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50e88a-66bd-47c6-a4b2-bd57433c2b03 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:04.584708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe7618-8d02-4434-8107-3e26f16da431 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:04.623264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbefe5b-95fa-4302-9ab9-d2fae8558ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:04.624206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbefe5b-95fa-4302-9ab9-d2fae8558ece None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:04.624684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbefe5b-95fa-4302-9ab9-d2fae8558ece None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:04.625126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbefe5b-95fa-4302-9ab9-d2fae8558ece None admin] PATH_INFO: `/v3/users/bd8bfa2c980a4f9291c56e991fae567c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:04.639866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbefe5b-95fa-4302-9ab9-d2fae8558ece None admin] RBAC: Authorizing `identity:get_user(user_id=bd8bfa2c980a4f9291c56e991fae567c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:04.641681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbefe5b-95fa-4302-9ab9-d2fae8558ece None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:04.643937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 144/279] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:04:04 2022] GET /identity/v3/users/bd8bfa2c980a4f9291c56e991fae567c => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:04.650204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbefe5b-95fa-4302-9ab9-d2fae8558ece None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:04.694014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd50e88a-66bd-47c6-a4b2-bd57433c2b03 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:04.731954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3804c-bfd8-44e3-9960-313dd9f77cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:04.732873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3804c-bfd8-44e3-9960-313dd9f77cf5 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:04.733350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3804c-bfd8-44e3-9960-313dd9f77cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:04.733835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b3804c-bfd8-44e3-9960-313dd9f77cf5 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:04.734750 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3804c-bfd8-44e3-9960-313dd9f77cf5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:04.736426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b3804c-bfd8-44e3-9960-313dd9f77cf5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:04.755242 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbefe5b-95fa-4302-9ab9-d2fae8558ece None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:04.760396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 136/280] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:04:04 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:04:04.761234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3804c-bfd8-44e3-9960-313dd9f77cf5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:04.798679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:04.807433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:04.814219 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8830e03-162f-4592-bbc3-bc12893dacfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:04.814952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8830e03-162f-4592-bbc3-bc12893dacfb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:04.815156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8830e03-162f-4592-bbc3-bc12893dacfb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:04.815382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8830e03-162f-4592-bbc3-bc12893dacfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:04.816183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8830e03-162f-4592-bbc3-bc12893dacfb None admin] RBAC: Adding query filter params (role.id=1e24ea020d1a46989b4f460308a32229, user.id=bd8bfa2c980a4f9291c56e991fae567c, scope.system=all) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:04.817054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8830e03-162f-4592-bbc3-bc12893dacfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:04.819090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8830e03-162f-4592-bbc3-bc12893dacfb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:04.835176 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 145/281] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Sep 15 19:04:04 2022] GET /identity/v3/role_assignments?user.id=bd8bfa2c980a4f9291c56e991fae567c&scope.system=all&role.id=1e24ea020d1a46989b4f460308a32229 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:04.936164 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b3804c-bfd8-44e3-9960-313dd9f77cf5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:04.980859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7700ba-8e46-4bdd-856e-ff1c57d4b517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:04.981491 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7700ba-8e46-4bdd-856e-ff1c57d4b517 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:04.981708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7700ba-8e46-4bdd-856e-ff1c57d4b517 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:04.982016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7700ba-8e46-4bdd-856e-ff1c57d4b517 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:04.995433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7700ba-8e46-4bdd-856e-ff1c57d4b517 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-db7700ba-8e46-4bdd-856e-ff1c57d4b517 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:05.001873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:05.002882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:05.003880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:05.003880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:05.003880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:05.003880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:05.003880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:05.003880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:05.003880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:05.003880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:05.003880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:05.003880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:05.003880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:04:05.003880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:05.003880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 137/282] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:04 2022] GET /identity/v3/roles/reader => generated 84 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:05.012645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8830e03-162f-4592-bbc3-bc12893dacfb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:05.146191 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8830e03-162f-4592-bbc3-bc12893dacfb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:05.195433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8e6a2-69b0-4e55-8270-20c0ec50cf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:05.196077 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e6a2-69b0-4e55-8270-20c0ec50cf2c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:05.196349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e6a2-69b0-4e55-8270-20c0ec50cf2c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:05.196612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd8e6a2-69b0-4e55-8270-20c0ec50cf2c None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:05.197293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8e6a2-69b0-4e55-8270-20c0ec50cf2c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:05.197591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8e6a2-69b0-4e55-8270-20c0ec50cf2c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:05.199049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd8e6a2-69b0-4e55-8270-20c0ec50cf2c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:05.206355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c584a-4d55-4ec4-ab6a-09e4e4a8c2b8 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:05.207278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c584a-4d55-4ec4-ab6a-09e4e4a8c2b8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:05.207549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315c584a-4d55-4ec4-ab6a-09e4e4a8c2b8 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:05.209298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 138/283] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:05.211050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 146/284] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:05 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:05.215563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec45d97-3d6a-4543-acf4-62d96b932730 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:05.215843 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec45d97-3d6a-4543-acf4-62d96b932730 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:05.216110 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec45d97-3d6a-4543-acf4-62d96b932730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:05.216863 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8e6a2-69b0-4e55-8270-20c0ec50cf2c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:05.246386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-3ec45d97-3d6a-4543-acf4-62d96b932730 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:05.247531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3ec45d97-3d6a-4543-acf4-62d96b932730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:05.308708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:05.349683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 139/285] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:05.421691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd8e6a2-69b0-4e55-8270-20c0ec50cf2c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:05.461619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355db913-1e38-46da-8913-1d957c8b97f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:05.462319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db913-1e38-46da-8913-1d957c8b97f2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:05.462594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db913-1e38-46da-8913-1d957c8b97f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:05.462860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355db913-1e38-46da-8913-1d957c8b97f2 None admin] PATH_INFO: `/v3/users/6abf2ab094a34b8896694b40c68a6448` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:05.464051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355db913-1e38-46da-8913-1d957c8b97f2 None admin] RBAC: Authorizing `identity:get_user(user_id=6abf2ab094a34b8896694b40c68a6448)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:05.465512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355db913-1e38-46da-8913-1d957c8b97f2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:05.467469 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 147/286] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:04:05 2022] GET /identity/v3/users/6abf2ab094a34b8896694b40c68a6448 => generated 297 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:05.473089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec45d97-3d6a-4543-acf4-62d96b932730 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:05.510283 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:05.646742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec45d97-3d6a-4543-acf4-62d96b932730 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:05.668604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355db913-1e38-46da-8913-1d957c8b97f2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:05.688871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f142f-6b32-4a18-821f-bea7fa9fc2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:05.689534 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f142f-6b32-4a18-821f-bea7fa9fc2d1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:05.689844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f142f-6b32-4a18-821f-bea7fa9fc2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:05.690129 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700f142f-6b32-4a18-821f-bea7fa9fc2d1 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:05.691395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f142f-6b32-4a18-821f-bea7fa9fc2d1 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:05.692900 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700f142f-6b32-4a18-821f-bea7fa9fc2d1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:05.695163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 140/287] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:05 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:05.701143 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f142f-6b32-4a18-821f-bea7fa9fc2d1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:05.885917 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:05.892514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355db913-1e38-46da-8913-1d957c8b97f2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:05.916426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700f142f-6b32-4a18-821f-bea7fa9fc2d1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:05.928885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:05.949904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b6b01-954e-4875-a66d-6cea472c6b6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:05.950560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b6b01-954e-4875-a66d-6cea472c6b6f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:05.950832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b6b01-954e-4875-a66d-6cea472c6b6f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:05.951098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947b6b01-954e-4875-a66d-6cea472c6b6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:05.971490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947b6b01-954e-4875-a66d-6cea472c6b6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-947b6b01-954e-4875-a66d-6cea472c6b6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:05.977377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:05.978292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:05.979163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:05.979163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:05.979163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:05.979163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:05.979163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:05.979163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:05.979163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:05.979163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:05.979163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:05.979163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:05.979163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:05.979163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:05.979163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 148/288] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:05.986768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b6b01-954e-4875-a66d-6cea472c6b6f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:05.993337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746af6ab-1c59-4388-8c50-16c498510009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:05.994668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746af6ab-1c59-4388-8c50-16c498510009 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:05.995951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746af6ab-1c59-4388-8c50-16c498510009 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:05.996426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746af6ab-1c59-4388-8c50-16c498510009 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912/users/6abf2ab094a34b8896694b40c68a6448/roles/b4a71464f9e64fa2bf52e7cbdec257c8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:06.002926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746af6ab-1c59-4388-8c50-16c498510009 None admin] RBAC: Authorizing `identity:create_grant(project_id=93aa5a059e0e48fcacea630bab923912, user_id=6abf2ab094a34b8896694b40c68a6448, role_id=b4a71464f9e64fa2bf52e7cbdec257c8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:06.004612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746af6ab-1c59-4388-8c50-16c498510009 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:06.029990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 141/289] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:04:05 2022] PUT /identity/v3/projects/93aa5a059e0e48fcacea630bab923912/users/6abf2ab094a34b8896694b40c68a6448/roles/b4a71464f9e64fa2bf52e7cbdec257c8 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:04:06.131559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947b6b01-954e-4875-a66d-6cea472c6b6f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:06.173034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910eb47c-d08c-405c-bb70-38ec14859272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:06.174035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910eb47c-d08c-405c-bb70-38ec14859272 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:06.174514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910eb47c-d08c-405c-bb70-38ec14859272 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:06.175003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910eb47c-d08c-405c-bb70-38ec14859272 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:06.175873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910eb47c-d08c-405c-bb70-38ec14859272 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:06.176372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910eb47c-d08c-405c-bb70-38ec14859272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:06.178166 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910eb47c-d08c-405c-bb70-38ec14859272 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:06.188709 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 149/290] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:06.194496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746af6ab-1c59-4388-8c50-16c498510009 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:06.349169 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746af6ab-1c59-4388-8c50-16c498510009 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:06.391908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91268a36-35c2-477b-921a-39be3259be1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:06.393013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91268a36-35c2-477b-921a-39be3259be1e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:06.393585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91268a36-35c2-477b-921a-39be3259be1e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:06.394078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91268a36-35c2-477b-921a-39be3259be1e None admin] PATH_INFO: `/v3/users/204a2b288a8642f396e3f34bc044c2e7` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:06.395466 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91268a36-35c2-477b-921a-39be3259be1e None admin] RBAC: Authorizing `identity:get_user(user_id=204a2b288a8642f396e3f34bc044c2e7)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:06.397278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91268a36-35c2-477b-921a-39be3259be1e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:06.399477 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 142/291] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:04:06 2022] GET /identity/v3/users/204a2b288a8642f396e3f34bc044c2e7 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:06.411110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910eb47c-d08c-405c-bb70-38ec14859272 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:06.470885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:06.561572 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910eb47c-d08c-405c-bb70-38ec14859272 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:06.622147 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf506a50-ba9b-48e6-b4dc-9a3a4a2d0210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:06.623708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf506a50-ba9b-48e6-b4dc-9a3a4a2d0210 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:06.624500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf506a50-ba9b-48e6-b4dc-9a3a4a2d0210 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:06.625248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf506a50-ba9b-48e6-b4dc-9a3a4a2d0210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:06.737049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf506a50-ba9b-48e6-b4dc-9a3a4a2d0210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:06.738946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf506a50-ba9b-48e6-b4dc-9a3a4a2d0210 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:06.798153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:06.868779 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 150/292] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:06.874726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91268a36-35c2-477b-921a-39be3259be1e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:06.896258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:07.003135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91268a36-35c2-477b-921a-39be3259be1e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:07.046624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a9b8a3-6d73-4fd1-89c9-21efe0732ff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:07.047625 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9b8a3-6d73-4fd1-89c9-21efe0732ff0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:07.048180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9b8a3-6d73-4fd1-89c9-21efe0732ff0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:07.048664 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a9b8a3-6d73-4fd1-89c9-21efe0732ff0 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:07.050061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9b8a3-6d73-4fd1-89c9-21efe0732ff0 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:07.051736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a9b8a3-6d73-4fd1-89c9-21efe0732ff0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:07.054116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 143/293] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:06 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:07.062915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf506a50-ba9b-48e6-b4dc-9a3a4a2d0210 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:07.189224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf506a50-ba9b-48e6-b4dc-9a3a4a2d0210 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:07.239857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c01c54-ab52-4588-9e70-afab885a31cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:07.240790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c01c54-ab52-4588-9e70-afab885a31cd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:07.241212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c01c54-ab52-4588-9e70-afab885a31cd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:07.241648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c01c54-ab52-4588-9e70-afab885a31cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:07.242543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c01c54-ab52-4588-9e70-afab885a31cd None admin] RBAC: Adding query filter params (role.id=1e24ea020d1a46989b4f460308a32229, scope.project.id=93aa5a059e0e48fcacea630bab923912, user.id=204a2b288a8642f396e3f34bc044c2e7) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:07.242995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c01c54-ab52-4588-9e70-afab885a31cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:07.244598 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c01c54-ab52-4588-9e70-afab885a31cd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:07.254674 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 151/294] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:07 2022] GET /identity/v3/role_assignments?user.id=204a2b288a8642f396e3f34bc044c2e7&scope.project.id=93aa5a059e0e48fcacea630bab923912&role.id=1e24ea020d1a46989b4f460308a32229 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:07.567251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a68d9-68ec-4567-b801-1070dda910b0 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:07.567829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a68d9-68ec-4567-b801-1070dda910b0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:07.568250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027a68d9-68ec-4567-b801-1070dda910b0 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:07.569957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 144/295] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:07.575797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa15a-3094-47a9-9a29-3f4e52f5f5b7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:07.576080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa15a-3094-47a9-9a29-3f4e52f5f5b7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:07.576353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621fa15a-3094-47a9-9a29-3f4e52f5f5b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:07.597745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a0712-58b1-410a-b0e7-5c45534ca08c None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:07.598398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a0712-58b1-410a-b0e7-5c45534ca08c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:07.598993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7a0712-58b1-410a-b0e7-5c45534ca08c None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:07.600657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 145/296] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:04:07.602074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-621fa15a-3094-47a9-9a29-3f4e52f5f5b7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:07.602303 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-621fa15a-3094-47a9-9a29-3f4e52f5f5b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:07.604540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:07.607799 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c57447-4b19-4093-9ac5-cdd6af34cff5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:07.609253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c57447-4b19-4093-9ac5-cdd6af34cff5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:07.609253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c57447-4b19-4093-9ac5-cdd6af34cff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:07.638661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-50c57447-4b19-4093-9ac5-cdd6af34cff5 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:07.639590 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-50c57447-4b19-4093-9ac5-cdd6af34cff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:07.719323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 152/297] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:04:07.757926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 146/298] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:04:08.062020 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa15a-3094-47a9-9a29-3f4e52f5f5b7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:08.078696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c57447-4b19-4093-9ac5-cdd6af34cff5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:08.098198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:08.218420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621fa15a-3094-47a9-9a29-3f4e52f5f5b7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:08.220470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c57447-4b19-4093-9ac5-cdd6af34cff5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:08.276425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e38e56-6ae7-440e-b585-26a21e61001c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:08.278904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e38e56-6ae7-440e-b585-26a21e61001c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:08.279350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e38e56-6ae7-440e-b585-26a21e61001c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:08.279765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e38e56-6ae7-440e-b585-26a21e61001c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:08.279879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f17b65f-28f1-40d9-bb34-38b133f31969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:08.280798 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17b65f-28f1-40d9-bb34-38b133f31969 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:08.281255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17b65f-28f1-40d9-bb34-38b133f31969 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:08.281699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f17b65f-28f1-40d9-bb34-38b133f31969 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:08.309929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:08.311537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f17b65f-28f1-40d9-bb34-38b133f31969 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:08.311697 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1e38e56-6ae7-440e-b585-26a21e61001c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-5f17b65f-28f1-40d9-bb34-38b133f31969 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:08.320253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:08.321817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:08.323846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:08.323846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:08.323846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:08.323846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:08.323846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:08.323846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:08.323846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:08.323846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:08.323846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:08.323846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:08.323846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:08.323846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c1e38e56-6ae7-440e-b585-26a21e61001c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:08.324893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:08.326571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:08.328638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:08.328638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:08.328638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:08.328638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:08.328638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:08.328638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:08.328638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:08.328638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:08.328638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:08.328638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:08.328638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:04:08.328638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:08.330216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 147/299] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:08.330216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865b5f3-cf64-44ec-aec0-e69b5cb0ee92 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:08.330216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865b5f3-cf64-44ec-aec0-e69b5cb0ee92 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:08.330216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7865b5f3-cf64-44ec-aec0-e69b5cb0ee92 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:08.330892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 153/300] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:08 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:08.330892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e38e56-6ae7-440e-b585-26a21e61001c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:08.331160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 148/301] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:08 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:08.331807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9239bd6-66f4-4137-ba20-9a5c1369146f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:08.333848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9239bd6-66f4-4137-ba20-9a5c1369146f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:08.333848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9239bd6-66f4-4137-ba20-9a5c1369146f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:08.379619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b9239bd6-66f4-4137-ba20-9a5c1369146f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:08.381872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b9239bd6-66f4-4137-ba20-9a5c1369146f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:08.468863 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 149/302] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:08.471320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9239bd6-66f4-4137-ba20-9a5c1369146f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:08.475597 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:08.480015 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e38e56-6ae7-440e-b585-26a21e61001c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:08.526913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0c53b-a57d-4a00-9363-694455ee8777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:08.527787 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0c53b-a57d-4a00-9363-694455ee8777 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:08.528206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0c53b-a57d-4a00-9363-694455ee8777 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:08.528619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e0c53b-a57d-4a00-9363-694455ee8777 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:08.529537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0c53b-a57d-4a00-9363-694455ee8777 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:08.530102 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0c53b-a57d-4a00-9363-694455ee8777 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:08.531744 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e0c53b-a57d-4a00-9363-694455ee8777 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:08.549333 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 154/303] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:08.551673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0c53b-a57d-4a00-9363-694455ee8777 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:08.583569 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9239bd6-66f4-4137-ba20-9a5c1369146f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:08.623480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1cb1-4516-422d-b67a-09022fe46fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:08.624585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1cb1-4516-422d-b67a-09022fe46fb9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:08.625047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1cb1-4516-422d-b67a-09022fe46fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:08.625615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333b1cb1-4516-422d-b67a-09022fe46fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:08.626733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b1cb1-4516-422d-b67a-09022fe46fb9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:08.627263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b1cb1-4516-422d-b67a-09022fe46fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:08.628897 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333b1cb1-4516-422d-b67a-09022fe46fb9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:08.639637 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 150/304] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:08.641162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:08.646081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1cb1-4516-422d-b67a-09022fe46fb9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:08.717010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e0c53b-a57d-4a00-9363-694455ee8777 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:08.721294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:08.757101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3143652-4301-44b8-90ea-77901eba4ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:08.758142 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3143652-4301-44b8-90ea-77901eba4ebc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:08.758461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3143652-4301-44b8-90ea-77901eba4ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:08.758824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3143652-4301-44b8-90ea-77901eba4ebc None admin] PATH_INFO: `/v3/users/bd8bfa2c980a4f9291c56e991fae567c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:08.760382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3143652-4301-44b8-90ea-77901eba4ebc None admin] RBAC: Authorizing `identity:get_user(user_id=bd8bfa2c980a4f9291c56e991fae567c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:08.761864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3143652-4301-44b8-90ea-77901eba4ebc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:08.763512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 155/305] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:04:08 2022] GET /identity/v3/users/bd8bfa2c980a4f9291c56e991fae567c => generated 293 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:08.764870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee95a-da68-4213-bd68-0106952381c6 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:08.765167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee95a-da68-4213-bd68-0106952381c6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:08.765608 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9eee95a-da68-4213-bd68-0106952381c6 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:08.767250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 156/306] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:08.772197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333b1cb1-4516-422d-b67a-09022fe46fb9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:08.773567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5e0cb-daea-47a9-9220-775c6339fba1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:08.773908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5e0cb-daea-47a9-9220-775c6339fba1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:08.774207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5e0cb-daea-47a9-9220-775c6339fba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:08.793475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-07a5e0cb-daea-47a9-9220-775c6339fba1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:08.794730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-07a5e0cb-daea-47a9-9220-775c6339fba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:08.815626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f57f8-52c5-49a9-89ce-d6c3089c9adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:08.816285 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f57f8-52c5-49a9-89ce-d6c3089c9adb None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:08.816560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f57f8-52c5-49a9-89ce-d6c3089c9adb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:08.816894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0f57f8-52c5-49a9-89ce-d6c3089c9adb None admin] PATH_INFO: `/v3/users/a87dc0e7c3e243d7803c085aea0f3483` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:08.833060 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f57f8-52c5-49a9-89ce-d6c3089c9adb None admin] RBAC: Authorizing `identity:get_user(user_id=a87dc0e7c3e243d7803c085aea0f3483)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:08.835290 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0f57f8-52c5-49a9-89ce-d6c3089c9adb None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:08.837046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 151/307] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:04:08 2022] GET /identity/v3/users/a87dc0e7c3e243d7803c085aea0f3483 => generated 293 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:08.837986 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f57f8-52c5-49a9-89ce-d6c3089c9adb None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:08.873338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 157/308] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:08.874290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5e0cb-daea-47a9-9220-775c6339fba1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:08.958698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0f57f8-52c5-49a9-89ce-d6c3089c9adb None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:08.964528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:08.987646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:08.999052 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a876-ee94-47d9-b499-15ec436414db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:08.999714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a876-ee94-47d9-b499-15ec436414db None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:08.999993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a876-ee94-47d9-b499-15ec436414db None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:09.000268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2780a876-ee94-47d9-b499-15ec436414db None admin] PATH_INFO: `/v3/system/users/bd8bfa2c980a4f9291c56e991fae567c/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:09.001705 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780a876-ee94-47d9-b499-15ec436414db None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=bd8bfa2c980a4f9291c56e991fae567c, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:09.003145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2780a876-ee94-47d9-b499-15ec436414db None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:09.014288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 152/309] 10.222.0.25 () {58 vars in 1334 bytes} [Thu Sep 15 19:04:08 2022] PUT /identity/v3/system/users/bd8bfa2c980a4f9291c56e991fae567c/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:04:09.015169 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a876-ee94-47d9-b499-15ec436414db None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:09.035330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5e0cb-daea-47a9-9220-775c6339fba1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:09.096602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f1a35-5327-4ae0-8f80-dfa8fa854ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:09.097910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f1a35-5327-4ae0-8f80-dfa8fa854ddf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:09.098369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f1a35-5327-4ae0-8f80-dfa8fa854ddf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:09.098827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9f1a35-5327-4ae0-8f80-dfa8fa854ddf None admin] PATH_INFO: `/v3/domains/default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:09.100841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f1a35-5327-4ae0-8f80-dfa8fa854ddf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:09.103409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9f1a35-5327-4ae0-8f80-dfa8fa854ddf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:09.106568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 158/310] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:09.111838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f1a35-5327-4ae0-8f80-dfa8fa854ddf None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:09.206394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2780a876-ee94-47d9-b499-15ec436414db None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:09.236704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9f1a35-5327-4ae0-8f80-dfa8fa854ddf None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:09.257405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f35f85-a323-4816-a807-8d71ba62c6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:09.258065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f35f85-a323-4816-a807-8d71ba62c6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:09.258349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f35f85-a323-4816-a807-8d71ba62c6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:09.258617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f35f85-a323-4816-a807-8d71ba62c6c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:09.259346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f35f85-a323-4816-a807-8d71ba62c6c1 None admin] RBAC: Adding query filter params (role.id=b4a71464f9e64fa2bf52e7cbdec257c8, user.id=a87dc0e7c3e243d7803c085aea0f3483, scope.system=all) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:09.259653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f35f85-a323-4816-a807-8d71ba62c6c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:09.261098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f35f85-a323-4816-a807-8d71ba62c6c1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:09.264715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:09.273806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 153/311] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Sep 15 19:04:09 2022] GET /identity/v3/role_assignments?user.id=a87dc0e7c3e243d7803c085aea0f3483&scope.system=all&role.id=b4a71464f9e64fa2bf52e7cbdec257c8 => generated 226 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:09.273806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f35f85-a323-4816-a807-8d71ba62c6c1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:09.283276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba817b-7753-4680-8e98-2af49cd4487b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:09.284380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba817b-7753-4680-8e98-2af49cd4487b None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:09.284753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba817b-7753-4680-8e98-2af49cd4487b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:09.285710 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba817b-7753-4680-8e98-2af49cd4487b None admin] PATH_INFO: `/v3/groups` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:09.286732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba817b-7753-4680-8e98-2af49cd4487b None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:09.288776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba817b-7753-4680-8e98-2af49cd4487b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:09.318728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 159/312] 10.222.0.25 () {60 vars in 1134 bytes} [Thu Sep 15 19:04:09 2022] POST /identity/v3/groups => generated 229 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:04:09.346158 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:09.429170 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f35f85-a323-4816-a807-8d71ba62c6c1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:09.471869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbb8d5-851d-495b-92d0-ede7c0a5f9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:09.472987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbb8d5-851d-495b-92d0-ede7c0a5f9ae None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:09.473272 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbb8d5-851d-495b-92d0-ede7c0a5f9ae None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:09.473599 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbb8d5-851d-495b-92d0-ede7c0a5f9ae None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:09.486771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbb8d5-851d-495b-92d0-ede7c0a5f9ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-8abbb8d5-851d-495b-92d0-ede7c0a5f9ae None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:09.492785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:09.493960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:09.495135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:09.495135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:09.495135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:09.495135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:09.495135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:09.495135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:09.495135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:09.495135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:09.495135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:09.495135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:09.495135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:04:09.495135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:09.495135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 154/313] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:09 2022] GET /identity/v3/roles/reader => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:09.500206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba817b-7753-4680-8e98-2af49cd4487b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:09.612393 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba817b-7753-4680-8e98-2af49cd4487b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:09.650872 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94a9af-8a7a-4ca5-854e-eacb847b7070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:09.651862 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94a9af-8a7a-4ca5-854e-eacb847b7070 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:09.652335 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94a9af-8a7a-4ca5-854e-eacb847b7070 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:09.652796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94a9af-8a7a-4ca5-854e-eacb847b7070 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:09.653692 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94a9af-8a7a-4ca5-854e-eacb847b7070 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:09.654296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94a9af-8a7a-4ca5-854e-eacb847b7070 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:09.655890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94a9af-8a7a-4ca5-854e-eacb847b7070 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:09.666597 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 160/314] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:09 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:09.673823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbb8d5-851d-495b-92d0-ede7c0a5f9ae None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:09.781714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbb8d5-851d-495b-92d0-ede7c0a5f9ae None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:09.797054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:09.825984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45886c60-e753-45c0-b70a-4c160179d28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:09.826705 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45886c60-e753-45c0-b70a-4c160179d28a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:09.826987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45886c60-e753-45c0-b70a-4c160179d28a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:09.827262 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45886c60-e753-45c0-b70a-4c160179d28a None admin] PATH_INFO: `/v3/users/6abf2ab094a34b8896694b40c68a6448` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:09.828574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45886c60-e753-45c0-b70a-4c160179d28a None admin] RBAC: Authorizing `identity:get_user(user_id=6abf2ab094a34b8896694b40c68a6448)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:09.830220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45886c60-e753-45c0-b70a-4c160179d28a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:09.832327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 155/315] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:04:09 2022] GET /identity/v3/users/6abf2ab094a34b8896694b40c68a6448 => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:09.838426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94a9af-8a7a-4ca5-854e-eacb847b7070 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:09.896255 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:09.958471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94a9af-8a7a-4ca5-854e-eacb847b7070 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:10.001716 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f15ef-9e19-4f35-842c-10183ecb9192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:10.002379 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f15ef-9e19-4f35-842c-10183ecb9192 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:10.002714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f15ef-9e19-4f35-842c-10183ecb9192 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:10.002991 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924f15ef-9e19-4f35-842c-10183ecb9192 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:10.079516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f15ef-9e19-4f35-842c-10183ecb9192 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:10.080914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924f15ef-9e19-4f35-842c-10183ecb9192 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:10.133746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:10.198704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 161/316] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:10.204145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45886c60-e753-45c0-b70a-4c160179d28a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:10.319095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45886c60-e753-45c0-b70a-4c160179d28a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:10.354696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5275395-a0ec-417f-b7dd-4d60b98ee9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:10.355681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5275395-a0ec-417f-b7dd-4d60b98ee9ee None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:10.356144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5275395-a0ec-417f-b7dd-4d60b98ee9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:10.356598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5275395-a0ec-417f-b7dd-4d60b98ee9ee None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:10.357953 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5275395-a0ec-417f-b7dd-4d60b98ee9ee None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:10.359597 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5275395-a0ec-417f-b7dd-4d60b98ee9ee None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:10.361812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 156/317] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:10 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:10.372111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f15ef-9e19-4f35-842c-10183ecb9192 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:10.482492 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924f15ef-9e19-4f35-842c-10183ecb9192 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:10.518178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbeb14f-2c18-4965-994f-75a1c49334de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:10.518800 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeb14f-2c18-4965-994f-75a1c49334de None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:10.519076 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeb14f-2c18-4965-994f-75a1c49334de None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:10.519343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbeb14f-2c18-4965-994f-75a1c49334de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:10.520069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbeb14f-2c18-4965-994f-75a1c49334de None admin] RBAC: Adding query filter params (role.id=b4a71464f9e64fa2bf52e7cbdec257c8, scope.project.id=93aa5a059e0e48fcacea630bab923912, user.id=6abf2ab094a34b8896694b40c68a6448) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:10.520375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbeb14f-2c18-4965-994f-75a1c49334de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:10.522020 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbeb14f-2c18-4965-994f-75a1c49334de None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:10.529058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 162/318] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:10 2022] GET /identity/v3/role_assignments?user.id=6abf2ab094a34b8896694b40c68a6448&scope.project.id=93aa5a059e0e48fcacea630bab923912&role.id=b4a71464f9e64fa2bf52e7cbdec257c8 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:11.280244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86de4a9-64d8-4542-b2d6-ff24f3d4a9e5 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:11.280630 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86de4a9-64d8-4542-b2d6-ff24f3d4a9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:11.280848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86de4a9-64d8-4542-b2d6-ff24f3d4a9e5 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:11.282271 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 157/319] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:11.288156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e973b86-cbc4-49ab-9c0c-b4e3f13eb2da None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:11.288432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e973b86-cbc4-49ab-9c0c-b4e3f13eb2da None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:11.288699 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e973b86-cbc4-49ab-9c0c-b4e3f13eb2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:11.310904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7e973b86-cbc4-49ab-9c0c-b4e3f13eb2da None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:11.312098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7e973b86-cbc4-49ab-9c0c-b4e3f13eb2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:11.320993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:11.387938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 163/320] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:11.533982 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f4da-ab3a-4f50-9cb2-f5ef1792c016 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:11.534494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f4da-ab3a-4f50-9cb2-f5ef1792c016 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:11.534494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6f4da-ab3a-4f50-9cb2-f5ef1792c016 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:11.535812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 158/321] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:11.541325 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b49c37-136d-44d5-8ddf-a53636efad2b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:11.541589 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b49c37-136d-44d5-8ddf-a53636efad2b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:11.541900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b49c37-136d-44d5-8ddf-a53636efad2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:11.561360 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-37b49c37-136d-44d5-8ddf-a53636efad2b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:11.562568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-37b49c37-136d-44d5-8ddf-a53636efad2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:11.633518 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 164/322] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:11.651519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6f4da-ab3a-4f50-9cb2-f5ef1792c016 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:11.711604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:11.769266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6f4da-ab3a-4f50-9cb2-f5ef1792c016 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:11.779808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac536d98-b2f5-4fc9-9cda-6f8bfbb5faec None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:11.780088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac536d98-b2f5-4fc9-9cda-6f8bfbb5faec None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:11.780355 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac536d98-b2f5-4fc9-9cda-6f8bfbb5faec None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:11.781804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 165/323] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:11.787921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f7b7-ade2-4614-acf4-7af9657dafd2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:11.788070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f7b7-ade2-4614-acf4-7af9657dafd2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:11.788331 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e8f7b7-ade2-4614-acf4-7af9657dafd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:11.809621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-41e8f7b7-ade2-4614-acf4-7af9657dafd2 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:11.810879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-41e8f7b7-ade2-4614-acf4-7af9657dafd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:11.815807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423691d0-46e3-4e72-8dd4-4bf6a063616f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:11.816609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423691d0-46e3-4e72-8dd4-4bf6a063616f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:11.817018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423691d0-46e3-4e72-8dd4-4bf6a063616f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:11.817421 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423691d0-46e3-4e72-8dd4-4bf6a063616f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:11.831193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423691d0-46e3-4e72-8dd4-4bf6a063616f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-423691d0-46e3-4e72-8dd4-4bf6a063616f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:11.836618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:11.837679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:11.838661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:11.838661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:11.838661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:11.838661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:11.838661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:11.838661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:11.838661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:11.838661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:11.838661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:11.838661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:11.838661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:11.838661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:11.845500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 159/324] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:11.847089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423691d0-46e3-4e72-8dd4-4bf6a063616f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:11.893833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 166/325] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:11.899897 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f7b7-ade2-4614-acf4-7af9657dafd2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:11.902711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:11.958260 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423691d0-46e3-4e72-8dd4-4bf6a063616f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:11.970459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:11.999120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c7c4e-89fe-40b8-8cc1-6ced355a3874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:11.999847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c7c4e-89fe-40b8-8cc1-6ced355a3874 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:12.000128 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c7c4e-89fe-40b8-8cc1-6ced355a3874 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:12.000417 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411c7c4e-89fe-40b8-8cc1-6ced355a3874 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:12.001165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c7c4e-89fe-40b8-8cc1-6ced355a3874 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:12.001469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c7c4e-89fe-40b8-8cc1-6ced355a3874 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:12.003074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411c7c4e-89fe-40b8-8cc1-6ced355a3874 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:12.010278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e8f7b7-ade2-4614-acf4-7af9657dafd2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:12.013012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 160/326] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:12.018906 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c7c4e-89fe-40b8-8cc1-6ced355a3874 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:12.050304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e95b9f-681b-4b64-bc61-f6350bbcc44e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:12.050977 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e95b9f-681b-4b64-bc61-f6350bbcc44e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:12.051255 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e95b9f-681b-4b64-bc61-f6350bbcc44e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:12.051532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e95b9f-681b-4b64-bc61-f6350bbcc44e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:12.063590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e95b9f-681b-4b64-bc61-f6350bbcc44e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d1e95b9f-681b-4b64-bc61-f6350bbcc44e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:12.069580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:12.070526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:12.071327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:12.071327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:12.071327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:12.071327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:12.071327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:12.071327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:12.071327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:12.071327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:12.071327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:12.071327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:12.071327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:04:12.071327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:12.071327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 167/327] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:12.077293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e95b9f-681b-4b64-bc61-f6350bbcc44e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:12.136818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411c7c4e-89fe-40b8-8cc1-6ced355a3874 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:12.147565 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:12.172427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12030a17-23fd-47a7-ae4f-d933a74349f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:12.173091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12030a17-23fd-47a7-ae4f-d933a74349f1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:12.173376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12030a17-23fd-47a7-ae4f-d933a74349f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:12.173650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12030a17-23fd-47a7-ae4f-d933a74349f1 None admin] PATH_INFO: `/v3/users/bd8bfa2c980a4f9291c56e991fae567c` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:12.174818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12030a17-23fd-47a7-ae4f-d933a74349f1 None admin] RBAC: Authorizing `identity:get_user(user_id=bd8bfa2c980a4f9291c56e991fae567c)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:12.176270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12030a17-23fd-47a7-ae4f-d933a74349f1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:12.177932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 161/328] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:04:12 2022] GET /identity/v3/users/bd8bfa2c980a4f9291c56e991fae567c => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:12.178712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12030a17-23fd-47a7-ae4f-d933a74349f1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:12.195352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e95b9f-681b-4b64-bc61-f6350bbcc44e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:12.218791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:12.231451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a5bfc-519c-4e57-ba1a-d162ee7038d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:12.232067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5bfc-519c-4e57-ba1a-d162ee7038d1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:12.232341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5bfc-519c-4e57-ba1a-d162ee7038d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:12.232608 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a5bfc-519c-4e57-ba1a-d162ee7038d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:12.233269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a5bfc-519c-4e57-ba1a-d162ee7038d1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:12.233565 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a5bfc-519c-4e57-ba1a-d162ee7038d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:12.234977 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886a5bfc-519c-4e57-ba1a-d162ee7038d1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:12.249041 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 168/329] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:12.250245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a5bfc-519c-4e57-ba1a-d162ee7038d1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:12.283330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12030a17-23fd-47a7-ae4f-d933a74349f1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:12.320112 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff49c8d-1813-44d6-87ff-4dc0b69e6e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:12.320667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff49c8d-1813-44d6-87ff-4dc0b69e6e68 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:12.320944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff49c8d-1813-44d6-87ff-4dc0b69e6e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:12.321215 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff49c8d-1813-44d6-87ff-4dc0b69e6e68 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:12.322374 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff49c8d-1813-44d6-87ff-4dc0b69e6e68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:12.323839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff49c8d-1813-44d6-87ff-4dc0b69e6e68 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:12.325449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 162/330] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:12.326252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff49c8d-1813-44d6-87ff-4dc0b69e6e68 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:12.353167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886a5bfc-519c-4e57-ba1a-d162ee7038d1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:12.378078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:12.392389 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d0c65-8185-4d7b-91eb-b6183c22df62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:12.393082 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d0c65-8185-4d7b-91eb-b6183c22df62 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:12.393310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d0c65-8185-4d7b-91eb-b6183c22df62 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:12.393572 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977d0c65-8185-4d7b-91eb-b6183c22df62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:12.394348 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d0c65-8185-4d7b-91eb-b6183c22df62 None admin] RBAC: Adding query filter params (role.id=1e24ea020d1a46989b4f460308a32229, user.id=bd8bfa2c980a4f9291c56e991fae567c, scope.system=all) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:12.394658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d0c65-8185-4d7b-91eb-b6183c22df62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:12.396092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977d0c65-8185-4d7b-91eb-b6183c22df62 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:12.408377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 169/331] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Sep 15 19:04:12 2022] GET /identity/v3/role_assignments?user.id=bd8bfa2c980a4f9291c56e991fae567c&scope.system=all&role.id=1e24ea020d1a46989b4f460308a32229 => generated 510 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:12.409238 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d0c65-8185-4d7b-91eb-b6183c22df62 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:12.448490 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff49c8d-1813-44d6-87ff-4dc0b69e6e68 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:12.457684 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:12.490469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd07ba-438d-4e0b-a900-d5882ff4a727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:12.491825 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd07ba-438d-4e0b-a900-d5882ff4a727 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:12.492102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd07ba-438d-4e0b-a900-d5882ff4a727 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:12.492376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afd07ba-438d-4e0b-a900-d5882ff4a727 None admin] PATH_INFO: `/v3/users/a87dc0e7c3e243d7803c085aea0f3483` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:12.493664 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd07ba-438d-4e0b-a900-d5882ff4a727 None admin] RBAC: Authorizing `identity:get_user(user_id=a87dc0e7c3e243d7803c085aea0f3483)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:12.495229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afd07ba-438d-4e0b-a900-d5882ff4a727 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:12.502035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 163/332] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:04:12 2022] GET /identity/v3/users/a87dc0e7c3e243d7803c085aea0f3483 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:12.503019 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd07ba-438d-4e0b-a900-d5882ff4a727 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:12.528200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977d0c65-8185-4d7b-91eb-b6183c22df62 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:12.570889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cdfbe-34cc-42a4-bce8-ebc4bf878cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:12.571906 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cdfbe-34cc-42a4-bce8-ebc4bf878cbe None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:12.572376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cdfbe-34cc-42a4-bce8-ebc4bf878cbe None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:12.572645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cdfbe-34cc-42a4-bce8-ebc4bf878cbe None admin] PATH_INFO: `/v3/groups` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:12.573337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cdfbe-34cc-42a4-bce8-ebc4bf878cbe None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:12.574832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cdfbe-34cc-42a4-bce8-ebc4bf878cbe None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:12.596730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 170/333] 10.222.0.25 () {60 vars in 1134 bytes} [Thu Sep 15 19:04:12 2022] POST /identity/v3/groups => generated 226 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:04:12.625691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afd07ba-438d-4e0b-a900-d5882ff4a727 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:12.668988 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebabf622-8556-4878-b971-1f3d9b67fe1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:12.669708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabf622-8556-4878-b971-1f3d9b67fe1d None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:12.670022 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabf622-8556-4878-b971-1f3d9b67fe1d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:12.670284 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebabf622-8556-4878-b971-1f3d9b67fe1d None admin] PATH_INFO: `/v3/system/users/a87dc0e7c3e243d7803c085aea0f3483/roles/b4a71464f9e64fa2bf52e7cbdec257c8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:12.671881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabf622-8556-4878-b971-1f3d9b67fe1d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=a87dc0e7c3e243d7803c085aea0f3483, role_id=b4a71464f9e64fa2bf52e7cbdec257c8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:12.673341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebabf622-8556-4878-b971-1f3d9b67fe1d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:12.685826 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 164/334] 10.222.0.25 () {58 vars in 1334 bytes} [Thu Sep 15 19:04:12 2022] PUT /identity/v3/system/users/a87dc0e7c3e243d7803c085aea0f3483/roles/b4a71464f9e64fa2bf52e7cbdec257c8 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:04:15.101185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ace79-2a2c-4cd7-b3fb-02e150b3ea5d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:15.101767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ace79-2a2c-4cd7-b3fb-02e150b3ea5d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:15.101767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0ace79-2a2c-4cd7-b3fb-02e150b3ea5d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:15.103427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 171/335] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:15.108882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b0fb-ffe5-46d3-a9a4-807e6804bf7f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:15.109902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b0fb-ffe5-46d3-a9a4-807e6804bf7f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:15.110382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260b0fb-ffe5-46d3-a9a4-807e6804bf7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:15.134616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b260b0fb-ffe5-46d3-a9a4-807e6804bf7f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:15.136183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b260b0fb-ffe5-46d3-a9a4-807e6804bf7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:15.172016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:15.219135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 165/336] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:15.248409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62160a88-b5f6-478b-9784-cb0cdfbb1af6 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:15.248744 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62160a88-b5f6-478b-9784-cb0cdfbb1af6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:15.248956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62160a88-b5f6-478b-9784-cb0cdfbb1af6 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:15.250540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 172/337] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:15.263928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3612544-c7a8-46fa-b12a-840e8455fdc2 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:15.264264 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3612544-c7a8-46fa-b12a-840e8455fdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:15.264505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3612544-c7a8-46fa-b12a-840e8455fdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:15.289388 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d3612544-c7a8-46fa-b12a-840e8455fdc2 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:15.290659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d3612544-c7a8-46fa-b12a-840e8455fdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:15.380191 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 166/338] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:15.798382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62160a88-b5f6-478b-9784-cb0cdfbb1af6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:15.860439 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:15.930522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3612544-c7a8-46fa-b12a-840e8455fdc2 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:15.967598 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62160a88-b5f6-478b-9784-cb0cdfbb1af6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:16.052819 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0376fa-8200-431c-ae5c-df405062b74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:16.053831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0376fa-8200-431c-ae5c-df405062b74f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:16.054255 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0376fa-8200-431c-ae5c-df405062b74f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:16.054720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0376fa-8200-431c-ae5c-df405062b74f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:16.067694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0376fa-8200-431c-ae5c-df405062b74f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-4e0376fa-8200-431c-ae5c-df405062b74f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:16.073083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:16.074092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:16.074916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:16.074916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:16.074916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:16.074916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:16.074916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:16.074916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:16.074916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:16.074916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:16.074916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:16.074916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:16.074916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 15 19:04:16.074916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:16.077406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 173/339] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:16.079014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ae511-01aa-4eb3-88c2-0bb51fcccdd8 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:16.079506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ae511-01aa-4eb3-88c2-0bb51fcccdd8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:16.079975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1ae511-01aa-4eb3-88c2-0bb51fcccdd8 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:16.081553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 174/340] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:16.085891 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:16.087432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d693c-6ea0-4c83-9506-97191e149b67 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:16.087920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d693c-6ea0-4c83-9506-97191e149b67 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:16.088410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8d693c-6ea0-4c83-9506-97191e149b67 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:16.089714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3612544-c7a8-46fa-b12a-840e8455fdc2 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:16.090446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 175/341] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:16.091345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d693c-6ea0-4c83-9506-97191e149b67 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:16.140216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b13d081-0003-43de-8e59-3b9fa916f78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:16.140887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13d081-0003-43de-8e59-3b9fa916f78e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:16.141284 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13d081-0003-43de-8e59-3b9fa916f78e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:16.141390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b13d081-0003-43de-8e59-3b9fa916f78e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:16.153324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b13d081-0003-43de-8e59-3b9fa916f78e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-3b13d081-0003-43de-8e59-3b9fa916f78e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:16.158662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:16.159552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:16.160741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:16.160741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:16.160741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:16.160741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:16.160741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:16.160741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:16.160741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:16.160741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:16.160741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:16.160741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:16.160741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:16.160741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:16.160741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 167/342] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:16.161979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50077d-8d16-46c5-ac47-8500020ca36e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:16.162848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50077d-8d16-46c5-ac47-8500020ca36e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:16.163261 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a50077d-8d16-46c5-ac47-8500020ca36e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:16.183547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0a50077d-8d16-46c5-ac47-8500020ca36e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:16.185013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0a50077d-8d16-46c5-ac47-8500020ca36e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:16.217124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8d693c-6ea0-4c83-9506-97191e149b67 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:16.218840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:16.257370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb99965-a472-4e33-920f-fcaad195b028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:16.258275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb99965-a472-4e33-920f-fcaad195b028 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:16.258715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb99965-a472-4e33-920f-fcaad195b028 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:16.259140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb99965-a472-4e33-920f-fcaad195b028 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:16.260434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb99965-a472-4e33-920f-fcaad195b028 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:16.261028 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb99965-a472-4e33-920f-fcaad195b028 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:16.263376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb99965-a472-4e33-920f-fcaad195b028 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:16.265825 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 168/343] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:16.267536 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46bcfa-e495-4035-b3bc-7b5388dc9ad3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:16.268022 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46bcfa-e495-4035-b3bc-7b5388dc9ad3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:16.268496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad46bcfa-e495-4035-b3bc-7b5388dc9ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:16.275024 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 176/344] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:16.276614 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb99965-a472-4e33-920f-fcaad195b028 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:16.294321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ad46bcfa-e495-4035-b3bc-7b5388dc9ad3 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:16.296372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ad46bcfa-e495-4035-b3bc-7b5388dc9ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:16.378362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 169/345] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:16.379670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46bcfa-e495-4035-b3bc-7b5388dc9ad3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:16.407581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:16.408804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb99965-a472-4e33-920f-fcaad195b028 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:16.450054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589efbda-10e9-4531-896d-623761c987ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:16.450955 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589efbda-10e9-4531-896d-623761c987ba None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:16.451373 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589efbda-10e9-4531-896d-623761c987ba None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:16.451809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589efbda-10e9-4531-896d-623761c987ba None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:16.452628 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589efbda-10e9-4531-896d-623761c987ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:16.453079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589efbda-10e9-4531-896d-623761c987ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:16.454645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589efbda-10e9-4531-896d-623761c987ba None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:16.466166 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 177/346] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:16.472700 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589efbda-10e9-4531-896d-623761c987ba None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:16.496791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad46bcfa-e495-4035-b3bc-7b5388dc9ad3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:16.508918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:16.543594 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8936-6d62-4d26-8dbc-d7395f1f6adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:16.544706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8936-6d62-4d26-8dbc-d7395f1f6adc None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:16.545182 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8936-6d62-4d26-8dbc-d7395f1f6adc None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:16.545659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a8936-6d62-4d26-8dbc-d7395f1f6adc None admin] PATH_INFO: `/v3/users/a87dc0e7c3e243d7803c085aea0f3483` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:16.547341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a8936-6d62-4d26-8dbc-d7395f1f6adc None admin] RBAC: Authorizing `identity:get_user(user_id=a87dc0e7c3e243d7803c085aea0f3483)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:16.549040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0a8936-6d62-4d26-8dbc-d7395f1f6adc None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:16.551414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 170/347] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:04:16 2022] GET /identity/v3/users/a87dc0e7c3e243d7803c085aea0f3483 => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:16.557171 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8936-6d62-4d26-8dbc-d7395f1f6adc None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:16.595586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589efbda-10e9-4531-896d-623761c987ba None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:16.635199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b943bf8-0b38-4222-9d83-261c12a336ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:16.636064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b943bf8-0b38-4222-9d83-261c12a336ac None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:16.636492 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b943bf8-0b38-4222-9d83-261c12a336ac None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:16.636895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b943bf8-0b38-4222-9d83-261c12a336ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:16.722680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b943bf8-0b38-4222-9d83-261c12a336ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:16.725008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b943bf8-0b38-4222-9d83-261c12a336ac None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:16.736372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:16.760425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:16.775706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a8936-6d62-4d26-8dbc-d7395f1f6adc None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:16.835369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae46be-326b-4254-8f30-98d81b79ecc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:16.836339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae46be-326b-4254-8f30-98d81b79ecc6 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:16.836760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae46be-326b-4254-8f30-98d81b79ecc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:16.837172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ae46be-326b-4254-8f30-98d81b79ecc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:16.838078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae46be-326b-4254-8f30-98d81b79ecc6 None admin] RBAC: Adding query filter params (role.id=b4a71464f9e64fa2bf52e7cbdec257c8, user.id=a87dc0e7c3e243d7803c085aea0f3483, scope.system=all) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:16.838553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae46be-326b-4254-8f30-98d81b79ecc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:16.840149 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ae46be-326b-4254-8f30-98d81b79ecc6 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:16.845506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 178/348] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:16.847557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8ee0b-ad30-4608-a336-39ae43c4c126 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:16.848010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8ee0b-ad30-4608-a336-39ae43c4c126 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:16.848419 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc8ee0b-ad30-4608-a336-39ae43c4c126 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:16.850038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 179/349] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:16.851203 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8ee0b-ad30-4608-a336-39ae43c4c126 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:16.858351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 171/350] 10.222.0.25 () {56 vars in 1308 bytes} [Thu Sep 15 19:04:16 2022] GET /identity/v3/role_assignments?user.id=a87dc0e7c3e243d7803c085aea0f3483&scope.system=all&role.id=b4a71464f9e64fa2bf52e7cbdec257c8 => generated 510 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:16.859248 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae46be-326b-4254-8f30-98d81b79ecc6 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:16.969377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc8ee0b-ad30-4608-a336-39ae43c4c126 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:17.006323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:17.008256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ae46be-326b-4254-8f30-98d81b79ecc6 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:17.014691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa681c84-ebd3-4c60-b2de-1ad7e013e6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:17.015634 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa681c84-ebd3-4c60-b2de-1ad7e013e6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:17.016161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa681c84-ebd3-4c60-b2de-1ad7e013e6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:17.016595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa681c84-ebd3-4c60-b2de-1ad7e013e6c3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:17.030641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa681c84-ebd3-4c60-b2de-1ad7e013e6c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-aa681c84-ebd3-4c60-b2de-1ad7e013e6c3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:17.036362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:17.037370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:17.038567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:17.038567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:17.038567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:17.038567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:17.038567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:17.038567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:17.038567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:17.038567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:17.038567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:17.038567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:17.038567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:17.038567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:17.041087 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 180/351] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:04:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:17.042944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bb2a5-65c6-4d1d-bc66-ce4e28b194c7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:17.043474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bb2a5-65c6-4d1d-bc66-ce4e28b194c7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:17.043945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387bb2a5-65c6-4d1d-bc66-ce4e28b194c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:17.047810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac2d8c-352e-41c6-8989-4ecfd8536b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:17.048471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac2d8c-352e-41c6-8989-4ecfd8536b40 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:17.048751 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac2d8c-352e-41c6-8989-4ecfd8536b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:17.049024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffac2d8c-352e-41c6-8989-4ecfd8536b40 None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:17.050229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac2d8c-352e-41c6-8989-4ecfd8536b40 None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:17.051712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffac2d8c-352e-41c6-8989-4ecfd8536b40 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:17.053959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 172/352] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:16 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:17.054843 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac2d8c-352e-41c6-8989-4ecfd8536b40 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:17.067368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-387bb2a5-65c6-4d1d-bc66-ce4e28b194c7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:17.069168 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-387bb2a5-65c6-4d1d-bc66-ce4e28b194c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:17.072565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:17.148215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 181/353] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:17.149445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bb2a5-65c6-4d1d-bc66-ce4e28b194c7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:17.176379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffac2d8c-352e-41c6-8989-4ecfd8536b40 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:17.229999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa741444-8cac-4be7-b79c-4646d449e169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:17.230727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa741444-8cac-4be7-b79c-4646d449e169 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:17.231238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa741444-8cac-4be7-b79c-4646d449e169 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:17.231715 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa741444-8cac-4be7-b79c-4646d449e169 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:17.251998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa741444-8cac-4be7-b79c-4646d449e169 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-fa741444-8cac-4be7-b79c-4646d449e169 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:17.262649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:17.264315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:17.265769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:17.265769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:17.265769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:17.265769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:17.265769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:17.265769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:17.265769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:17.265769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:17.265769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:17.265769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:17.265769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:17.265769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:17.273452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 173/354] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:17.275435 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa741444-8cac-4be7-b79c-4646d449e169 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:17.286704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387bb2a5-65c6-4d1d-bc66-ce4e28b194c7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:17.313755 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:17.336047 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263035-53c8-42e4-a099-e29dced13193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:17.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263035-53c8-42e4-a099-e29dced13193 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:17.337450 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263035-53c8-42e4-a099-e29dced13193 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:17.337996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff263035-53c8-42e4-a099-e29dced13193 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:17.338667 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263035-53c8-42e4-a099-e29dced13193 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:17.339141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263035-53c8-42e4-a099-e29dced13193 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:17.340546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff263035-53c8-42e4-a099-e29dced13193 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:17.350674 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 182/355] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:17.356490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263035-53c8-42e4-a099-e29dced13193 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:17.417908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:17.463982 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa741444-8cac-4be7-b79c-4646d449e169 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:17.512987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff263035-53c8-42e4-a099-e29dced13193 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:17.513176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd62a1a-14dc-4ab8-9634-0d05640ce8a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:17.513865 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62a1a-14dc-4ab8-9634-0d05640ce8a2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:17.514146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62a1a-14dc-4ab8-9634-0d05640ce8a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:17.514408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd62a1a-14dc-4ab8-9634-0d05640ce8a2 None admin] PATH_INFO: `/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:17.523079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd62a1a-14dc-4ab8-9634-0d05640ce8a2 None admin] RBAC: Authorizing `identity:get_group(group_id=16a58725c17b4b3fb3a20dbf02af0c52)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:17.525001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd62a1a-14dc-4ab8-9634-0d05640ce8a2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:17.527154 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 174/356] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:17 2022] GET /identity/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52 => generated 226 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:17.528559 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd62a1a-14dc-4ab8-9634-0d05640ce8a2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:17.559429 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a8d16-3279-4e8f-9f16-65d6c9981380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:17.560323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a8d16-3279-4e8f-9f16-65d6c9981380 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:17.560633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a8d16-3279-4e8f-9f16-65d6c9981380 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:17.560905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a8d16-3279-4e8f-9f16-65d6c9981380 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:17.561579 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a8d16-3279-4e8f-9f16-65d6c9981380 None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:17.561910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a8d16-3279-4e8f-9f16-65d6c9981380 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:17.563288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948a8d16-3279-4e8f-9f16-65d6c9981380 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:17.572615 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 183/357] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:17 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:17.574239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a8d16-3279-4e8f-9f16-65d6c9981380 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:17.643210 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:17.655227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd62a1a-14dc-4ab8-9634-0d05640ce8a2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:17.713503 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63367246-8220-491d-8c70-f39e9f17f464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:17.714171 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63367246-8220-491d-8c70-f39e9f17f464 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:17.714442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63367246-8220-491d-8c70-f39e9f17f464 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:17.714702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63367246-8220-491d-8c70-f39e9f17f464 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:17.719809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:17.720417 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a8d16-3279-4e8f-9f16-65d6c9981380 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:17.765229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991acb9f-f6e5-4ac8-9ec8-0d71ca2de8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:17.765848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991acb9f-f6e5-4ac8-9ec8-0d71ca2de8ae None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:17.766137 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991acb9f-f6e5-4ac8-9ec8-0d71ca2de8ae None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:17.766412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-991acb9f-f6e5-4ac8-9ec8-0d71ca2de8ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:17.782322 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-991acb9f-f6e5-4ac8-9ec8-0d71ca2de8ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-991acb9f-f6e5-4ac8-9ec8-0d71ca2de8ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:17.789736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:17.790766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:17.791540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:17.791540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:17.791540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:17.791540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:17.791540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:17.791540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:17.791540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:17.791540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:17.791540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:17.791540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:17.791540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:17.791540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:17.794863 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 184/358] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:04:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:17.794863 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991acb9f-f6e5-4ac8-9ec8-0d71ca2de8ae None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:17.824497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63367246-8220-491d-8c70-f39e9f17f464 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:17.825987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63367246-8220-491d-8c70-f39e9f17f464 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:17.929596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:17.933546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-991acb9f-f6e5-4ac8-9ec8-0d71ca2de8ae None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:17.949502 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 175/359] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:17.950549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63367246-8220-491d-8c70-f39e9f17f464 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:17.988507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab907a8-6b1a-4329-ab7a-47fc070c9af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:17.989109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab907a8-6b1a-4329-ab7a-47fc070c9af4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:17.989391 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab907a8-6b1a-4329-ab7a-47fc070c9af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:17.989659 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab907a8-6b1a-4329-ab7a-47fc070c9af4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:17.990605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab907a8-6b1a-4329-ab7a-47fc070c9af4 None admin] RBAC: Adding query filter params (group.id=16a58725c17b4b3fb3a20dbf02af0c52, role.id=1e24ea020d1a46989b4f460308a32229, scope.project.id=23a9c71b85984efe850d28405efb5998) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:17.990917 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab907a8-6b1a-4329-ab7a-47fc070c9af4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:17.992423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab907a8-6b1a-4329-ab7a-47fc070c9af4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:17.999518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:17.999967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 185/360] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 19:04:17 2022] GET /identity/v3/role_assignments?group.id=16a58725c17b4b3fb3a20dbf02af0c52&scope.project.id=23a9c71b85984efe850d28405efb5998&role.id=1e24ea020d1a46989b4f460308a32229 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:18.000708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab907a8-6b1a-4329-ab7a-47fc070c9af4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:18.096554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63367246-8220-491d-8c70-f39e9f17f464 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:18.147297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca2124-4272-4106-86c4-6bb665892a1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:18.148216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca2124-4272-4106-86c4-6bb665892a1d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:18.148496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca2124-4272-4106-86c4-6bb665892a1d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:18.148769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca2124-4272-4106-86c4-6bb665892a1d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:18.159287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab907a8-6b1a-4329-ab7a-47fc070c9af4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:18.207196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698a25f0-6630-44f1-9afc-11312527486f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:18.207838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a25f0-6630-44f1-9afc-11312527486f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:18.208181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a25f0-6630-44f1-9afc-11312527486f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:18.208459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698a25f0-6630-44f1-9afc-11312527486f None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:18.209221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a25f0-6630-44f1-9afc-11312527486f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:18.209523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a25f0-6630-44f1-9afc-11312527486f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:18.211217 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698a25f0-6630-44f1-9afc-11312527486f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:18.221915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 186/361] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:18.223676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46fa0a-d57d-4bf7-9a55-65904187f6d2 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:18.223964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46fa0a-d57d-4bf7-9a55-65904187f6d2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:18.224238 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df46fa0a-d57d-4bf7-9a55-65904187f6d2 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:18.226153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 187/362] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:18.227046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46fa0a-d57d-4bf7-9a55-65904187f6d2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:18.249306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca2124-4272-4106-86c4-6bb665892a1d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:18.250842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ca2124-4272-4106-86c4-6bb665892a1d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:18.269350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:18.301555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:18.383349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df46fa0a-d57d-4bf7-9a55-65904187f6d2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:18.404342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 176/363] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:18.410016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca2124-4272-4106-86c4-6bb665892a1d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:18.430877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa28a0-6ff6-429c-9ef0-b7baccb166a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:18.431543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa28a0-6ff6-429c-9ef0-b7baccb166a1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:18.431821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa28a0-6ff6-429c-9ef0-b7baccb166a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:18.432091 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa28a0-6ff6-429c-9ef0-b7baccb166a1 None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:18.433369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa28a0-6ff6-429c-9ef0-b7baccb166a1 None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:18.434944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa28a0-6ff6-429c-9ef0-b7baccb166a1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:18.436866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 188/364] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:18 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:18.439014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ffdbb-9177-469e-8138-306955e5f34a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:18.439304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ffdbb-9177-469e-8138-306955e5f34a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:18.439581 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085ffdbb-9177-469e-8138-306955e5f34a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:18.464743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-085ffdbb-9177-469e-8138-306955e5f34a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:18.466865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-085ffdbb-9177-469e-8138-306955e5f34a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:18.568797 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca2124-4272-4106-86c4-6bb665892a1d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:18.577935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 189/365] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:18.579268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ffdbb-9177-469e-8138-306955e5f34a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:18.610343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:18.612552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21068ba2-86e8-4043-be63-831a8a59b674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:18.613198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21068ba2-86e8-4043-be63-831a8a59b674 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:18.613479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21068ba2-86e8-4043-be63-831a8a59b674 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:18.613753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21068ba2-86e8-4043-be63-831a8a59b674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:18.646266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:18.691360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21068ba2-86e8-4043-be63-831a8a59b674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:18.692835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21068ba2-86e8-4043-be63-831a8a59b674 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:18.702908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085ffdbb-9177-469e-8138-306955e5f34a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:18.761941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88bc6e2-c3fe-4908-a3dc-4124e2407eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:18.762936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bc6e2-c3fe-4908-a3dc-4124e2407eeb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:18.763388 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bc6e2-c3fe-4908-a3dc-4124e2407eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:18.763829 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88bc6e2-c3fe-4908-a3dc-4124e2407eeb None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:18.765318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88bc6e2-c3fe-4908-a3dc-4124e2407eeb None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:18.767689 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88bc6e2-c3fe-4908-a3dc-4124e2407eeb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:18.769622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 190/366] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:18 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:18.770640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88bc6e2-c3fe-4908-a3dc-4124e2407eeb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:18.824830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 177/367] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:18.828521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21068ba2-86e8-4043-be63-831a8a59b674 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:18.878306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:18.896636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:18.915175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88bc6e2-c3fe-4908-a3dc-4124e2407eeb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:18.966365 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc11c-a893-4e9b-880b-349890211a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:18.967044 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc11c-a893-4e9b-880b-349890211a80 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:18.967319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc11c-a893-4e9b-880b-349890211a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:18.967461 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21068ba2-86e8-4043-be63-831a8a59b674 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:18.967604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ecc11c-a893-4e9b-880b-349890211a80 None admin] PATH_INFO: `/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:18.968804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecc11c-a893-4e9b-880b-349890211a80 None admin] RBAC: Authorizing `identity:get_group(group_id=16a58725c17b4b3fb3a20dbf02af0c52)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:18.970535 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ecc11c-a893-4e9b-880b-349890211a80 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:18.972623 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 191/368] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:18 2022] GET /identity/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52 => generated 226 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:18.973439 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc11c-a893-4e9b-880b-349890211a80 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:19.013714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a7c7f-6919-4aaf-b3e4-c6db20662920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:19.014846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7c7f-6919-4aaf-b3e4-c6db20662920 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:19.015243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7c7f-6919-4aaf-b3e4-c6db20662920 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:19.015528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a7c7f-6919-4aaf-b3e4-c6db20662920 None admin] PATH_INFO: `/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:19.017889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a7c7f-6919-4aaf-b3e4-c6db20662920 None admin] RBAC: Authorizing `identity:get_group(group_id=16a58725c17b4b3fb3a20dbf02af0c52)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:19.019410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1a7c7f-6919-4aaf-b3e4-c6db20662920 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:19.022097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 178/369] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:18 2022] GET /identity/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:19.024264 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a7c7f-6919-4aaf-b3e4-c6db20662920 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:19.117571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ecc11c-a893-4e9b-880b-349890211a80 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:19.157413 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a7c7f-6919-4aaf-b3e4-c6db20662920 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:19.160508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:19.173090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f03845-6aeb-4cbe-89e1-5ed6cf1ded94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:19.173452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f03845-6aeb-4cbe-89e1-5ed6cf1ded94 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:19.173724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f03845-6aeb-4cbe-89e1-5ed6cf1ded94 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:19.174035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f03845-6aeb-4cbe-89e1-5ed6cf1ded94 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:19.178051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f03845-6aeb-4cbe-89e1-5ed6cf1ded94 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:19.179051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25f03845-6aeb-4cbe-89e1-5ed6cf1ded94 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:19.180727 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 192/370] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:18 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:19.181484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f03845-6aeb-4cbe-89e1-5ed6cf1ded94 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:19.198234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5033791-8afc-42e5-a15e-da5819509232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:19.199185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5033791-8afc-42e5-a15e-da5819509232 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:19.199728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5033791-8afc-42e5-a15e-da5819509232 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:19.200169 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5033791-8afc-42e5-a15e-da5819509232 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:19.217877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:19.218396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5033791-8afc-42e5-a15e-da5819509232 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-d5033791-8afc-42e5-a15e-da5819509232 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:19.224218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:19.225119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:19.225912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:19.225912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:19.225912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:19.225912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:19.225912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:19.225912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:19.225912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:19.225912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:19.225912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:19.225912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:19.225912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:04:19.225912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:19.227931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 179/371] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:04:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:19.228891 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5033791-8afc-42e5-a15e-da5819509232 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:19.314945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f03845-6aeb-4cbe-89e1-5ed6cf1ded94 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:19.345163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5033791-8afc-42e5-a15e-da5819509232 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:19.359161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da659a18-8d7a-4994-88f4-c8598db1fa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:19.360119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da659a18-8d7a-4994-88f4-c8598db1fa85 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:19.360606 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da659a18-8d7a-4994-88f4-c8598db1fa85 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:19.361069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da659a18-8d7a-4994-88f4-c8598db1fa85 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:19.362042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da659a18-8d7a-4994-88f4-c8598db1fa85 None admin] RBAC: Adding query filter params (group.id=16a58725c17b4b3fb3a20dbf02af0c52, role.id=568edd5e60424ffaa076d1c402c72b19, scope.project.id=23a9c71b85984efe850d28405efb5998) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:19.362555 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da659a18-8d7a-4994-88f4-c8598db1fa85 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:19.364335 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da659a18-8d7a-4994-88f4-c8598db1fa85 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:19.371802 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 193/372] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 19:04:19 2022] GET /identity/v3/role_assignments?group.id=16a58725c17b4b3fb3a20dbf02af0c52&scope.project.id=23a9c71b85984efe850d28405efb5998&role.id=568edd5e60424ffaa076d1c402c72b19 => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:19.372911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da659a18-8d7a-4994-88f4-c8598db1fa85 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:19.389210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5fd48-8917-47a9-ad01-bf2791adad11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:19.389742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5fd48-8917-47a9-ad01-bf2791adad11 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:19.390039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5fd48-8917-47a9-ad01-bf2791adad11 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:19.390306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae5fd48-8917-47a9-ad01-bf2791adad11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:19.391156 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5fd48-8917-47a9-ad01-bf2791adad11 None admin] RBAC: Adding query filter params (group.id=16a58725c17b4b3fb3a20dbf02af0c52, role.id=1e24ea020d1a46989b4f460308a32229, scope.project.id=93aa5a059e0e48fcacea630bab923912) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:19.391344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5fd48-8917-47a9-ad01-bf2791adad11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:19.392854 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae5fd48-8917-47a9-ad01-bf2791adad11 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:19.399824 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 180/373] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 19:04:19 2022] GET /identity/v3/role_assignments?group.id=16a58725c17b4b3fb3a20dbf02af0c52&scope.project.id=93aa5a059e0e48fcacea630bab923912&role.id=1e24ea020d1a46989b4f460308a32229 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:19.400714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5fd48-8917-47a9-ad01-bf2791adad11 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:19.461553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:19.498215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:19.507454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da659a18-8d7a-4994-88f4-c8598db1fa85 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:19.549013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a88a01-5589-4903-9dd4-3872cd3024fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:19.549769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a88a01-5589-4903-9dd4-3872cd3024fe None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:19.550143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a88a01-5589-4903-9dd4-3872cd3024fe None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:19.550477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a88a01-5589-4903-9dd4-3872cd3024fe None admin] PATH_INFO: `/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:19.551985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a88a01-5589-4903-9dd4-3872cd3024fe None admin] RBAC: Authorizing `identity:get_group(group_id=16a58725c17b4b3fb3a20dbf02af0c52)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:19.554028 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a88a01-5589-4903-9dd4-3872cd3024fe None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:19.556059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 194/374] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:19 2022] GET /identity/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:19.562101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a88a01-5589-4903-9dd4-3872cd3024fe None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:19.628160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae5fd48-8917-47a9-ad01-bf2791adad11 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:19.693088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27794a4b-64dd-4807-a6d9-e35d7cbf4e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:19.694591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794a4b-64dd-4807-a6d9-e35d7cbf4e44 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:19.694873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794a4b-64dd-4807-a6d9-e35d7cbf4e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:19.695145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27794a4b-64dd-4807-a6d9-e35d7cbf4e44 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:19.695826 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27794a4b-64dd-4807-a6d9-e35d7cbf4e44 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:19.696131 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27794a4b-64dd-4807-a6d9-e35d7cbf4e44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:19.697528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27794a4b-64dd-4807-a6d9-e35d7cbf4e44 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:19.712512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a88a01-5589-4903-9dd4-3872cd3024fe None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:19.723925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 181/375] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:19.730822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27794a4b-64dd-4807-a6d9-e35d7cbf4e44 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:19.766461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7dd92-9b4d-4de0-b639-df183cf6b9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:19.767452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7dd92-9b4d-4de0-b639-df183cf6b9bf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:19.767954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7dd92-9b4d-4de0-b639-df183cf6b9bf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:19.768441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d7dd92-9b4d-4de0-b639-df183cf6b9bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:19.769370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7dd92-9b4d-4de0-b639-df183cf6b9bf None admin] RBAC: Adding query filter params (group.id=16a58725c17b4b3fb3a20dbf02af0c52, role.id=568edd5e60424ffaa076d1c402c72b19, scope.project.id=93aa5a059e0e48fcacea630bab923912) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:19.769903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7dd92-9b4d-4de0-b639-df183cf6b9bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:19.771925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d7dd92-9b4d-4de0-b639-df183cf6b9bf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:19.778898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 195/376] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 19:04:19 2022] GET /identity/v3/role_assignments?group.id=16a58725c17b4b3fb3a20dbf02af0c52&scope.project.id=93aa5a059e0e48fcacea630bab923912&role.id=568edd5e60424ffaa076d1c402c72b19 => generated 260 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:19.892507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:19.911081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27794a4b-64dd-4807-a6d9-e35d7cbf4e44 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:19.956727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c4f04-7503-4594-8135-70a720c7bac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:19.957363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4f04-7503-4594-8135-70a720c7bac1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:19.957736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4f04-7503-4594-8135-70a720c7bac1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:19.958103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7c4f04-7503-4594-8135-70a720c7bac1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:20.042537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c4f04-7503-4594-8135-70a720c7bac1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:20.044006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7c4f04-7503-4594-8135-70a720c7bac1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:20.142976 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:20.154675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 182/377] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:20.163002 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7dd92-9b4d-4de0-b639-df183cf6b9bf None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:20.198470 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:20.287541 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d7dd92-9b4d-4de0-b639-df183cf6b9bf None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:20.326632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b34575-9434-4b51-8a94-de6b06f01af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:20.327294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b34575-9434-4b51-8a94-de6b06f01af2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:20.327580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b34575-9434-4b51-8a94-de6b06f01af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:20.327851 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b34575-9434-4b51-8a94-de6b06f01af2 None admin] PATH_INFO: `/v3/projects/0bc762c67fb94d798d853612955d1b04` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:20.328995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b34575-9434-4b51-8a94-de6b06f01af2 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc762c67fb94d798d853612955d1b04)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:20.330481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b34575-9434-4b51-8a94-de6b06f01af2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:20.332147 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 196/378] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:20 2022] GET /identity/v3/projects/0bc762c67fb94d798d853612955d1b04 => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:20.338150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c4f04-7503-4594-8135-70a720c7bac1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:20.492124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7c4f04-7503-4594-8135-70a720c7bac1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:20.544636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15401dd4-3d6e-49f8-becf-3d94b511ab0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:20.545301 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15401dd4-3d6e-49f8-becf-3d94b511ab0f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:20.545576 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15401dd4-3d6e-49f8-becf-3d94b511ab0f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:20.545916 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15401dd4-3d6e-49f8-becf-3d94b511ab0f None admin] PATH_INFO: `/v3/groups/a96043e801094a8686b68ac3481d44bd` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:20.551709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15401dd4-3d6e-49f8-becf-3d94b511ab0f None admin] RBAC: Authorizing `identity:get_group(group_id=a96043e801094a8686b68ac3481d44bd)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:20.553673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15401dd4-3d6e-49f8-becf-3d94b511ab0f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:20.555531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 183/379] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:20 2022] GET /identity/v3/groups/a96043e801094a8686b68ac3481d44bd => generated 229 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:20.561288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b34575-9434-4b51-8a94-de6b06f01af2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:20.691451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:20.705627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b34575-9434-4b51-8a94-de6b06f01af2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:20.751539 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c75fd0-1fbb-4a9c-8dab-0ec974bd78a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:20.752184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c75fd0-1fbb-4a9c-8dab-0ec974bd78a0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:20.752466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c75fd0-1fbb-4a9c-8dab-0ec974bd78a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:20.752741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c75fd0-1fbb-4a9c-8dab-0ec974bd78a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:20.753493 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c75fd0-1fbb-4a9c-8dab-0ec974bd78a0 None admin] RBAC: Adding query filter params (group.id=a96043e801094a8686b68ac3481d44bd, role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=0bc762c67fb94d798d853612955d1b04) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:20.753821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c75fd0-1fbb-4a9c-8dab-0ec974bd78a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:20.755289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c75fd0-1fbb-4a9c-8dab-0ec974bd78a0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:20.763177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 197/380] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 19:04:20 2022] GET /identity/v3/role_assignments?group.id=a96043e801094a8686b68ac3481d44bd&scope.project.id=0bc762c67fb94d798d853612955d1b04&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 260 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:20.953024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7170c2-4f37-49bf-9976-02e3c86d7add None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:20.953200 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7170c2-4f37-49bf-9976-02e3c86d7add None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:20.953479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7170c2-4f37-49bf-9976-02e3c86d7add None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:20.954880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 184/381] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:20.960478 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9acd0c-afea-48d8-b06f-eacc3eef2176 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:20.960771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9acd0c-afea-48d8-b06f-eacc3eef2176 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:20.961038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9acd0c-afea-48d8-b06f-eacc3eef2176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:20.987058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5f9acd0c-afea-48d8-b06f-eacc3eef2176 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:20.988299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5f9acd0c-afea-48d8-b06f-eacc3eef2176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:21.080560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 198/382] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:21.481080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7170c2-4f37-49bf-9976-02e3c86d7add None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:21.548458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:21.617528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7170c2-4f37-49bf-9976-02e3c86d7add None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:21.660218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93b0f3-3d65-418b-9d5f-3022b5d6460e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:21.660862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93b0f3-3d65-418b-9d5f-3022b5d6460e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:21.661132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93b0f3-3d65-418b-9d5f-3022b5d6460e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:21.661395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93b0f3-3d65-418b-9d5f-3022b5d6460e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:21.680766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93b0f3-3d65-418b-9d5f-3022b5d6460e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-5a93b0f3-3d65-418b-9d5f-3022b5d6460e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:21.685626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:21.686537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:21.687318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:21.687318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:21.687318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:21.687318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:21.687318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:21.687318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:21.687318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:21.687318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:21.687318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:21.687318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:21.687318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:21.687318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:21.687318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 185/383] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:21.694465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9acd0c-afea-48d8-b06f-eacc3eef2176 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:21.816668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:21.841980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9acd0c-afea-48d8-b06f-eacc3eef2176 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:21.888249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6b4ee-9605-4e23-99d0-fa701500a0bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:21.888811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6b4ee-9605-4e23-99d0-fa701500a0bf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:21.889098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6b4ee-9605-4e23-99d0-fa701500a0bf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:21.889380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6b4ee-9605-4e23-99d0-fa701500a0bf None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:21.890116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6b4ee-9605-4e23-99d0-fa701500a0bf None admin] RBAC: Adding query filter params (name=member) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:21.890427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6b4ee-9605-4e23-99d0-fa701500a0bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:21.891860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a6b4ee-9605-4e23-99d0-fa701500a0bf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:21.909199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 199/384] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:21.914965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93b0f3-3d65-418b-9d5f-3022b5d6460e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:22.079765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93b0f3-3d65-418b-9d5f-3022b5d6460e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:22.097015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:22.122731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4eafe3-a9f3-4a43-9909-9fe15a46ab1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:22.123397 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eafe3-a9f3-4a43-9909-9fe15a46ab1f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:22.123670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eafe3-a9f3-4a43-9909-9fe15a46ab1f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:22.123935 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4eafe3-a9f3-4a43-9909-9fe15a46ab1f None admin] PATH_INFO: `/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:22.125082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4eafe3-a9f3-4a43-9909-9fe15a46ab1f None admin] RBAC: Authorizing `identity:get_group(group_id=16a58725c17b4b3fb3a20dbf02af0c52)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:22.126576 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4eafe3-a9f3-4a43-9909-9fe15a46ab1f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:22.128547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 186/385] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:21 2022] GET /identity/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52 => generated 226 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:22.134246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6b4ee-9605-4e23-99d0-fa701500a0bf None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:22.303841 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22071e-86bd-47de-8e84-81f1433989fc None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:22.304499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6b4ee-9605-4e23-99d0-fa701500a0bf None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:22.304746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22071e-86bd-47de-8e84-81f1433989fc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:22.305223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd22071e-86bd-47de-8e84-81f1433989fc None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:22.307193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 187/386] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:22.312862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa1b3f-7bb1-4b86-a38b-fb2ba786eef8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:22.313409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa1b3f-7bb1-4b86-a38b-fb2ba786eef8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:22.313931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efa1b3f-7bb1-4b86-a38b-fb2ba786eef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:22.344698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1efa1b3f-7bb1-4b86-a38b-fb2ba786eef8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:22.347615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1efa1b3f-7bb1-4b86-a38b-fb2ba786eef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:22.371070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffce72-903a-479c-b271-f2b888cb5744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:22.371737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffce72-903a-479c-b271-f2b888cb5744 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:22.372031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffce72-903a-479c-b271-f2b888cb5744 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:22.372309 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffce72-903a-479c-b271-f2b888cb5744 None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:22.373477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffce72-903a-479c-b271-f2b888cb5744 None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:22.374964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffce72-903a-479c-b271-f2b888cb5744 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:22.376953 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 200/387] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:22 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:22.381818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204fa4-4538-4b13-ab37-1789b60054aa None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:22.381818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204fa4-4538-4b13-ab37-1789b60054aa None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:22.381818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d204fa4-4538-4b13-ab37-1789b60054aa None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:22.384170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 201/388] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:22.385048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d204fa4-4538-4b13-ab37-1789b60054aa None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:22.405484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:22.443966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 188/389] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:04:22.451749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ed29b-6bc1-4828-b2c4-0ade255f0c8c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:22.452409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ed29b-6bc1-4828-b2c4-0ade255f0c8c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:22.452872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2ed29b-6bc1-4828-b2c4-0ade255f0c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:22.485248 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-eb2ed29b-6bc1-4828-b2c4-0ade255f0c8c None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:22.486949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-eb2ed29b-6bc1-4828-b2c4-0ade255f0c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:22.500315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d204fa4-4538-4b13-ab37-1789b60054aa None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:22.535857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067d8c07-1126-4ab7-9cc3-4513090479dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:22.536800 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8c07-1126-4ab7-9cc3-4513090479dd None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:22.537324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8c07-1126-4ab7-9cc3-4513090479dd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:22.537968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067d8c07-1126-4ab7-9cc3-4513090479dd None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998/groups/16a58725c17b4b3fb3a20dbf02af0c52/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:22.540158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d8c07-1126-4ab7-9cc3-4513090479dd None admin] RBAC: Authorizing `identity:create_grant(project_id=23a9c71b85984efe850d28405efb5998, group_id=16a58725c17b4b3fb3a20dbf02af0c52, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:22.541772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067d8c07-1126-4ab7-9cc3-4513090479dd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:22.566295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 202/390] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 15 19:04:22 2022] PUT /identity/v3/projects/23a9c71b85984efe850d28405efb5998/groups/16a58725c17b4b3fb3a20dbf02af0c52/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:04:22.567956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e5bc7-c9b6-4b24-871c-1b18cf9a6958 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:22.568493 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e5bc7-c9b6-4b24-871c-1b18cf9a6958 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:22.568920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4e5bc7-c9b6-4b24-871c-1b18cf9a6958 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:22.570510 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 203/391] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:22.577393 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475cc41-be06-48e3-ab4a-dc8db0b8969f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:22.578046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475cc41-be06-48e3-ab4a-dc8db0b8969f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:22.578511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4475cc41-be06-48e3-ab4a-dc8db0b8969f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:22.619030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4475cc41-be06-48e3-ab4a-dc8db0b8969f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:22.621025 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4475cc41-be06-48e3-ab4a-dc8db0b8969f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:22.626216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 189/392] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:22.697983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 204/393] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:22.792830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ed29b-6bc1-4828-b2c4-0ade255f0c8c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:22.863944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:22.936503 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2ed29b-6bc1-4828-b2c4-0ade255f0c8c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:22.960864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475cc41-be06-48e3-ab4a-dc8db0b8969f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:22.973035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:22.979470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479f126-a5b0-47ff-afda-e1016b159c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:22.980410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f126-a5b0-47ff-afda-e1016b159c3c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:22.980883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f126-a5b0-47ff-afda-e1016b159c3c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:22.981474 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d479f126-a5b0-47ff-afda-e1016b159c3c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:23.002163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d479f126-a5b0-47ff-afda-e1016b159c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-d479f126-a5b0-47ff-afda-e1016b159c3c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:23.007743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:23.008650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:23.009434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:23.009434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:23.009434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:23.009434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:23.009434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:23.009434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:23.009434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:23.009434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:23.009434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:23.009434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:23.009434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:23.009434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:23.009434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 190/394] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:23.014738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479f126-a5b0-47ff-afda-e1016b159c3c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:23.104577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4475cc41-be06-48e3-ab4a-dc8db0b8969f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:23.141440 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d479f126-a5b0-47ff-afda-e1016b159c3c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:23.143870 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:23.147634 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642aad6-e0d1-4ede-b6f6-aaf20db1d941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:23.148345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642aad6-e0d1-4ede-b6f6-aaf20db1d941 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:23.148630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642aad6-e0d1-4ede-b6f6-aaf20db1d941 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:23.148902 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642aad6-e0d1-4ede-b6f6-aaf20db1d941 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:23.163667 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0642aad6-e0d1-4ede-b6f6-aaf20db1d941 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0642aad6-e0d1-4ede-b6f6-aaf20db1d941 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:23.169946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:23.170860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:23.171640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:23.171640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:23.171640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:23.171640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:23.171640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:23.171640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:23.171640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:23.171640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:23.171640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:23.171640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:23.171640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:23.171640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:23.174466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 205/395] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:04:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:23.175479 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642aad6-e0d1-4ede-b6f6-aaf20db1d941 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:23.188952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c58da-81b7-44a0-93c7-7b6224f486e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:23.189431 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c58da-81b7-44a0-93c7-7b6224f486e5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:23.189813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c58da-81b7-44a0-93c7-7b6224f486e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:23.190160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9c58da-81b7-44a0-93c7-7b6224f486e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:23.191019 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c58da-81b7-44a0-93c7-7b6224f486e5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:23.191434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c58da-81b7-44a0-93c7-7b6224f486e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:23.193034 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9c58da-81b7-44a0-93c7-7b6224f486e5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:23.203580 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 191/396] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:23.204780 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c58da-81b7-44a0-93c7-7b6224f486e5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:23.258342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:23.302596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0642aad6-e0d1-4ede-b6f6-aaf20db1d941 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:23.331680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9c58da-81b7-44a0-93c7-7b6224f486e5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:23.347033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad897f-ce68-4fec-a254-1e8d5167b245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:23.348451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad897f-ce68-4fec-a254-1e8d5167b245 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:23.349061 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad897f-ce68-4fec-a254-1e8d5167b245 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:23.349590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcad897f-ce68-4fec-a254-1e8d5167b245 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:23.363081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcad897f-ce68-4fec-a254-1e8d5167b245 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-bcad897f-ce68-4fec-a254-1e8d5167b245 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:23.369806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:23.370711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:23.371484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:23.371484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:23.371484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:23.371484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:23.371484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:23.371484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:23.371484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:23.371484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:23.371484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:23.371484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:23.371484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:23.371484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:23.375155 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ac701-f349-4d83-a3bc-2d0c6dee6ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:23.375155 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ac701-f349-4d83-a3bc-2d0c6dee6ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:23.375155 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ac701-f349-4d83-a3bc-2d0c6dee6ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:23.375436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ac701-f349-4d83-a3bc-2d0c6dee6ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:23.379801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ac701-f349-4d83-a3bc-2d0c6dee6ea0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:23.379801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ac701-f349-4d83-a3bc-2d0c6dee6ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:23.379801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ac701-f349-4d83-a3bc-2d0c6dee6ea0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:23.380216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 206/397] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:04:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:23.381925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad897f-ce68-4fec-a254-1e8d5167b245 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:23.388815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 192/398] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:23.389679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ac701-f349-4d83-a3bc-2d0c6dee6ea0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:23.431570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:23.512132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcad897f-ce68-4fec-a254-1e8d5167b245 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:23.522031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ac701-f349-4d83-a3bc-2d0c6dee6ea0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:23.542642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:23.552826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92974b77-209d-411d-86a5-045531c7eff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:23.553914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92974b77-209d-411d-86a5-045531c7eff1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:23.554590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92974b77-209d-411d-86a5-045531c7eff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:23.554922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92974b77-209d-411d-86a5-045531c7eff1 None admin] PATH_INFO: `/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:23.556445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92974b77-209d-411d-86a5-045531c7eff1 None admin] RBAC: Authorizing `identity:get_group(group_id=16a58725c17b4b3fb3a20dbf02af0c52)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:23.558017 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92974b77-209d-411d-86a5-045531c7eff1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:23.559831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 207/399] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:23 2022] GET /identity/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:23.560498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92974b77-209d-411d-86a5-045531c7eff1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:23.567094 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0473b36-08a9-468c-b363-569fd82db880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:23.567721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0473b36-08a9-468c-b363-569fd82db880 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:23.568001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0473b36-08a9-468c-b363-569fd82db880 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:23.568365 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0473b36-08a9-468c-b363-569fd82db880 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:23.569046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0473b36-08a9-468c-b363-569fd82db880 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:23.569350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0473b36-08a9-468c-b363-569fd82db880 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:23.570811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0473b36-08a9-468c-b363-569fd82db880 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:23.579846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 193/400] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:23.581052 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b09535-cb29-4f58-b634-159334d2cbf2 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:23.581398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b09535-cb29-4f58-b634-159334d2cbf2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:23.581679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b09535-cb29-4f58-b634-159334d2cbf2 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:23.583223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 194/401] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:23.584031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b09535-cb29-4f58-b634-159334d2cbf2 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:23.670504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92974b77-209d-411d-86a5-045531c7eff1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:23.682091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:23.695656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b09535-cb29-4f58-b634-159334d2cbf2 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:23.708467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e66c8-a8c0-4c8d-8f6c-d0825ea71b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:23.709214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e66c8-a8c0-4c8d-8f6c-d0825ea71b35 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:23.709487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e66c8-a8c0-4c8d-8f6c-d0825ea71b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:23.709757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30e66c8-a8c0-4c8d-8f6c-d0825ea71b35 None admin] PATH_INFO: `/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:23.710926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e66c8-a8c0-4c8d-8f6c-d0825ea71b35 None admin] RBAC: Authorizing `identity:get_group(group_id=16a58725c17b4b3fb3a20dbf02af0c52)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:23.712361 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30e66c8-a8c0-4c8d-8f6c-d0825ea71b35 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:23.718517 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 208/402] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:23 2022] GET /identity/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:23.718517 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e66c8-a8c0-4c8d-8f6c-d0825ea71b35 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:23.737286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170e4a9f-c315-4f89-b9e2-ce41f59012e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:23.737973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e4a9f-c315-4f89-b9e2-ce41f59012e0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:23.738251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e4a9f-c315-4f89-b9e2-ce41f59012e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:23.738519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170e4a9f-c315-4f89-b9e2-ce41f59012e0 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:23.739755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e4a9f-c315-4f89-b9e2-ce41f59012e0 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:23.741341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170e4a9f-c315-4f89-b9e2-ce41f59012e0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:23.748244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 195/403] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:23 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:23.748244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2ce63-3bad-4816-a7c6-74f2b2d54bd6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:23.748244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2ce63-3bad-4816-a7c6-74f2b2d54bd6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:23.748244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2ce63-3bad-4816-a7c6-74f2b2d54bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:23.768366 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-afb2ce63-3bad-4816-a7c6-74f2b2d54bd6 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:23.769547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-afb2ce63-3bad-4816-a7c6-74f2b2d54bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:23.797872 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:23.841977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 196/404] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:23.841977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2ce63-3bad-4816-a7c6-74f2b2d54bd6 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:23.851995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30e66c8-a8c0-4c8d-8f6c-d0825ea71b35 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:23.888234 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602049b6-36f0-4f27-a7a5-ea105f69bb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:23.888959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602049b6-36f0-4f27-a7a5-ea105f69bb5c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:23.889406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602049b6-36f0-4f27-a7a5-ea105f69bb5c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:23.889685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602049b6-36f0-4f27-a7a5-ea105f69bb5c None admin] PATH_INFO: `/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:23.891215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602049b6-36f0-4f27-a7a5-ea105f69bb5c None admin] RBAC: Authorizing `identity:get_group(group_id=16a58725c17b4b3fb3a20dbf02af0c52)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:23.892817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602049b6-36f0-4f27-a7a5-ea105f69bb5c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:23.895503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 209/405] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:23 2022] GET /identity/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:23.896083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602049b6-36f0-4f27-a7a5-ea105f69bb5c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:23.933443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:23.955277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2ce63-3bad-4816-a7c6-74f2b2d54bd6 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:23.993184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64483424-1fd6-4bef-87bb-3f5c233cb84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:23.994092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64483424-1fd6-4bef-87bb-3f5c233cb84b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:23.994533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64483424-1fd6-4bef-87bb-3f5c233cb84b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:23.994928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64483424-1fd6-4bef-87bb-3f5c233cb84b None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:23.996216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64483424-1fd6-4bef-87bb-3f5c233cb84b None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:23.997837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64483424-1fd6-4bef-87bb-3f5c233cb84b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:23.999964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 197/406] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:23 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:24.001004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64483424-1fd6-4bef-87bb-3f5c233cb84b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:24.029821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602049b6-36f0-4f27-a7a5-ea105f69bb5c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:24.063172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:24.071013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c36af5-87f4-4e65-8f42-4cb4ad8743a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:24.071891 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c36af5-87f4-4e65-8f42-4cb4ad8743a6 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:24.072421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c36af5-87f4-4e65-8f42-4cb4ad8743a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:24.072826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c36af5-87f4-4e65-8f42-4cb4ad8743a6 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912/groups/16a58725c17b4b3fb3a20dbf02af0c52/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:24.075056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c36af5-87f4-4e65-8f42-4cb4ad8743a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=93aa5a059e0e48fcacea630bab923912, group_id=16a58725c17b4b3fb3a20dbf02af0c52, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:24.076768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c36af5-87f4-4e65-8f42-4cb4ad8743a6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:24.094187 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 210/407] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 15 19:04:23 2022] PUT /identity/v3/projects/93aa5a059e0e48fcacea630bab923912/groups/16a58725c17b4b3fb3a20dbf02af0c52/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:04:24.095612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c36af5-87f4-4e65-8f42-4cb4ad8743a6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:24.115718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64483424-1fd6-4bef-87bb-3f5c233cb84b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:24.171264 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910cb42-c9b0-4441-92f6-cbc71a29ea88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:24.171923 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910cb42-c9b0-4441-92f6-cbc71a29ea88 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:24.172194 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910cb42-c9b0-4441-92f6-cbc71a29ea88 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:24.172467 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6910cb42-c9b0-4441-92f6-cbc71a29ea88 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:24.178854 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910cb42-c9b0-4441-92f6-cbc71a29ea88 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:24.180360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6910cb42-c9b0-4441-92f6-cbc71a29ea88 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:24.182544 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 198/408] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:24 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:24.186361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910cb42-c9b0-4441-92f6-cbc71a29ea88 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:24.221706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:24.227382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c36af5-87f4-4e65-8f42-4cb4ad8743a6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:24.276370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad043c4-5221-489d-891f-c687c4831b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:24.277463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad043c4-5221-489d-891f-c687c4831b78 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:24.278162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad043c4-5221-489d-891f-c687c4831b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:24.278740 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad043c4-5221-489d-891f-c687c4831b78 None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998/groups/16a58725c17b4b3fb3a20dbf02af0c52/roles/568edd5e60424ffaa076d1c402c72b19` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:24.281339 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad043c4-5221-489d-891f-c687c4831b78 None admin] RBAC: Authorizing `identity:create_grant(project_id=23a9c71b85984efe850d28405efb5998, group_id=16a58725c17b4b3fb3a20dbf02af0c52, role_id=568edd5e60424ffaa076d1c402c72b19)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:24.283461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad043c4-5221-489d-891f-c687c4831b78 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:24.306087 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 211/409] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 15 19:04:24 2022] PUT /identity/v3/projects/23a9c71b85984efe850d28405efb5998/groups/16a58725c17b4b3fb3a20dbf02af0c52/roles/568edd5e60424ffaa076d1c402c72b19 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:04:24.307301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad043c4-5221-489d-891f-c687c4831b78 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:24.321943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6910cb42-c9b0-4441-92f6-cbc71a29ea88 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:24.362440 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7a5ce-f6ad-44fe-94d6-95a68b18271b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:24.363104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7a5ce-f6ad-44fe-94d6-95a68b18271b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:24.363378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7a5ce-f6ad-44fe-94d6-95a68b18271b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:24.363645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b7a5ce-f6ad-44fe-94d6-95a68b18271b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:24.370886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:24.383183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b7a5ce-f6ad-44fe-94d6-95a68b18271b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-d6b7a5ce-f6ad-44fe-94d6-95a68b18271b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:24.384031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:24.384894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:24.386405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:24.386405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:24.386405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:24.386405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:24.386405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:24.386405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:24.386405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:24.386405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:24.386405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:24.386405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:24.386405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:04:24.386405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:24.386405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 199/410] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:04:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:24.391279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7a5ce-f6ad-44fe-94d6-95a68b18271b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:24.450152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad043c4-5221-489d-891f-c687c4831b78 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:24.493236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:24.496878 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e80ca-2513-42df-8921-9767d95031b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:24.498062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e80ca-2513-42df-8921-9767d95031b3 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:24.498567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e80ca-2513-42df-8921-9767d95031b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:24.499029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696e80ca-2513-42df-8921-9767d95031b3 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912/groups/16a58725c17b4b3fb3a20dbf02af0c52/roles/568edd5e60424ffaa076d1c402c72b19` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:24.502722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e80ca-2513-42df-8921-9767d95031b3 None admin] RBAC: Authorizing `identity:create_grant(project_id=93aa5a059e0e48fcacea630bab923912, group_id=16a58725c17b4b3fb3a20dbf02af0c52, role_id=568edd5e60424ffaa076d1c402c72b19)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:24.504538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696e80ca-2513-42df-8921-9767d95031b3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:24.516425 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b7a5ce-f6ad-44fe-94d6-95a68b18271b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:24.524042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 212/411] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 15 19:04:24 2022] PUT /identity/v3/projects/93aa5a059e0e48fcacea630bab923912/groups/16a58725c17b4b3fb3a20dbf02af0c52/roles/568edd5e60424ffaa076d1c402c72b19 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:04:24.564642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b550f-3432-47b8-ab61-4020d20fc0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:24.565306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b550f-3432-47b8-ab61-4020d20fc0ac None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:24.565581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b550f-3432-47b8-ab61-4020d20fc0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:24.565886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096b550f-3432-47b8-ab61-4020d20fc0ac None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:24.566579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b550f-3432-47b8-ab61-4020d20fc0ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:24.566880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b550f-3432-47b8-ab61-4020d20fc0ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:24.568484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096b550f-3432-47b8-ab61-4020d20fc0ac None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:24.578071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 200/412] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:24.583746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e80ca-2513-42df-8921-9767d95031b3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:24.702323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696e80ca-2513-42df-8921-9767d95031b3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:24.715043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:24.744067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9360ced-8345-4da3-8649-0d7ca5794ec8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:24.744729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360ced-8345-4da3-8649-0d7ca5794ec8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:24.745003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360ced-8345-4da3-8649-0d7ca5794ec8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:24.745268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9360ced-8345-4da3-8649-0d7ca5794ec8 None admin] PATH_INFO: `/v3/groups/a96043e801094a8686b68ac3481d44bd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:24.746481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9360ced-8345-4da3-8649-0d7ca5794ec8 None admin] RBAC: Authorizing `identity:get_group(group_id=a96043e801094a8686b68ac3481d44bd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:24.747938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9360ced-8345-4da3-8649-0d7ca5794ec8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:24.749903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 213/413] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:24 2022] GET /identity/v3/groups/a96043e801094a8686b68ac3481d44bd => generated 229 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:24.756850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b550f-3432-47b8-ab61-4020d20fc0ac None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:24.875446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096b550f-3432-47b8-ab61-4020d20fc0ac None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:24.913504 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e91a9-2c90-4aec-8b51-9e88cc5219c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:24.914230 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e91a9-2c90-4aec-8b51-9e88cc5219c8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:24.914506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e91a9-2c90-4aec-8b51-9e88cc5219c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:24.914773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e91a9-2c90-4aec-8b51-9e88cc5219c8 None admin] PATH_INFO: `/v3/projects/0bc762c67fb94d798d853612955d1b04` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:24.915915 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e91a9-2c90-4aec-8b51-9e88cc5219c8 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc762c67fb94d798d853612955d1b04)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:24.917369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011e91a9-2c90-4aec-8b51-9e88cc5219c8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:24.919336 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 201/414] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:24 2022] GET /identity/v3/projects/0bc762c67fb94d798d853612955d1b04 => generated 344 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:24.925220 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9360ced-8345-4da3-8649-0d7ca5794ec8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:25.035976 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9360ced-8345-4da3-8649-0d7ca5794ec8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:25.073368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10cc43-3aea-49b6-a1f6-cf84527235c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:25.074139 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10cc43-3aea-49b6-a1f6-cf84527235c6 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:25.074417 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10cc43-3aea-49b6-a1f6-cf84527235c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:25.074685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e10cc43-3aea-49b6-a1f6-cf84527235c6 None admin] PATH_INFO: `/v3/projects/0bc762c67fb94d798d853612955d1b04/groups/a96043e801094a8686b68ac3481d44bd/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:25.076648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10cc43-3aea-49b6-a1f6-cf84527235c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=0bc762c67fb94d798d853612955d1b04, group_id=a96043e801094a8686b68ac3481d44bd, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:25.079620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69cf18-892c-425d-a48a-d4bd3540d1d6 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:25.079899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69cf18-892c-425d-a48a-d4bd3540d1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:25.080165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69cf18-892c-425d-a48a-d4bd3540d1d6 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:25.081632 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 202/415] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:25.081754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e10cc43-3aea-49b6-a1f6-cf84527235c6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:25.087374 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2b814-ace4-43fd-9b54-f67394e26d10 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:25.087643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2b814-ace4-43fd-9b54-f67394e26d10 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:25.088133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab2b814-ace4-43fd-9b54-f67394e26d10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:25.119629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8ab2b814-ace4-43fd-9b54-f67394e26d10 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:25.121659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8ab2b814-ace4-43fd-9b54-f67394e26d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:25.123251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 214/416] 10.222.0.25 () {58 vars in 1442 bytes} [Thu Sep 15 19:04:24 2022] PUT /identity/v3/projects/0bc762c67fb94d798d853612955d1b04/groups/a96043e801094a8686b68ac3481d44bd/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:04:25.137759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:25.230021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 203/417] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:04:25.513947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10cc43-3aea-49b6-a1f6-cf84527235c6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:25.558537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:25.621852 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e10cc43-3aea-49b6-a1f6-cf84527235c6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:25.656557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4b790-9168-40eb-8c7a-00e0582c6720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:25.657195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4b790-9168-40eb-8c7a-00e0582c6720 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:25.657466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4b790-9168-40eb-8c7a-00e0582c6720 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:25.657849 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4b790-9168-40eb-8c7a-00e0582c6720 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:25.668725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4b790-9168-40eb-8c7a-00e0582c6720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-1bd4b790-9168-40eb-8c7a-00e0582c6720 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:25.673521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:25.674421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:25.675570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:25.675570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:25.675570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:25.675570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:25.675570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:25.675570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:25.675570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:25.675570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:25.675570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:25.675570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:25.675570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:25.675570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:25.675570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 215/418] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:25.681312 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2b814-ace4-43fd-9b54-f67394e26d10 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:25.812054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab2b814-ace4-43fd-9b54-f67394e26d10 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:25.864145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cdc2c-e2be-4673-b837-180829886ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:25.864766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cdc2c-e2be-4673-b837-180829886ecb None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:25.865507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cdc2c-e2be-4673-b837-180829886ecb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:25.865817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385cdc2c-e2be-4673-b837-180829886ecb None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:25.866623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cdc2c-e2be-4673-b837-180829886ecb None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:25.866927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cdc2c-e2be-4673-b837-180829886ecb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:25.868313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385cdc2c-e2be-4673-b837-180829886ecb None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:25.877011 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 204/419] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:25.882990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4b790-9168-40eb-8c7a-00e0582c6720 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:26.005534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:26.010476 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4b790-9168-40eb-8c7a-00e0582c6720 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:26.051152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a670c9d-f935-4938-8c76-e82ed1a01fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:26.051773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a670c9d-f935-4938-8c76-e82ed1a01fc8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:26.052048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a670c9d-f935-4938-8c76-e82ed1a01fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:26.052319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a670c9d-f935-4938-8c76-e82ed1a01fc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:26.145405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a670c9d-f935-4938-8c76-e82ed1a01fc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:26.147018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a670c9d-f935-4938-8c76-e82ed1a01fc8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:26.319493 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 216/420] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:26.320171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:26.338947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cdc2c-e2be-4673-b837-180829886ecb None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:26.359773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:26.572964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385cdc2c-e2be-4673-b837-180829886ecb None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:26.689887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed5a1af-70ed-43b9-abdf-bcca24d3b901 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:26.690543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5a1af-70ed-43b9-abdf-bcca24d3b901 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:26.690827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5a1af-70ed-43b9-abdf-bcca24d3b901 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:26.691084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed5a1af-70ed-43b9-abdf-bcca24d3b901 None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:26.694800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5a1af-70ed-43b9-abdf-bcca24d3b901 None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:26.696344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed5a1af-70ed-43b9-abdf-bcca24d3b901 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:26.698063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 205/421] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:26 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:26.706921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a670c9d-f935-4938-8c76-e82ed1a01fc8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:26.989584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a670c9d-f935-4938-8c76-e82ed1a01fc8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:27.038465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7608be-c15e-4f7e-b592-46152d05858b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:27.039174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7608be-c15e-4f7e-b592-46152d05858b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:27.039373 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7608be-c15e-4f7e-b592-46152d05858b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:27.039649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7608be-c15e-4f7e-b592-46152d05858b None admin] PATH_INFO: `/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:27.040657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49261836-358e-40cd-a4ac-d6509387b24f None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:27.041105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7608be-c15e-4f7e-b592-46152d05858b None admin] RBAC: Authorizing `identity:get_group(group_id=16a58725c17b4b3fb3a20dbf02af0c52)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:27.041574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49261836-358e-40cd-a4ac-d6509387b24f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:27.042057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49261836-358e-40cd-a4ac-d6509387b24f None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:27.042276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7608be-c15e-4f7e-b592-46152d05858b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:27.044012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 206/423] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:27.044115 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 217/423] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:26 2022] GET /identity/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52 => generated 226 bytes in 338 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:27.049268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0aeb48-7c44-49f3-8851-a5f7fdb734b6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:27.049550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0aeb48-7c44-49f3-8851-a5f7fdb734b6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:27.049849 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0aeb48-7c44-49f3-8851-a5f7fdb734b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:27.049950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49261836-358e-40cd-a4ac-d6509387b24f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:27.083019 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4c0aeb48-7c44-49f3-8851-a5f7fdb734b6 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:27.084679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4c0aeb48-7c44-49f3-8851-a5f7fdb734b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:27.141301 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:27.195188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:27.210288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49261836-358e-40cd-a4ac-d6509387b24f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:27.211888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 218/424] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:27.223679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474cd03-4a19-45c5-a374-fd4e899493cc None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:27.223957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474cd03-4a19-45c5-a374-fd4e899493cc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:27.224443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8474cd03-4a19-45c5-a374-fd4e899493cc None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:27.226020 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 219/425] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:27.232874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c06c3-45b2-4418-8f57-da49234a8f31 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:27.233473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c06c3-45b2-4418-8f57-da49234a8f31 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:27.233982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6c06c3-45b2-4418-8f57-da49234a8f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:27.253198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fe6c06c3-45b2-4418-8f57-da49234a8f31 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:27.254881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fe6c06c3-45b2-4418-8f57-da49234a8f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:27.292697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5851939-ede7-4e93-99ed-4862e4f629b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:27.294091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5851939-ede7-4e93-99ed-4862e4f629b8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:27.295099 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5851939-ede7-4e93-99ed-4862e4f629b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:27.296716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5851939-ede7-4e93-99ed-4862e4f629b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:27.297677 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5851939-ede7-4e93-99ed-4862e4f629b8 None admin] RBAC: Adding query filter params (group.id=16a58725c17b4b3fb3a20dbf02af0c52, role.id=1e24ea020d1a46989b4f460308a32229, scope.project.id=23a9c71b85984efe850d28405efb5998) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:27.298983 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5851939-ede7-4e93-99ed-4862e4f629b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:27.300706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5851939-ede7-4e93-99ed-4862e4f629b8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:27.315961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 207/426] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 19:04:27 2022] GET /identity/v3/role_assignments?group.id=16a58725c17b4b3fb3a20dbf02af0c52&scope.project.id=23a9c71b85984efe850d28405efb5998&role.id=1e24ea020d1a46989b4f460308a32229 => generated 611 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:27.356821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 220/427] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:04:27.376255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ba548-8669-4dbd-b24a-370606387d16 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:27.376810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ba548-8669-4dbd-b24a-370606387d16 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:27.377242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0ba548-8669-4dbd-b24a-370606387d16 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:27.378769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 208/428] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:27.384625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0ba45-a779-40e3-9ae8-1f26dbc1cc24 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:27.385111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0ba45-a779-40e3-9ae8-1f26dbc1cc24 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:27.385521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0ba45-a779-40e3-9ae8-1f26dbc1cc24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:27.410959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1be0ba45-a779-40e3-9ae8-1f26dbc1cc24 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:27.412467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1be0ba45-a779-40e3-9ae8-1f26dbc1cc24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:27.491080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ba548-8669-4dbd-b24a-370606387d16 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:27.512651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 221/429] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:27.610632 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0ba548-8669-4dbd-b24a-370606387d16 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:27.649870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0ba45-a779-40e3-9ae8-1f26dbc1cc24 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:27.662563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c832b50-8f7c-4533-80a9-1d5490bc02a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:27.663234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c832b50-8f7c-4533-80a9-1d5490bc02a1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:27.663513 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c832b50-8f7c-4533-80a9-1d5490bc02a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:27.663787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c832b50-8f7c-4533-80a9-1d5490bc02a1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:27.674178 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:27.685545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c832b50-8f7c-4533-80a9-1d5490bc02a1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-3c832b50-8f7c-4533-80a9-1d5490bc02a1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:27.693925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:27.694957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:27.695739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:27.695739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:27.695739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:27.695739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:27.695739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:27.695739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:27.695739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:27.695739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:27.695739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:27.695739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:27.695739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:27.695739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:27.695739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 209/430] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:04:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:27.700913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c832b50-8f7c-4533-80a9-1d5490bc02a1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:27.738489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:27.796495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0ba45-a779-40e3-9ae8-1f26dbc1cc24 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:27.841123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2be65-a49f-4794-b3bc-7d2b58056dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:27.841123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2be65-a49f-4794-b3bc-7d2b58056dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:27.841123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2be65-a49f-4794-b3bc-7d2b58056dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:27.841123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc2be65-a49f-4794-b3bc-7d2b58056dd0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:27.845010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c832b50-8f7c-4533-80a9-1d5490bc02a1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:27.858378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc2be65-a49f-4794-b3bc-7d2b58056dd0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8dc2be65-a49f-4794-b3bc-7d2b58056dd0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:27.863905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:27.864791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 222/431] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:27.868760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2be65-a49f-4794-b3bc-7d2b58056dd0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:27.894649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ba3dc-3a96-4387-b58c-f9011e61304c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:27.895548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba3dc-3a96-4387-b58c-f9011e61304c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:27.895880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba3dc-3a96-4387-b58c-f9011e61304c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:27.896423 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ba3dc-3a96-4387-b58c-f9011e61304c None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:27.896908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ba3dc-3a96-4387-b58c-f9011e61304c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:27.897647 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ba3dc-3a96-4387-b58c-f9011e61304c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:27.899154 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ba3dc-3a96-4387-b58c-f9011e61304c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:27.913918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 210/432] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:27.914870 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ba3dc-3a96-4387-b58c-f9011e61304c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:27.990134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:28.013307 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc2be65-a49f-4794-b3bc-7d2b58056dd0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:28.035294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:28.047341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ba3dc-3a96-4387-b58c-f9011e61304c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:28.061060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cb5b4-19c6-4b17-b4b4-149117d43d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:28.061685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cb5b4-19c6-4b17-b4b4-149117d43d35 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:28.061998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cb5b4-19c6-4b17-b4b4-149117d43d35 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:28.062266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7cb5b4-19c6-4b17-b4b4-149117d43d35 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:28.080816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7cb5b4-19c6-4b17-b4b4-149117d43d35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-da7cb5b4-19c6-4b17-b4b4-149117d43d35 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:28.086968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:28.087864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:28.088658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:28.088658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:28.088658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:28.088658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:28.088658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:28.088658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:28.088658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:28.088658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:28.088658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:28.088658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:28.088658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:28.088658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:28.088658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 223/433] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:04:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:28.089395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cb5b4-19c6-4b17-b4b4-149117d43d35 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:28.095875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66718ec0-70ee-424e-b664-8789aaaaac72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:28.096807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66718ec0-70ee-424e-b664-8789aaaaac72 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:28.097603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66718ec0-70ee-424e-b664-8789aaaaac72 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:28.098065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66718ec0-70ee-424e-b664-8789aaaaac72 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:28.098927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66718ec0-70ee-424e-b664-8789aaaaac72 None admin] RBAC: Adding query filter params (name=member) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:28.099443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66718ec0-70ee-424e-b664-8789aaaaac72 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:28.101762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66718ec0-70ee-424e-b664-8789aaaaac72 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:28.114360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 211/434] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:04:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:28.115509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66718ec0-70ee-424e-b664-8789aaaaac72 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:28.206121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7cb5b4-19c6-4b17-b4b4-149117d43d35 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:28.229213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66718ec0-70ee-424e-b664-8789aaaaac72 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:28.246784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12d3b6-2fb0-4f30-ab66-bd1a36fdbe96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:28.247825 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12d3b6-2fb0-4f30-ab66-bd1a36fdbe96 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:28.248098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12d3b6-2fb0-4f30-ab66-bd1a36fdbe96 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:28.248369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a12d3b6-2fb0-4f30-ab66-bd1a36fdbe96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:28.252975 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:28.271873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a269f9-d820-4598-aaff-d919471cfe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:28.272834 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a269f9-d820-4598-aaff-d919471cfe86 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:28.273150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a269f9-d820-4598-aaff-d919471cfe86 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:28.273427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a269f9-d820-4598-aaff-d919471cfe86 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:28.274207 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a269f9-d820-4598-aaff-d919471cfe86 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:28.274481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a269f9-d820-4598-aaff-d919471cfe86 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:28.275966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a269f9-d820-4598-aaff-d919471cfe86 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:28.292093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 212/435] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:28.292093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a269f9-d820-4598-aaff-d919471cfe86 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:28.319178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:28.345443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12d3b6-2fb0-4f30-ab66-bd1a36fdbe96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:28.346941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a12d3b6-2fb0-4f30-ab66-bd1a36fdbe96 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:28.396543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a269f9-d820-4598-aaff-d919471cfe86 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:28.434702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d0774f-81ad-4eda-a11c-8e3b0bd27d4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:28.435653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0774f-81ad-4eda-a11c-8e3b0bd27d4d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:28.435939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0774f-81ad-4eda-a11c-8e3b0bd27d4d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:28.436208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d0774f-81ad-4eda-a11c-8e3b0bd27d4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:28.448227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 224/436] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:28.449100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12d3b6-2fb0-4f30-ab66-bd1a36fdbe96 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:28.490737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:28.509693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0774f-81ad-4eda-a11c-8e3b0bd27d4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:28.511186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d0774f-81ad-4eda-a11c-8e3b0bd27d4d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:28.524587 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:28.547093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a12d3b6-2fb0-4f30-ab66-bd1a36fdbe96 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:28.582554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65647335-72ca-44dc-abfc-5e4126692c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:28.583097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65647335-72ca-44dc-abfc-5e4126692c6f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:28.583403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65647335-72ca-44dc-abfc-5e4126692c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:28.583699 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65647335-72ca-44dc-abfc-5e4126692c6f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:28.611303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 213/437] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:28.612994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5efe4-830d-417c-85a3-3137e81a68a3 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:28.613278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5efe4-830d-417c-85a3-3137e81a68a3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:28.613551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e5efe4-830d-417c-85a3-3137e81a68a3 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:28.614859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 214/438] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:28.615558 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5efe4-830d-417c-85a3-3137e81a68a3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:28.660322 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65647335-72ca-44dc-abfc-5e4126692c6f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:28.661880 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65647335-72ca-44dc-abfc-5e4126692c6f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:28.698760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:28.718029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e5efe4-830d-417c-85a3-3137e81a68a3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:28.739432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:28.751578 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32925-f4bc-4bec-a05c-ed0452f7f321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:28.752208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32925-f4bc-4bec-a05c-ed0452f7f321 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:28.752492 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32925-f4bc-4bec-a05c-ed0452f7f321 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:28.752764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c32925-f4bc-4bec-a05c-ed0452f7f321 None admin] PATH_INFO: `/v3/projects/23a9c71b85984efe850d28405efb5998` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:28.753907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c32925-f4bc-4bec-a05c-ed0452f7f321 None admin] RBAC: Authorizing `identity:get_project(project_id=23a9c71b85984efe850d28405efb5998)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:28.755361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c32925-f4bc-4bec-a05c-ed0452f7f321 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:28.761931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 215/439] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:28 2022] GET /identity/v3/projects/23a9c71b85984efe850d28405efb5998 => generated 298 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:28.761931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32925-f4bc-4bec-a05c-ed0452f7f321 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:28.763377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 225/440] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:28.764618 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dbadc-2af4-4f4f-a04b-20d59e8cda9e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:28.764897 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dbadc-2af4-4f4f-a04b-20d59e8cda9e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:28.765165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859dbadc-2af4-4f4f-a04b-20d59e8cda9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:28.782695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-859dbadc-2af4-4f4f-a04b-20d59e8cda9e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:28.783873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-859dbadc-2af4-4f4f-a04b-20d59e8cda9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:28.851617 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 226/441] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:28.852396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dbadc-2af4-4f4f-a04b-20d59e8cda9e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:28.883239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c32925-f4bc-4bec-a05c-ed0452f7f321 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:28.920675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15cdac-2eaa-47d0-be5e-09ada4ac6872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:28.921360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15cdac-2eaa-47d0-be5e-09ada4ac6872 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:28.921612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15cdac-2eaa-47d0-be5e-09ada4ac6872 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:28.921902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb15cdac-2eaa-47d0-be5e-09ada4ac6872 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:28.923111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15cdac-2eaa-47d0-be5e-09ada4ac6872 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:28.924567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb15cdac-2eaa-47d0-be5e-09ada4ac6872 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:28.930800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 216/442] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:28 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:28.930800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15cdac-2eaa-47d0-be5e-09ada4ac6872 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:28.948545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:28.959543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859dbadc-2af4-4f4f-a04b-20d59e8cda9e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:28.967625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:28.996886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c1d19-2c77-437d-9a29-11056dcd0436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:28.997527 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c1d19-2c77-437d-9a29-11056dcd0436 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:28.997818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c1d19-2c77-437d-9a29-11056dcd0436 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:28.998092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8c1d19-2c77-437d-9a29-11056dcd0436 None admin] PATH_INFO: `/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:28.999190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c1d19-2c77-437d-9a29-11056dcd0436 None admin] RBAC: Authorizing `identity:get_group(group_id=16a58725c17b4b3fb3a20dbf02af0c52)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:29.000653 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8c1d19-2c77-437d-9a29-11056dcd0436 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:29.002422 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 227/443] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:28 2022] GET /identity/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:29.003006 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c1d19-2c77-437d-9a29-11056dcd0436 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:29.039428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb15cdac-2eaa-47d0-be5e-09ada4ac6872 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:29.075233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319375b-faaf-4bea-b819-a043effd9825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:29.075877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319375b-faaf-4bea-b819-a043effd9825 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:29.076134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319375b-faaf-4bea-b819-a043effd9825 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:29.076402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c319375b-faaf-4bea-b819-a043effd9825 None admin] PATH_INFO: `/v3/projects/93aa5a059e0e48fcacea630bab923912` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:29.077520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319375b-faaf-4bea-b819-a043effd9825 None admin] RBAC: Authorizing `identity:get_project(project_id=93aa5a059e0e48fcacea630bab923912)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:29.078999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c319375b-faaf-4bea-b819-a043effd9825 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:29.081894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 217/444] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:28 2022] GET /identity/v3/projects/93aa5a059e0e48fcacea630bab923912 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:29.081894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319375b-faaf-4bea-b819-a043effd9825 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:29.113953 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8c1d19-2c77-437d-9a29-11056dcd0436 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:29.154197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226c8de-8492-4295-9431-a6acee4bba41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:29.155012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226c8de-8492-4295-9431-a6acee4bba41 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:29.155375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226c8de-8492-4295-9431-a6acee4bba41 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:29.155654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5226c8de-8492-4295-9431-a6acee4bba41 None admin] PATH_INFO: `/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:29.156771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226c8de-8492-4295-9431-a6acee4bba41 None admin] RBAC: Authorizing `identity:get_group(group_id=16a58725c17b4b3fb3a20dbf02af0c52)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:29.158237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5226c8de-8492-4295-9431-a6acee4bba41 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:29.160012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 228/445] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:29 2022] GET /identity/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:29.160563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226c8de-8492-4295-9431-a6acee4bba41 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:29.175088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:29.189831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c319375b-faaf-4bea-b819-a043effd9825 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:29.205341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:29.223274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f5150-0b81-43d5-af1a-dce8bf2109e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:29.223913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f5150-0b81-43d5-af1a-dce8bf2109e0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:29.224241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f5150-0b81-43d5-af1a-dce8bf2109e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:29.224520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8f5150-0b81-43d5-af1a-dce8bf2109e0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:29.225244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f5150-0b81-43d5-af1a-dce8bf2109e0 None admin] RBAC: Adding query filter params (group.id=16a58725c17b4b3fb3a20dbf02af0c52, role.id=568edd5e60424ffaa076d1c402c72b19, scope.project.id=23a9c71b85984efe850d28405efb5998) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:29.225555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f5150-0b81-43d5-af1a-dce8bf2109e0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:29.227053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8f5150-0b81-43d5-af1a-dce8bf2109e0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:29.232749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 218/446] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 19:04:29 2022] GET /identity/v3/role_assignments?group.id=16a58725c17b4b3fb3a20dbf02af0c52&scope.project.id=23a9c71b85984efe850d28405efb5998&role.id=568edd5e60424ffaa076d1c402c72b19 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:29.233549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f5150-0b81-43d5-af1a-dce8bf2109e0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:29.268283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5226c8de-8492-4295-9431-a6acee4bba41 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:29.312073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2376de3-f145-4873-92f6-e2d75e9aea98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:29.312791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2376de3-f145-4873-92f6-e2d75e9aea98 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:29.313009 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2376de3-f145-4873-92f6-e2d75e9aea98 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:29.313280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2376de3-f145-4873-92f6-e2d75e9aea98 None admin] PATH_INFO: `/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:29.314461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2376de3-f145-4873-92f6-e2d75e9aea98 None admin] RBAC: Authorizing `identity:get_group(group_id=16a58725c17b4b3fb3a20dbf02af0c52)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:29.316156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2376de3-f145-4873-92f6-e2d75e9aea98 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:29.317806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 229/447] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:29 2022] GET /identity/v3/groups/16a58725c17b4b3fb3a20dbf02af0c52 => generated 226 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:29.323929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2376de3-f145-4873-92f6-e2d75e9aea98 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:29.358261 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8f5150-0b81-43d5-af1a-dce8bf2109e0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:29.398162 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9685be-3ef6-4c24-9b2b-ad4dd01e13ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:29.398715 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9685be-3ef6-4c24-9b2b-ad4dd01e13ff None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:29.398993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9685be-3ef6-4c24-9b2b-ad4dd01e13ff None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:29.399263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9685be-3ef6-4c24-9b2b-ad4dd01e13ff None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:29.413400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9685be-3ef6-4c24-9b2b-ad4dd01e13ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-0e9685be-3ef6-4c24-9b2b-ad4dd01e13ff None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:29.419163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:29.420071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:29.420858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:29.420858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:29.420858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:29.420858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:29.420858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:29.420858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:29.420858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:29.420858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:29.420858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:29.420858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:29.420858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:04:29.420858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:29.420858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 219/448] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:04:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:29.422022 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9685be-3ef6-4c24-9b2b-ad4dd01e13ff None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:29.439492 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:29.439677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2376de3-f145-4873-92f6-e2d75e9aea98 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:29.451659 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:29.479829 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981946c7-739a-4623-b6d1-b49c99441d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:29.480458 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981946c7-739a-4623-b6d1-b49c99441d52 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:29.480739 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981946c7-739a-4623-b6d1-b49c99441d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:29.481011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981946c7-739a-4623-b6d1-b49c99441d52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:29.481749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981946c7-739a-4623-b6d1-b49c99441d52 None admin] RBAC: Adding query filter params (group.id=16a58725c17b4b3fb3a20dbf02af0c52, role.id=1e24ea020d1a46989b4f460308a32229, scope.project.id=93aa5a059e0e48fcacea630bab923912) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:29.482092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981946c7-739a-4623-b6d1-b49c99441d52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:29.483542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981946c7-739a-4623-b6d1-b49c99441d52 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:29.490569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 230/449] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 19:04:29 2022] GET /identity/v3/role_assignments?group.id=16a58725c17b4b3fb3a20dbf02af0c52&scope.project.id=93aa5a059e0e48fcacea630bab923912&role.id=1e24ea020d1a46989b4f460308a32229 => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:29.490569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981946c7-739a-4623-b6d1-b49c99441d52 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:29.551570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9685be-3ef6-4c24-9b2b-ad4dd01e13ff None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:29.603262 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab6bc-737b-4e1c-b489-80c56cf8d3a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:29.604058 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab6bc-737b-4e1c-b489-80c56cf8d3a5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:29.604334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab6bc-737b-4e1c-b489-80c56cf8d3a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:29.604602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ab6bc-737b-4e1c-b489-80c56cf8d3a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:29.605345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ab6bc-737b-4e1c-b489-80c56cf8d3a5 None admin] RBAC: Adding query filter params (group.id=16a58725c17b4b3fb3a20dbf02af0c52, role.id=568edd5e60424ffaa076d1c402c72b19, scope.project.id=93aa5a059e0e48fcacea630bab923912) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:29.605653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ab6bc-737b-4e1c-b489-80c56cf8d3a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:29.607284 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47ab6bc-737b-4e1c-b489-80c56cf8d3a5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:29.616826 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 220/450] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 19:04:29 2022] GET /identity/v3/role_assignments?group.id=16a58725c17b4b3fb3a20dbf02af0c52&scope.project.id=93aa5a059e0e48fcacea630bab923912&role.id=568edd5e60424ffaa076d1c402c72b19 => generated 611 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:29.640780 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981946c7-739a-4623-b6d1-b49c99441d52 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:29.690452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69150bfe-8aac-4749-a1ac-1a8441d47a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:29.691011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69150bfe-8aac-4749-a1ac-1a8441d47a8f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:29.691288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69150bfe-8aac-4749-a1ac-1a8441d47a8f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:29.691560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69150bfe-8aac-4749-a1ac-1a8441d47a8f None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:29.692254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69150bfe-8aac-4749-a1ac-1a8441d47a8f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:29.692562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69150bfe-8aac-4749-a1ac-1a8441d47a8f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:29.694287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69150bfe-8aac-4749-a1ac-1a8441d47a8f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:29.704255 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 231/451] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:29.710706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab6bc-737b-4e1c-b489-80c56cf8d3a5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:29.803666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:29.831629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ab6bc-737b-4e1c-b489-80c56cf8d3a5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:29.869565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38035693-75a2-4cdf-8b46-32b56e754732 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:29.870213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38035693-75a2-4cdf-8b46-32b56e754732 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:29.870496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38035693-75a2-4cdf-8b46-32b56e754732 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:29.870764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38035693-75a2-4cdf-8b46-32b56e754732 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:29.950367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38035693-75a2-4cdf-8b46-32b56e754732 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:29.951766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38035693-75a2-4cdf-8b46-32b56e754732 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:30.025517 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:30.052162 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 221/452] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:30.058056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69150bfe-8aac-4749-a1ac-1a8441d47a8f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:30.094779 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:30.158674 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69150bfe-8aac-4749-a1ac-1a8441d47a8f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:30.192881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab1f74-6c87-494f-96bb-486809a175a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:30.193709 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab1f74-6c87-494f-96bb-486809a175a8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:30.194009 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab1f74-6c87-494f-96bb-486809a175a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:30.194307 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ab1f74-6c87-494f-96bb-486809a175a8 None admin] PATH_INFO: `/v3/projects/0bc762c67fb94d798d853612955d1b04` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:30.195471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab1f74-6c87-494f-96bb-486809a175a8 None admin] RBAC: Authorizing `identity:get_project(project_id=0bc762c67fb94d798d853612955d1b04)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:30.196911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ab1f74-6c87-494f-96bb-486809a175a8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:30.198560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 232/453] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:04:30 2022] GET /identity/v3/projects/0bc762c67fb94d798d853612955d1b04 => generated 344 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:30.204400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38035693-75a2-4cdf-8b46-32b56e754732 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:30.305956 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38035693-75a2-4cdf-8b46-32b56e754732 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:30.340656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967be568-5c38-4268-a901-844d5ad7c2a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:30.341268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be568-5c38-4268-a901-844d5ad7c2a1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:30.341538 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be568-5c38-4268-a901-844d5ad7c2a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:30.341827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967be568-5c38-4268-a901-844d5ad7c2a1 None admin] PATH_INFO: `/v3/groups/a96043e801094a8686b68ac3481d44bd` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:30.342957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967be568-5c38-4268-a901-844d5ad7c2a1 None admin] RBAC: Authorizing `identity:get_group(group_id=a96043e801094a8686b68ac3481d44bd)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:30.344406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967be568-5c38-4268-a901-844d5ad7c2a1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:30.345992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 222/454] 10.222.0.25 () {56 vars in 1180 bytes} [Thu Sep 15 19:04:30 2022] GET /identity/v3/groups/a96043e801094a8686b68ac3481d44bd => generated 229 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:30.352537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab1f74-6c87-494f-96bb-486809a175a8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:30.464843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ab1f74-6c87-494f-96bb-486809a175a8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:30.467597 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:30.504650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63f16b8-6058-402c-ad40-3f64b3a76fab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:30.505266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f16b8-6058-402c-ad40-3f64b3a76fab None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:30.505574 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f16b8-6058-402c-ad40-3f64b3a76fab None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:30.505839 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63f16b8-6058-402c-ad40-3f64b3a76fab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:30.506595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f16b8-6058-402c-ad40-3f64b3a76fab None admin] RBAC: Adding query filter params (group.id=a96043e801094a8686b68ac3481d44bd, role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=0bc762c67fb94d798d853612955d1b04) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:30.506903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f16b8-6058-402c-ad40-3f64b3a76fab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:30.508369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63f16b8-6058-402c-ad40-3f64b3a76fab None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:30.514490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 233/455] 10.222.0.25 () {56 vars in 1376 bytes} [Thu Sep 15 19:04:30 2022] GET /identity/v3/role_assignments?group.id=a96043e801094a8686b68ac3481d44bd&scope.project.id=0bc762c67fb94d798d853612955d1b04&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 611 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:33.084507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdfaa9-e55a-421e-a476-8f7aa6e0283e None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:33.085085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdfaa9-e55a-421e-a476-8f7aa6e0283e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:33.085085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cdfaa9-e55a-421e-a476-8f7aa6e0283e None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:33.086672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 223/456] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:33.098957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4b7c-fb41-4eae-baf8-5be4e7ee85d1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:33.099575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4b7c-fb41-4eae-baf8-5be4e7ee85d1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:33.099575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05f4b7c-fb41-4eae-baf8-5be4e7ee85d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:33.135808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c05f4b7c-fb41-4eae-baf8-5be4e7ee85d1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:33.137055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c05f4b7c-fb41-4eae-baf8-5be4e7ee85d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:33.233527 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 234/457] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:04:33.248513 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6d663-4094-493c-9ed5-fcc7e661fc2c None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:33.248814 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6d663-4094-493c-9ed5-fcc7e661fc2c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:33.249059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6d663-4094-493c-9ed5-fcc7e661fc2c None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:33.250444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 224/458] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:33.256586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171d0fd-a565-48bd-be74-35fdde4e8185 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:33.256884 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171d0fd-a565-48bd-be74-35fdde4e8185 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:33.257159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b171d0fd-a565-48bd-be74-35fdde4e8185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:33.276351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b171d0fd-a565-48bd-be74-35fdde4e8185 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:33.277562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b171d0fd-a565-48bd-be74-35fdde4e8185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:33.366506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 235/459] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:33.564230 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6d663-4094-493c-9ed5-fcc7e661fc2c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:33.629643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:33.701169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171d0fd-a565-48bd-be74-35fdde4e8185 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:33.714998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6d663-4094-493c-9ed5-fcc7e661fc2c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:33.746753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:33.760206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a23f55f-5866-4b9a-8b60-4aadc9f0e4d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:33.760991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23f55f-5866-4b9a-8b60-4aadc9f0e4d1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:33.761366 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23f55f-5866-4b9a-8b60-4aadc9f0e4d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:33.761636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a23f55f-5866-4b9a-8b60-4aadc9f0e4d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:33.773894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23f55f-5866-4b9a-8b60-4aadc9f0e4d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:33.775418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a23f55f-5866-4b9a-8b60-4aadc9f0e4d1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-6a23f55f-5866-4b9a-8b60-4aadc9f0e4d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:33.794624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:33.795827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:33.796912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:33.796912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:33.796912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:33.798581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 225/460] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:33.805379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b72d8-1b4f-4d5a-baa6-847cf121f889 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:33.806255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b72d8-1b4f-4d5a-baa6-847cf121f889 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:33.806674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b72d8-1b4f-4d5a-baa6-847cf121f889 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:33.808573 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 226/461] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:33 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:33.809635 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b72d8-1b4f-4d5a-baa6-847cf121f889 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:33.834381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b171d0fd-a565-48bd-be74-35fdde4e8185 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:33.870757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e39b8f-6004-49f7-b0f8-144d3cb9622d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:33.871227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e39b8f-6004-49f7-b0f8-144d3cb9622d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:33.871504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e39b8f-6004-49f7-b0f8-144d3cb9622d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:33.871773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e39b8f-6004-49f7-b0f8-144d3cb9622d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:33.883750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e39b8f-6004-49f7-b0f8-144d3cb9622d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:33.885019 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e39b8f-6004-49f7-b0f8-144d3cb9622d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-49e39b8f-6004-49f7-b0f8-144d3cb9622d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:33.901148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:33.902313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:33.903193 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:33.903193 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:33.903193 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:33.903193 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 236/462] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:33.903925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa54d9-bf11-4fd8-8756-82cced477fab None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:33.904207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa54d9-bf11-4fd8-8756-82cced477fab None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:33.904476 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aa54d9-bf11-4fd8-8756-82cced477fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:33.923936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e5aa54d9-bf11-4fd8-8756-82cced477fab None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:33.925136 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e5aa54d9-bf11-4fd8-8756-82cced477fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:33.933678 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:33.943981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b72d8-1b4f-4d5a-baa6-847cf121f889 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:33.980787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac2af93-dad5-407f-be10-0fff7c865773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:33.981658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2af93-dad5-407f-be10-0fff7c865773 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:33.982174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2af93-dad5-407f-be10-0fff7c865773 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:33.982279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac2af93-dad5-407f-be10-0fff7c865773 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:33.982847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2af93-dad5-407f-be10-0fff7c865773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:33.983146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2af93-dad5-407f-be10-0fff7c865773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:33.984526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac2af93-dad5-407f-be10-0fff7c865773 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:34.000715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 237/463] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:34.001668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa54d9-bf11-4fd8-8756-82cced477fab None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:34.007496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 227/464] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:34.007496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0898-1e34-4e1d-9d22-8cfc14089901 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:34.007496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0898-1e34-4e1d-9d22-8cfc14089901 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:34.007496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de0898-1e34-4e1d-9d22-8cfc14089901 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:34.007496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 228/465] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:34 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:34.010734 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de0898-1e34-4e1d-9d22-8cfc14089901 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:34.020506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:34.116691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aa54d9-bf11-4fd8-8756-82cced477fab None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:34.152961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de0898-1e34-4e1d-9d22-8cfc14089901 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:34.154684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b702e29-1ddf-4e74-95ad-5cf7a292e275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:34.155484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b702e29-1ddf-4e74-95ad-5cf7a292e275 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:34.155906 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b702e29-1ddf-4e74-95ad-5cf7a292e275 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:34.156341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b702e29-1ddf-4e74-95ad-5cf7a292e275 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:34.157190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b702e29-1ddf-4e74-95ad-5cf7a292e275 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:34.157861 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b702e29-1ddf-4e74-95ad-5cf7a292e275 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:34.159438 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b702e29-1ddf-4e74-95ad-5cf7a292e275 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:34.172136 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 238/466] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:34.178611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837392ab-32e0-47be-a55f-fb4a24213f90 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:34.179105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837392ab-32e0-47be-a55f-fb4a24213f90 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:34.179569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837392ab-32e0-47be-a55f-fb4a24213f90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:34.194985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ceccef-1af1-4a37-8d81-1fec77865fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:34.195608 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ceccef-1af1-4a37-8d81-1fec77865fb3 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:34.195883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ceccef-1af1-4a37-8d81-1fec77865fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:34.196150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ceccef-1af1-4a37-8d81-1fec77865fb3 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:34.196800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ceccef-1af1-4a37-8d81-1fec77865fb3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:34.198389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ceccef-1af1-4a37-8d81-1fec77865fb3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:34.200130 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-837392ab-32e0-47be-a55f-fb4a24213f90 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:34.201622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-837392ab-32e0-47be-a55f-fb4a24213f90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:34.229872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 229/467] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:04:34 2022] POST /identity/v3/users => generated 246 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:04:34.231449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ceccef-1af1-4a37-8d81-1fec77865fb3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:34.258571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:34.324125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:34.331606 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 239/468] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:34.332972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837392ab-32e0-47be-a55f-fb4a24213f90 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:34.412032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ceccef-1af1-4a37-8d81-1fec77865fb3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:34.459179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34deecc-7c44-48ec-9465-1f2a8d05ded6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:34.459811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34deecc-7c44-48ec-9465-1f2a8d05ded6 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:34.460091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34deecc-7c44-48ec-9465-1f2a8d05ded6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:34.460362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34deecc-7c44-48ec-9465-1f2a8d05ded6 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:34.461027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34deecc-7c44-48ec-9465-1f2a8d05ded6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:34.462537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34deecc-7c44-48ec-9465-1f2a8d05ded6 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:34.499528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 230/469] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:04:34 2022] POST /identity/v3/users => generated 248 bytes in 269 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:04:34.510794 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837392ab-32e0-47be-a55f-fb4a24213f90 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:34.551828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee7806-a5dd-4833-8e67-9169fcf8f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:34.553288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee7806-a5dd-4833-8e67-9169fcf8f20c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:34.553751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee7806-a5dd-4833-8e67-9169fcf8f20c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:34.554214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee7806-a5dd-4833-8e67-9169fcf8f20c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:34.566329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee7806-a5dd-4833-8e67-9169fcf8f20c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:34.568174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aee7806-a5dd-4833-8e67-9169fcf8f20c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8aee7806-a5dd-4833-8e67-9169fcf8f20c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:34.585380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:34.586375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:34.587202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:34.587202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:34.587202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:34.589267 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 240/470] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:34.595181 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34deecc-7c44-48ec-9465-1f2a8d05ded6 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:34.671174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:34.713939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34deecc-7c44-48ec-9465-1f2a8d05ded6 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:34.717180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee7806-a5dd-4833-8e67-9169fcf8f20c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:34.772527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d862535-0bf6-44cf-8767-521daf31a853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:34.773955 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d862535-0bf6-44cf-8767-521daf31a853 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:34.774628 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d862535-0bf6-44cf-8767-521daf31a853 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:34.775260 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d862535-0bf6-44cf-8767-521daf31a853 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:34.776562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d862535-0bf6-44cf-8767-521daf31a853 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:34.777352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d862535-0bf6-44cf-8767-521daf31a853 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:34.779841 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d862535-0bf6-44cf-8767-521daf31a853 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:34.788846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:34.802651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 231/471] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:34.811833 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d862535-0bf6-44cf-8767-521daf31a853 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:34.852324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee7806-a5dd-4833-8e67-9169fcf8f20c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:34.890091 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fcbab-5078-4d4e-a55f-a0ead54dcc30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:34.890867 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fcbab-5078-4d4e-a55f-a0ead54dcc30 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:34.891243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fcbab-5078-4d4e-a55f-a0ead54dcc30 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:34.891613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2fcbab-5078-4d4e-a55f-a0ead54dcc30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:34.904512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fcbab-5078-4d4e-a55f-a0ead54dcc30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:34.906225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2fcbab-5078-4d4e-a55f-a0ead54dcc30 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8e2fcbab-5078-4d4e-a55f-a0ead54dcc30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:34.922265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:34.923414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:34.924311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:34.924311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:34.924311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:34.925903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 241/472] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:34.932510 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fcbab-5078-4d4e-a55f-a0ead54dcc30 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:34.944592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d862535-0bf6-44cf-8767-521daf31a853 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:34.979002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:34.994888 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea57ebd6-a523-49f6-88d7-fc41ed127c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:34.995507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57ebd6-a523-49f6-88d7-fc41ed127c5f None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:34.995779 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57ebd6-a523-49f6-88d7-fc41ed127c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:34.996045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea57ebd6-a523-49f6-88d7-fc41ed127c5f None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:34.997166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57ebd6-a523-49f6-88d7-fc41ed127c5f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:34.999056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea57ebd6-a523-49f6-88d7-fc41ed127c5f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:35.028813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 232/473] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:04:34 2022] POST /identity/v3/users => generated 248 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:04:35.030568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33726e51-c133-42cd-857a-37947015b4cf None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:35.031118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33726e51-c133-42cd-857a-37947015b4cf None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:35.031391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33726e51-c133-42cd-857a-37947015b4cf None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:35.033491 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 233/474] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:35.040696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a4bb2-39e4-43a6-89d7-5e028bdb9c69 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:35.041036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a4bb2-39e4-43a6-89d7-5e028bdb9c69 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:35.041240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50a4bb2-39e4-43a6-89d7-5e028bdb9c69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:35.056422 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2fcbab-5078-4d4e-a55f-a0ead54dcc30 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:35.063161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:35.064965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c50a4bb2-39e4-43a6-89d7-5e028bdb9c69 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:35.067441 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c50a4bb2-39e4-43a6-89d7-5e028bdb9c69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:35.126547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317d120-96b0-4295-8458-b47734223c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:35.127250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317d120-96b0-4295-8458-b47734223c4a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:35.127524 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317d120-96b0-4295-8458-b47734223c4a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:35.127793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317d120-96b0-4295-8458-b47734223c4a None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:35.128690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317d120-96b0-4295-8458-b47734223c4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:35.128997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317d120-96b0-4295-8458-b47734223c4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:35.130567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317d120-96b0-4295-8458-b47734223c4a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:35.152215 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 234/475] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:04:35.163014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 242/476] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:35.169215 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a4bb2-39e4-43a6-89d7-5e028bdb9c69 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:35.284562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50a4bb2-39e4-43a6-89d7-5e028bdb9c69 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:35.300700 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:35.331761 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda5c86-d3af-4f3c-bd70-0b4e6412d5c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:35.332413 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda5c86-d3af-4f3c-bd70-0b4e6412d5c6 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:35.332693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda5c86-d3af-4f3c-bd70-0b4e6412d5c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:35.332971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda5c86-d3af-4f3c-bd70-0b4e6412d5c6 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:35.333699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda5c86-d3af-4f3c-bd70-0b4e6412d5c6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:35.335382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fda5c86-d3af-4f3c-bd70-0b4e6412d5c6 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:35.378688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 235/477] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:04:35 2022] POST /identity/v3/users => generated 249 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:04:35.532368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317d120-96b0-4295-8458-b47734223c4a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:35.642794 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317d120-96b0-4295-8458-b47734223c4a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:35.679974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5bb6c-9061-4fd3-ac5e-0c323f6dd0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:35.680595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5bb6c-9061-4fd3-ac5e-0c323f6dd0e2 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:35.680871 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5bb6c-9061-4fd3-ac5e-0c323f6dd0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:35.681137 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b5bb6c-9061-4fd3-ac5e-0c323f6dd0e2 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:35.682909 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5bb6c-9061-4fd3-ac5e-0c323f6dd0e2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:35.683289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b5bb6c-9061-4fd3-ac5e-0c323f6dd0e2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:35.693016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.sql.core [None req-b0b5bb6c-9061-4fd3-ac5e-0c323f6dd0e2 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 19:04:35.693016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 19:04:35.693016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [parameters: {'id': '832e1f62d1994d68a7fcaab0856838a6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 19:04:35.693016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81626) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b0b5bb6c-9061-4fd3-ac5e-0c323f6dd0e2 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application conn.query(q) Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result.read() Sep 15 19:04:35.710253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return ref.to_dict() Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 19:04:35.711190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application next(self.gen) Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application yield resource Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application next(self.gen) Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise self.value Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application session.commit() Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 19:04:35.712100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.session.flush() Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application compat.raise_( Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 19:04:35.712924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 19:04:35.715338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application conn.query(q) Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application result.read() Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 19:04:35.720757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [parameters: {'id': '832e1f62d1994d68a7fcaab0856838a6', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:35.723026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 15 19:04:35.724599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:35.726637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 243/478] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 15 19:04:35 2022] POST /identity/v3/roles => generated 144 bytes in 180 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:35.726771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda5c86-d3af-4f3c-bd70-0b4e6412d5c6 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:35.838373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda5c86-d3af-4f3c-bd70-0b4e6412d5c6 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:35.877344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fc491b-fe49-499c-8f9d-ae9463cf6c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:35.878018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc491b-fe49-499c-8f9d-ae9463cf6c52 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:35.878350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc491b-fe49-499c-8f9d-ae9463cf6c52 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:35.878622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fc491b-fe49-499c-8f9d-ae9463cf6c52 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:35.889931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fc491b-fe49-499c-8f9d-ae9463cf6c52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-75fc491b-fe49-499c-8f9d-ae9463cf6c52 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:35.895416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:35.898013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:35.899908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:35.899908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:35.899908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:35.899908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:35.899908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:35.899908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:35.899908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:35.899908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:35.899908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:35.899908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:35.899908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 15 19:04:35.899908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:35.899908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 236/479] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:04:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:35.903950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5bb6c-9061-4fd3-ac5e-0c323f6dd0e2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:35.935705 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:36.014261 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b5bb6c-9061-4fd3-ac5e-0c323f6dd0e2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:36.055143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a9455c-31e7-4938-9604-030336fac27b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:36.055788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9455c-31e7-4938-9604-030336fac27b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:36.056059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9455c-31e7-4938-9604-030336fac27b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:36.056318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a9455c-31e7-4938-9604-030336fac27b None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:36.057048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9455c-31e7-4938-9604-030336fac27b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:36.057350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9455c-31e7-4938-9604-030336fac27b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:36.058755 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a9455c-31e7-4938-9604-030336fac27b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:36.072114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 244/480] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:37.018352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e934c-27ea-4a11-9afe-d00b1eb765f1 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:37.019065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e934c-27ea-4a11-9afe-d00b1eb765f1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:37.019065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e934c-27ea-4a11-9afe-d00b1eb765f1 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:37.020510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 237/481] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:37.026436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3ffb4-0187-4a6b-ad97-a6d4c7584b9d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:37.027003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3ffb4-0187-4a6b-ad97-a6d4c7584b9d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:37.027003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc3ffb4-0187-4a6b-ad97-a6d4c7584b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:37.045972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9cc3ffb4-0187-4a6b-ad97-a6d4c7584b9d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:37.047155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9cc3ffb4-0187-4a6b-ad97-a6d4c7584b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:37.122431 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 245/482] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:04:37.354002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e003b-3838-486f-9ab2-f79740d4002f None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:37.354334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e003b-3838-486f-9ab2-f79740d4002f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:37.354540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e003b-3838-486f-9ab2-f79740d4002f None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:37.356175 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 238/483] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:37.361266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba072e45-99d9-40e5-8166-9c6b0545ce89 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:37.361550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba072e45-99d9-40e5-8166-9c6b0545ce89 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:37.361865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba072e45-99d9-40e5-8166-9c6b0545ce89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:37.386341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ba072e45-99d9-40e5-8166-9c6b0545ce89 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:37.387527 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ba072e45-99d9-40e5-8166-9c6b0545ce89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:37.411207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:37.487557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 246/484] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:37.493097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e003b-3838-486f-9ab2-f79740d4002f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:37.534138 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:37.617358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e003b-3838-486f-9ab2-f79740d4002f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:37.664000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee12aea-fb66-4028-9c43-2321b531946a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:37.664706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee12aea-fb66-4028-9c43-2321b531946a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:37.664986 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee12aea-fb66-4028-9c43-2321b531946a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:37.665254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee12aea-fb66-4028-9c43-2321b531946a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:37.677542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee12aea-fb66-4028-9c43-2321b531946a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-6ee12aea-fb66-4028-9c43-2321b531946a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:37.682682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:37.683636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:37.684872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:37.684872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:37.684872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:37.684872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:37.684872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:37.684872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:37.684872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:37.684872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:37.684872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:37.684872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:37.684872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:37.684872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:37.684872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 239/485] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:37.690625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba072e45-99d9-40e5-8166-9c6b0545ce89 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:37.836551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee12aea-fb66-4028-9c43-2321b531946a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:37.843569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba072e45-99d9-40e5-8166-9c6b0545ce89 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:37.893272 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e686-1931-411c-82df-3b1c0b987304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:37.893461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e686-1931-411c-82df-3b1c0b987304 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:37.893714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e686-1931-411c-82df-3b1c0b987304 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:37.894012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a5e686-1931-411c-82df-3b1c0b987304 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:37.894684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e686-1931-411c-82df-3b1c0b987304 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:37.895112 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e686-1931-411c-82df-3b1c0b987304 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:37.896717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a5e686-1931-411c-82df-3b1c0b987304 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:37.921075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 247/486] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:37 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:37.926538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e686-1931-411c-82df-3b1c0b987304 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:37.957371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:37.996432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:38.009102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee12aea-fb66-4028-9c43-2321b531946a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:38.045194 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d3d77-e633-46c1-9a68-a5bb5f7740bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:38.045991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3d77-e633-46c1-9a68-a5bb5f7740bd None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:38.046179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3d77-e633-46c1-9a68-a5bb5f7740bd None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:38.046425 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8d3d77-e633-46c1-9a68-a5bb5f7740bd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:38.058535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8d3d77-e633-46c1-9a68-a5bb5f7740bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ad8d3d77-e633-46c1-9a68-a5bb5f7740bd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:38.063721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:38.064600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:38.065373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:38.065373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:38.065373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:38.065373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:38.065373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:38.065373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:38.065373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:38.065373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:38.065373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:38.065373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:38.065373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:38.065373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:38.065373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 240/487] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:37 2022] GET /identity/v3/roles/service => generated 85 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:38.072540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d3d77-e633-46c1-9a68-a5bb5f7740bd None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:38.156558 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a5e686-1931-411c-82df-3b1c0b987304 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:38.194960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449f96b-4d2f-4553-b9a0-9f8875107ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:38.195632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449f96b-4d2f-4553-b9a0-9f8875107ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:38.195911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449f96b-4d2f-4553-b9a0-9f8875107ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:38.196183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449f96b-4d2f-4553-b9a0-9f8875107ea9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:38.210271 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449f96b-4d2f-4553-b9a0-9f8875107ea9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:38.211752 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449f96b-4d2f-4553-b9a0-9f8875107ea9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:38.211856 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8d3d77-e633-46c1-9a68-a5bb5f7740bd None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-f449f96b-4d2f-4553-b9a0-9f8875107ea9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:38.229764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:38.230971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:38.232032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:38.232032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:38.232032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:38.232032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 248/488] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:38.235406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee113eb-f958-4100-82fd-ebd29a14c13e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:38.235406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee113eb-f958-4100-82fd-ebd29a14c13e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:38.235406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee113eb-f958-4100-82fd-ebd29a14c13e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:38.235406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 249/489] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:38.237264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee113eb-f958-4100-82fd-ebd29a14c13e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:38.255776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026edf4d-eaa1-4179-81c9-a18523288891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:38.256658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026edf4d-eaa1-4179-81c9-a18523288891 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:38.256939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026edf4d-eaa1-4179-81c9-a18523288891 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:38.257213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026edf4d-eaa1-4179-81c9-a18523288891 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:38.257937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026edf4d-eaa1-4179-81c9-a18523288891 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:38.258246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026edf4d-eaa1-4179-81c9-a18523288891 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:38.259653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026edf4d-eaa1-4179-81c9-a18523288891 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:38.268620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 241/490] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:38.269998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec1744-76a6-4325-b92b-e785a9c36752 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:38.270279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec1744-76a6-4325-b92b-e785a9c36752 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:38.270547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ec1744-76a6-4325-b92b-e785a9c36752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:38.291440 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-84ec1744-76a6-4325-b92b-e785a9c36752 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:38.292662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-84ec1744-76a6-4325-b92b-e785a9c36752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:38.300575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:38.315253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:38.360301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee113eb-f958-4100-82fd-ebd29a14c13e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:38.370283 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 242/491] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:38.371217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec1744-76a6-4325-b92b-e785a9c36752 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:38.405840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1516999c-005e-4371-a328-be8aca72342c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:38.406873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516999c-005e-4371-a328-be8aca72342c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:38.407338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516999c-005e-4371-a328-be8aca72342c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:38.407799 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1516999c-005e-4371-a328-be8aca72342c None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:38.408945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516999c-005e-4371-a328-be8aca72342c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:38.409434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516999c-005e-4371-a328-be8aca72342c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:38.411065 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1516999c-005e-4371-a328-be8aca72342c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:38.432032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 250/492] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:38.434001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85298e90-80c2-489e-a561-eaf0b9a1c4b1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:38.434503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85298e90-80c2-489e-a561-eaf0b9a1c4b1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:38.434958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85298e90-80c2-489e-a561-eaf0b9a1c4b1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:38.440724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 251/493] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:38.440724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85298e90-80c2-489e-a561-eaf0b9a1c4b1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:38.502651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ec1744-76a6-4325-b92b-e785a9c36752 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:38.551662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85298e90-80c2-489e-a561-eaf0b9a1c4b1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:38.554816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5fa1011-6809-47b0-ac28-df88d0f8e514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:38.555777 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa1011-6809-47b0-ac28-df88d0f8e514 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:38.556293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa1011-6809-47b0-ac28-df88d0f8e514 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:38.556760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fa1011-6809-47b0-ac28-df88d0f8e514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:38.565758 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:38.569001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa1011-6809-47b0-ac28-df88d0f8e514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:38.570790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5fa1011-6809-47b0-ac28-df88d0f8e514 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:38.580447 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-e5fa1011-6809-47b0-ac28-df88d0f8e514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:38.590668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:38.591703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:38.592550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:38.592550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:38.592550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:38.593896 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd61b0-4cdf-406e-8d2a-14ef0cb14b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:38.594609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 243/494] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:38.594841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd61b0-4cdf-406e-8d2a-14ef0cb14b29 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:38.595233 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd61b0-4cdf-406e-8d2a-14ef0cb14b29 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:38.595635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd61b0-4cdf-406e-8d2a-14ef0cb14b29 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:38.596641 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124134-3f52-4839-b384-de4ed4d02e1c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:38.597401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124134-3f52-4839-b384-de4ed4d02e1c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:38.597842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a124134-3f52-4839-b384-de4ed4d02e1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:38.604652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd61b0-4cdf-406e-8d2a-14ef0cb14b29 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:38.606308 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd61b0-4cdf-406e-8d2a-14ef0cb14b29 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:38.617610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7a124134-3f52-4839-b384-de4ed4d02e1c None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:38.619121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7a124134-3f52-4839-b384-de4ed4d02e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-91bd61b0-4cdf-406e-8d2a-14ef0cb14b29 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:38.620624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:38.621499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:38.622424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:38.622424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:38.622424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:38.622424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:38.622424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:38.622424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:38.622424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:38.622424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:38.622424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:04:38.622424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:38.625859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 252/495] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 19:04:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:38.627785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd61b0-4cdf-406e-8d2a-14ef0cb14b29 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:38.702070 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 244/496] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:38.702070 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124134-3f52-4839-b384-de4ed4d02e1c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:38.755216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd61b0-4cdf-406e-8d2a-14ef0cb14b29 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:38.798374 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5b91d-a98d-4d92-8015-33c20d7a0caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:38.799086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5b91d-a98d-4d92-8015-33c20d7a0caf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:38.799427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5b91d-a98d-4d92-8015-33c20d7a0caf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:38.799760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae5b91d-a98d-4d92-8015-33c20d7a0caf None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:38.801008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5b91d-a98d-4d92-8015-33c20d7a0caf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:38.801383 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5b91d-a98d-4d92-8015-33c20d7a0caf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:38.803848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae5b91d-a98d-4d92-8015-33c20d7a0caf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:38.814166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a124134-3f52-4839-b384-de4ed4d02e1c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:38.819345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 253/497] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:38.820489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5b91d-a98d-4d92-8015-33c20d7a0caf None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:38.842716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:38.857066 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f77049-21d6-4ccf-a5bf-c179c38454a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:38.858076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f77049-21d6-4ccf-a5bf-c179c38454a2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:38.858583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f77049-21d6-4ccf-a5bf-c179c38454a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:38.859084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f77049-21d6-4ccf-a5bf-c179c38454a2 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:38.860100 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f77049-21d6-4ccf-a5bf-c179c38454a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:38.860544 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f77049-21d6-4ccf-a5bf-c179c38454a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:38.862193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f77049-21d6-4ccf-a5bf-c179c38454a2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:38.876680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:38.905670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 245/498] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 19:04:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:38.907045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f77049-21d6-4ccf-a5bf-c179c38454a2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:38.949888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae5b91d-a98d-4d92-8015-33c20d7a0caf None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:38.996366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56403d2-dd71-4831-93db-58d1a5766cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:38.996920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56403d2-dd71-4831-93db-58d1a5766cfe None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:38.997188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56403d2-dd71-4831-93db-58d1a5766cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:38.997451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56403d2-dd71-4831-93db-58d1a5766cfe None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:39.009974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56403d2-dd71-4831-93db-58d1a5766cfe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c56403d2-dd71-4831-93db-58d1a5766cfe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:39.015500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:39.016405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:39.017251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:39.017251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:39.017251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:39.017251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:39.017251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:39.017251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:39.017251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:39.017251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:39.017251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:39.017251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:39.017251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:39.017251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:39.017251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 254/499] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:39.018560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56403d2-dd71-4831-93db-58d1a5766cfe None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:39.029255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f77049-21d6-4ccf-a5bf-c179c38454a2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:39.068622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffdf55-994c-43d4-ac4a-831489ee7a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:39.069307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffdf55-994c-43d4-ac4a-831489ee7a80 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:39.069558 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffdf55-994c-43d4-ac4a-831489ee7a80 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:39.069851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bffdf55-994c-43d4-ac4a-831489ee7a80 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:39.077029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffdf55-994c-43d4-ac4a-831489ee7a80 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:39.078516 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bffdf55-994c-43d4-ac4a-831489ee7a80 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-7bffdf55-994c-43d4-ac4a-831489ee7a80 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:39.091619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:39.092532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:39.093402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:39.093402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:39.093402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:39.093402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:39.093402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:39.093402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:39.093402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:39.093402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:39.093402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 19:04:39.093402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:39.093402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 246/500] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:38 2022] GET /identity/v3/users/glance => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:39.094029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffdf55-994c-43d4-ac4a-831489ee7a80 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:39.123973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56403d2-dd71-4831-93db-58d1a5766cfe None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:39.126750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:39.139360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:39.163912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd64501b-b5c7-4967-93e9-edd410681b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:39.164499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64501b-b5c7-4967-93e9-edd410681b9d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:39.164780 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64501b-b5c7-4967-93e9-edd410681b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:39.165040 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd64501b-b5c7-4967-93e9-edd410681b9d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:39.199699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bffdf55-994c-43d4-ac4a-831489ee7a80 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:39.233090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64501b-b5c7-4967-93e9-edd410681b9d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:39.234117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e97b6-97f1-486d-9e57-915c652216f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:39.234764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e97b6-97f1-486d-9e57-915c652216f0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:39.234974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd64501b-b5c7-4967-93e9-edd410681b9d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:39.235068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e97b6-97f1-486d-9e57-915c652216f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:39.235299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e97b6-97f1-486d-9e57-915c652216f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:39.246288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e97b6-97f1-486d-9e57-915c652216f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-6e2e97b6-97f1-486d-9e57-915c652216f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:39.251646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:39.252774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:39.254092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:39.254092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:39.254092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:39.254092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:39.254092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:39.254092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:39.254092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:39.254092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:39.254092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:39.254092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:39.254092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:39.254092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:39.254092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 247/501] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:39.256252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e97b6-97f1-486d-9e57-915c652216f0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:39.343924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 255/502] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:39.344356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e946f-0024-4e68-a166-a35f3c4a7423 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:39.344571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e946f-0024-4e68-a166-a35f3c4a7423 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:39.344843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805e946f-0024-4e68-a166-a35f3c4a7423 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:39.346177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 256/503] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:39.347343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e946f-0024-4e68-a166-a35f3c4a7423 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:39.351331 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:39.357038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:39.359979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e97b6-97f1-486d-9e57-915c652216f0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:39.394958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f1a05-268c-489c-a640-c89347db61aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:39.395573 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f1a05-268c-489c-a640-c89347db61aa None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:39.395908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f1a05-268c-489c-a640-c89347db61aa None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:39.396368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645f1a05-268c-489c-a640-c89347db61aa None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:39.397166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f1a05-268c-489c-a640-c89347db61aa None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:39.397481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f1a05-268c-489c-a640-c89347db61aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:39.398918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645f1a05-268c-489c-a640-c89347db61aa None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:39.407448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 248/504] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:39.408345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f1a05-268c-489c-a640-c89347db61aa None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:39.449052 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805e946f-0024-4e68-a166-a35f3c4a7423 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:39.484013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d62247-2eaa-4e8b-9825-1d2a9f42ca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:39.484622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d62247-2eaa-4e8b-9825-1d2a9f42ca64 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:39.484896 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d62247-2eaa-4e8b-9825-1d2a9f42ca64 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:39.485158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d62247-2eaa-4e8b-9825-1d2a9f42ca64 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:39.485928 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d62247-2eaa-4e8b-9825-1d2a9f42ca64 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:39.486234 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d62247-2eaa-4e8b-9825-1d2a9f42ca64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:39.487673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d62247-2eaa-4e8b-9825-1d2a9f42ca64 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:39.508082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645f1a05-268c-489c-a640-c89347db61aa None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:39.525107 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 257/505] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 15 19:04:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:39.525916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d62247-2eaa-4e8b-9825-1d2a9f42ca64 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:39.544120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba5c3ff-f3ff-43f3-a02d-448298d39499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:39.544737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c3ff-f3ff-43f3-a02d-448298d39499 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:39.545018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c3ff-f3ff-43f3-a02d-448298d39499 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:39.545294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba5c3ff-f3ff-43f3-a02d-448298d39499 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:39.546001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5c3ff-f3ff-43f3-a02d-448298d39499 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:39.546307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5c3ff-f3ff-43f3-a02d-448298d39499 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:39.547706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba5c3ff-f3ff-43f3-a02d-448298d39499 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:39.556100 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 249/506] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:39.557361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152da15-3108-4cb2-962e-926c5a727306 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:39.557635 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152da15-3108-4cb2-962e-926c5a727306 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:39.557949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3152da15-3108-4cb2-962e-926c5a727306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:39.576904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-3152da15-3108-4cb2-962e-926c5a727306 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:39.578113 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3152da15-3108-4cb2-962e-926c5a727306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:39.590113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:39.597259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:39.631239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d62247-2eaa-4e8b-9825-1d2a9f42ca64 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:39.648272 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 250/507] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:39.649142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152da15-3108-4cb2-962e-926c5a727306 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:39.680429 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f2877-c7ef-422a-8df6-c1f08e98241d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:39.681509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f2877-c7ef-422a-8df6-c1f08e98241d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:39.682042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f2877-c7ef-422a-8df6-c1f08e98241d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:39.682533 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488f2877-c7ef-422a-8df6-c1f08e98241d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:39.698687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f2877-c7ef-422a-8df6-c1f08e98241d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:39.700297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488f2877-c7ef-422a-8df6-c1f08e98241d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-488f2877-c7ef-422a-8df6-c1f08e98241d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:39.717529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:39.718595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:39.719421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:39.719421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:39.719421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:39.719421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 258/508] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:39.719643 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f2877-c7ef-422a-8df6-c1f08e98241d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:39.777150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3152da15-3108-4cb2-962e-926c5a727306 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:39.814016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205a7c3-fbd7-48f6-b0d8-ac3541e63fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:39.814677 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205a7c3-fbd7-48f6-b0d8-ac3541e63fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:39.814954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205a7c3-fbd7-48f6-b0d8-ac3541e63fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:39.815223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d205a7c3-fbd7-48f6-b0d8-ac3541e63fd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:39.825543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205a7c3-fbd7-48f6-b0d8-ac3541e63fd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:39.827085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d205a7c3-fbd7-48f6-b0d8-ac3541e63fd8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-d205a7c3-fbd7-48f6-b0d8-ac3541e63fd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:39.842367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:39.843320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:39.844193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:39.844193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:39.844193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:39.844193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 251/509] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:39.844405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205a7c3-fbd7-48f6-b0d8-ac3541e63fd8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:39.855823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:39.890758 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488f2877-c7ef-422a-8df6-c1f08e98241d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:39.909669 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:39.934137 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972c516-c25f-4e56-a074-f8cfa8845d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:39.934853 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972c516-c25f-4e56-a074-f8cfa8845d25 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:39.935132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972c516-c25f-4e56-a074-f8cfa8845d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:39.935403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8972c516-c25f-4e56-a074-f8cfa8845d25 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:39.981428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d205a7c3-fbd7-48f6-b0d8-ac3541e63fd8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:40.005958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972c516-c25f-4e56-a074-f8cfa8845d25 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:40.007577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8972c516-c25f-4e56-a074-f8cfa8845d25 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:40.014148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c79e2-d60b-46d8-a42f-ae2ea705ff38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:40.014779 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c79e2-d60b-46d8-a42f-ae2ea705ff38 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:40.015056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c79e2-d60b-46d8-a42f-ae2ea705ff38 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:40.015322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5c79e2-d60b-46d8-a42f-ae2ea705ff38 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:40.026360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c79e2-d60b-46d8-a42f-ae2ea705ff38 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:40.027857 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5c79e2-d60b-46d8-a42f-ae2ea705ff38 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-5b5c79e2-d60b-46d8-a42f-ae2ea705ff38 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:40.042187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:40.043136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:40.043977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:40.043977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:40.043977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:40.043977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 252/510] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:40.044187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c79e2-d60b-46d8-a42f-ae2ea705ff38 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:40.104376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:40.106833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 259/511] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:40.107718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972c516-c25f-4e56-a074-f8cfa8845d25 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:40.123232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:40.149042 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5c79e2-d60b-46d8-a42f-ae2ea705ff38 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:40.183000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cae3b-6a9a-4c97-bc26-15bb21ee218b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:40.183617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cae3b-6a9a-4c97-bc26-15bb21ee218b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:40.183892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cae3b-6a9a-4c97-bc26-15bb21ee218b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:40.184160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706cae3b-6a9a-4c97-bc26-15bb21ee218b None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:40.184810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706cae3b-6a9a-4c97-bc26-15bb21ee218b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:40.185114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706cae3b-6a9a-4c97-bc26-15bb21ee218b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:40.186526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706cae3b-6a9a-4c97-bc26-15bb21ee218b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:40.198291 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 253/512] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:40.199141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cae3b-6a9a-4c97-bc26-15bb21ee218b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:40.211479 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8972c516-c25f-4e56-a074-f8cfa8845d25 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:40.246309 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf9b8-9fce-40c2-922f-7b2e733a1272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:40.246926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf9b8-9fce-40c2-922f-7b2e733a1272 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:40.247199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf9b8-9fce-40c2-922f-7b2e733a1272 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:40.247464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccaf9b8-9fce-40c2-922f-7b2e733a1272 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:40.248100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaf9b8-9fce-40c2-922f-7b2e733a1272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:40.248398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaf9b8-9fce-40c2-922f-7b2e733a1272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:40.249768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccaf9b8-9fce-40c2-922f-7b2e733a1272 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:40.260857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 260/513] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:40.261653 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf9b8-9fce-40c2-922f-7b2e733a1272 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:40.318545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706cae3b-6a9a-4c97-bc26-15bb21ee218b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:40.335904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:40.338249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:40.353858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3d0a0-b734-42da-a812-ec9992ed2991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:40.354507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3d0a0-b734-42da-a812-ec9992ed2991 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:40.354790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3d0a0-b734-42da-a812-ec9992ed2991 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:40.355055 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3d0a0-b734-42da-a812-ec9992ed2991 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:40.364068 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccaf9b8-9fce-40c2-922f-7b2e733a1272 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:40.365168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3d0a0-b734-42da-a812-ec9992ed2991 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:40.366695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3d0a0-b734-42da-a812-ec9992ed2991 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-49f3d0a0-b734-42da-a812-ec9992ed2991 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:40.381317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:40.382473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:40.387096 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:40.387096 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:40.387096 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:40.387096 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 254/514] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:40.387096 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3d0a0-b734-42da-a812-ec9992ed2991 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:40.398117 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2dc14-bd1d-42ac-af54-f1030b900ca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:40.398759 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2dc14-bd1d-42ac-af54-f1030b900ca4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:40.399031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2dc14-bd1d-42ac-af54-f1030b900ca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:40.399342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa2dc14-bd1d-42ac-af54-f1030b900ca4 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:40.400009 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2dc14-bd1d-42ac-af54-f1030b900ca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:40.400305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2dc14-bd1d-42ac-af54-f1030b900ca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:40.401697 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa2dc14-bd1d-42ac-af54-f1030b900ca4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:40.414791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 261/515] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:40.415610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2dc14-bd1d-42ac-af54-f1030b900ca4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:40.488474 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3d0a0-b734-42da-a812-ec9992ed2991 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:40.516249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa2dc14-bd1d-42ac-af54-f1030b900ca4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:40.521566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da2fc4-bacc-4fe3-93ca-7d9038b96aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:40.522236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da2fc4-bacc-4fe3-93ca-7d9038b96aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:40.522535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da2fc4-bacc-4fe3-93ca-7d9038b96aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:40.522800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4da2fc4-bacc-4fe3-93ca-7d9038b96aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:40.533589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da2fc4-bacc-4fe3-93ca-7d9038b96aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:40.535098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4da2fc4-bacc-4fe3-93ca-7d9038b96aa6 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:40.551649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8fc7b-266f-4775-9979-5bebbc97b663 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:40.552282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8fc7b-266f-4775-9979-5bebbc97b663 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:40.552625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8fc7b-266f-4775-9979-5bebbc97b663 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:40.552967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e8fc7b-266f-4775-9979-5bebbc97b663 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:40.554950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c4da2fc4-bacc-4fe3-93ca-7d9038b96aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:40.557744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:40.558697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:40.559529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:40.559529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:40.559529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:40.559529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 255/516] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:40.559748 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da2fc4-bacc-4fe3-93ca-7d9038b96aa6 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:40.565101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8fc7b-266f-4775-9979-5bebbc97b663 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:40.566883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e8fc7b-266f-4775-9979-5bebbc97b663 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-89e8fc7b-266f-4775-9979-5bebbc97b663 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:40.579568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:40.580534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:40.586433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:40.586433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:40.586433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:40.586433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:40.586433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:40.586433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:40.586433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:40.586433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:40.586433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 262/517] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:40.586433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8fc7b-266f-4775-9979-5bebbc97b663 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:40.589584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:40.669044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4da2fc4-bacc-4fe3-93ca-7d9038b96aa6 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:40.687588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e8fc7b-266f-4775-9979-5bebbc97b663 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:40.701668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a42002-483d-4be8-8d25-7c7f82fb53a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:40.702323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a42002-483d-4be8-8d25-7c7f82fb53a4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:40.702595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a42002-483d-4be8-8d25-7c7f82fb53a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:40.702862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a42002-483d-4be8-8d25-7c7f82fb53a4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:40.710588 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a42002-483d-4be8-8d25-7c7f82fb53a4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:40.712042 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a42002-483d-4be8-8d25-7c7f82fb53a4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:40.721623 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2fe9f-8d70-46b4-87a1-6b2d4b2f83d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:40.722610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2fe9f-8d70-46b4-87a1-6b2d4b2f83d1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:40.722879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2fe9f-8d70-46b4-87a1-6b2d4b2f83d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:40.723142 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a2fe9f-8d70-46b4-87a1-6b2d4b2f83d1 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-16a42002-483d-4be8-8d25-7c7f82fb53a4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:40.723341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:40.724343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:40.725223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:40.725223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:40.725223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:40.725223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:40.725223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:40.725223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:40.725223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:40.725223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:40.725223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 19:04:40.725223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:40.725794 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2fe9f-8d70-46b4-87a1-6b2d4b2f83d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:40.725794 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2fe9f-8d70-46b4-87a1-6b2d4b2f83d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:40.725921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 256/518] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:40.725921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a42002-483d-4be8-8d25-7c7f82fb53a4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:40.726052 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a2fe9f-8d70-46b4-87a1-6b2d4b2f83d1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:40.737626 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 263/519] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:40.738480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2fe9f-8d70-46b4-87a1-6b2d4b2f83d1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:40.793525 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:40.812515 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:40.830681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a42002-483d-4be8-8d25-7c7f82fb53a4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:40.839394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a2fe9f-8d70-46b4-87a1-6b2d4b2f83d1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:40.864949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe319c9-089b-4dfc-849c-4758feecf86f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:40.865581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe319c9-089b-4dfc-849c-4758feecf86f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:40.865879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe319c9-089b-4dfc-849c-4758feecf86f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:40.866151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe319c9-089b-4dfc-849c-4758feecf86f None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:40.874145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe319c9-089b-4dfc-849c-4758feecf86f None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:40.874781 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e3293-8fcf-45a5-82e8-c7ed0ed5abb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:40.875392 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e3293-8fcf-45a5-82e8-c7ed0ed5abb4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:40.875590 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe319c9-089b-4dfc-849c-4758feecf86f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:40.875704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e3293-8fcf-45a5-82e8-c7ed0ed5abb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:40.875959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1e3293-8fcf-45a5-82e8-c7ed0ed5abb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:40.876545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e3293-8fcf-45a5-82e8-c7ed0ed5abb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:40.876842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e3293-8fcf-45a5-82e8-c7ed0ed5abb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:40.878226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1e3293-8fcf-45a5-82e8-c7ed0ed5abb4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-fbe319c9-089b-4dfc-849c-4758feecf86f None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:40.886619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:40.887672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:40.888920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:40.888920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:40.888920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:40.888920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:40.888920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:40.888920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:40.888920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:40.888920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:40.888920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 19:04:40.888920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:40.888920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 257/520] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:40.888920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe319c9-089b-4dfc-849c-4758feecf86f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:40.893743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 264/521] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:40.894876 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e3293-8fcf-45a5-82e8-c7ed0ed5abb4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:40.991082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe319c9-089b-4dfc-849c-4758feecf86f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:40.998121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1e3293-8fcf-45a5-82e8-c7ed0ed5abb4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:41.012333 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:41.025691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f335fbc-dcc4-4592-8cbf-1f27cd049ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:41.026342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f335fbc-dcc4-4592-8cbf-1f27cd049ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:41.026620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f335fbc-dcc4-4592-8cbf-1f27cd049ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:41.026893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f335fbc-dcc4-4592-8cbf-1f27cd049ec5 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:41.027587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f335fbc-dcc4-4592-8cbf-1f27cd049ec5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:41.027891 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f335fbc-dcc4-4592-8cbf-1f27cd049ec5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:41.029376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f335fbc-dcc4-4592-8cbf-1f27cd049ec5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:41.033561 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffe3db-dbbf-41f7-8450-4bcbe1702bc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:41.034216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffe3db-dbbf-41f7-8450-4bcbe1702bc5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:41.034491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffe3db-dbbf-41f7-8450-4bcbe1702bc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:41.034749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ffe3db-dbbf-41f7-8450-4bcbe1702bc5 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:41.035515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffe3db-dbbf-41f7-8450-4bcbe1702bc5 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:41.035818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffe3db-dbbf-41f7-8450-4bcbe1702bc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:41.037332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ffe3db-dbbf-41f7-8450-4bcbe1702bc5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:41.047387 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 258/522] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:41.048203 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f335fbc-dcc4-4592-8cbf-1f27cd049ec5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:41.054962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 265/523] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 15 19:04:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:41.055136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:41.055643 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffe3db-dbbf-41f7-8450-4bcbe1702bc5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:41.153895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ffe3db-dbbf-41f7-8450-4bcbe1702bc5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:41.155254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f335fbc-dcc4-4592-8cbf-1f27cd049ec5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:41.188430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cb5de-dc61-4372-8e32-79082391fcc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:41.189053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cb5de-dc61-4372-8e32-79082391fcc9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:41.189327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cb5de-dc61-4372-8e32-79082391fcc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:41.189595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1cb5de-dc61-4372-8e32-79082391fcc9 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:41.190349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cb5de-dc61-4372-8e32-79082391fcc9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:41.190652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cb5de-dc61-4372-8e32-79082391fcc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:41.190943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de5827-86c8-4d5b-a603-aa5f403e73e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:41.191570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de5827-86c8-4d5b-a603-aa5f403e73e4 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:41.191850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de5827-86c8-4d5b-a603-aa5f403e73e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:41.192109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1cb5de-dc61-4372-8e32-79082391fcc9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:41.192196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3de5827-86c8-4d5b-a603-aa5f403e73e4 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:41.192841 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de5827-86c8-4d5b-a603-aa5f403e73e4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:41.194414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3de5827-86c8-4d5b-a603-aa5f403e73e4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:41.210529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 266/524] 10.222.0.25 () {56 vars in 1139 bytes} [Thu Sep 15 19:04:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:41.211464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cb5de-dc61-4372-8e32-79082391fcc9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:41.219242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 259/525] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:04:41 2022] POST /identity/v3/users => generated 247 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:04:41.220932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de5827-86c8-4d5b-a603-aa5f403e73e4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:41.247796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:41.313435 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:41.341809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1cb5de-dc61-4372-8e32-79082391fcc9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:41.375741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3de5827-86c8-4d5b-a603-aa5f403e73e4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:41.381087 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34885e10-0a01-4ad4-a364-ebd2226c2ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:41.381751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34885e10-0a01-4ad4-a364-ebd2226c2ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:41.382054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34885e10-0a01-4ad4-a364-ebd2226c2ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:41.382330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34885e10-0a01-4ad4-a364-ebd2226c2ea9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:41.389929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34885e10-0a01-4ad4-a364-ebd2226c2ea9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:41.391409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34885e10-0a01-4ad4-a364-ebd2226c2ea9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-34885e10-0a01-4ad4-a364-ebd2226c2ea9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:41.403994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:41.405199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:41.406221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:41.406221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:41.406221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:41.406221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:41.406221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:41.406221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:41.406221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:41.406221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:41.406221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 267/526] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:41.406221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34885e10-0a01-4ad4-a364-ebd2226c2ea9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:41.422181 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bc29a-6897-4510-a32e-4cff00b47fd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:41.422793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bc29a-6897-4510-a32e-4cff00b47fd0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:41.423075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bc29a-6897-4510-a32e-4cff00b47fd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:41.423349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4bc29a-6897-4510-a32e-4cff00b47fd0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:41.424222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bc29a-6897-4510-a32e-4cff00b47fd0 None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=38b19e4add2a4321a2fbfeb9a3a1b61d) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:41.424534 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bc29a-6897-4510-a32e-4cff00b47fd0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:41.426043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4bc29a-6897-4510-a32e-4cff00b47fd0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:41.433447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 260/527] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:41 2022] GET /identity/v3/role_assignments?user.id=38b19e4add2a4321a2fbfeb9a3a1b61d&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:41.434328 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bc29a-6897-4510-a32e-4cff00b47fd0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:41.532863 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:41.549525 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34885e10-0a01-4ad4-a364-ebd2226c2ea9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:41.589545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4bc29a-6897-4510-a32e-4cff00b47fd0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:41.596474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cadf2f-c0ef-4cb6-96b3-5cfed6685221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:41.597464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cadf2f-c0ef-4cb6-96b3-5cfed6685221 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:41.597741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cadf2f-c0ef-4cb6-96b3-5cfed6685221 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:41.598050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3cadf2f-c0ef-4cb6-96b3-5cfed6685221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:41.627360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:41.646318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dee9a-950d-4407-82c9-b6b15fe89d1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:41.647302 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dee9a-950d-4407-82c9-b6b15fe89d1e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:41.647730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dee9a-950d-4407-82c9-b6b15fe89d1e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:41.648165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dee9a-950d-4407-82c9-b6b15fe89d1e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:41.688732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cadf2f-c0ef-4cb6-96b3-5cfed6685221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:41.690155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3cadf2f-c0ef-4cb6-96b3-5cfed6685221 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:41.751407 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9dee9a-950d-4407-82c9-b6b15fe89d1e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:41.753542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9dee9a-950d-4407-82c9-b6b15fe89d1e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:41.812921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:41.828463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 268/528] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:41.829358 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cadf2f-c0ef-4cb6-96b3-5cfed6685221 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:41.904763 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 261/529] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 471 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:41.905892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dee9a-950d-4407-82c9-b6b15fe89d1e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:41.938266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:41.951938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3cadf2f-c0ef-4cb6-96b3-5cfed6685221 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:41.996472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eff2b6-bc6d-45fa-af4b-2d109cab867f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:41.997093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eff2b6-bc6d-45fa-af4b-2d109cab867f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:41.997374 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eff2b6-bc6d-45fa-af4b-2d109cab867f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:41.997646 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20eff2b6-bc6d-45fa-af4b-2d109cab867f None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:41.998545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eff2b6-bc6d-45fa-af4b-2d109cab867f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:41.999689 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eff2b6-bc6d-45fa-af4b-2d109cab867f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:42.001159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20eff2b6-bc6d-45fa-af4b-2d109cab867f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:42.025831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 269/530] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:42.025831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eff2b6-bc6d-45fa-af4b-2d109cab867f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:42.039161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dee9a-950d-4407-82c9-b6b15fe89d1e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:42.085726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e2492-b0f6-4752-8974-15849cfd5bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:42.086681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e2492-b0f6-4752-8974-15849cfd5bb4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:42.086965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e2492-b0f6-4752-8974-15849cfd5bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:42.087234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7e2492-b0f6-4752-8974-15849cfd5bb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:42.089510 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:42.102272 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e2492-b0f6-4752-8974-15849cfd5bb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:42.104044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7e2492-b0f6-4752-8974-15849cfd5bb4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ac7e2492-b0f6-4752-8974-15849cfd5bb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:42.120327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:42.121527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:42.122577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:42.122577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:42.122577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:42.124316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 262/531] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:42.125356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e2492-b0f6-4752-8974-15849cfd5bb4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:42.151399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20eff2b6-bc6d-45fa-af4b-2d109cab867f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:42.191830 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf233fa-9fec-4a02-bd9a-c55ca5a68163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:42.192702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf233fa-9fec-4a02-bd9a-c55ca5a68163 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:42.192982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf233fa-9fec-4a02-bd9a-c55ca5a68163 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:42.193244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf233fa-9fec-4a02-bd9a-c55ca5a68163 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:42.209910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf233fa-9fec-4a02-bd9a-c55ca5a68163 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:42.209910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf233fa-9fec-4a02-bd9a-c55ca5a68163 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:42.211887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-bcf233fa-9fec-4a02-bd9a-c55ca5a68163 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:42.229732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:42.230946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:42.231846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:42.231846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:42.231846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:42.233326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 270/532] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:42.234372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf233fa-9fec-4a02-bd9a-c55ca5a68163 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:42.247273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7e2492-b0f6-4752-8974-15849cfd5bb4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:42.288443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6c5f7-21de-4e92-9876-2a0cb34c28d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:42.289470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6c5f7-21de-4e92-9876-2a0cb34c28d5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:42.289941 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6c5f7-21de-4e92-9876-2a0cb34c28d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:42.290349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b6c5f7-21de-4e92-9876-2a0cb34c28d5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:42.291288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6c5f7-21de-4e92-9876-2a0cb34c28d5 None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=b06d8a144ecf43fc8de82346758b6065) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:42.291905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6c5f7-21de-4e92-9876-2a0cb34c28d5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:42.293768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b6c5f7-21de-4e92-9876-2a0cb34c28d5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:42.315348 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 263/533] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:42 2022] GET /identity/v3/role_assignments?user.id=b06d8a144ecf43fc8de82346758b6065&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:42.316776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6c5f7-21de-4e92-9876-2a0cb34c28d5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:42.370528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf233fa-9fec-4a02-bd9a-c55ca5a68163 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:42.372440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:42.416839 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281c2c0-5d35-4377-a562-f39accdc3fbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:42.417480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281c2c0-5d35-4377-a562-f39accdc3fbf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:42.417916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281c2c0-5d35-4377-a562-f39accdc3fbf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:42.418097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0281c2c0-5d35-4377-a562-f39accdc3fbf None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:42.418763 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281c2c0-5d35-4377-a562-f39accdc3fbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:42.419066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281c2c0-5d35-4377-a562-f39accdc3fbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:42.425808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0281c2c0-5d35-4377-a562-f39accdc3fbf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:42.435900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 271/534] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:42.441691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281c2c0-5d35-4377-a562-f39accdc3fbf None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:42.563688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b6c5f7-21de-4e92-9876-2a0cb34c28d5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:42.567955 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0281c2c0-5d35-4377-a562-f39accdc3fbf None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:42.620025 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939556d-0cfa-4029-96e6-a290ca2d3fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:42.620700 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939556d-0cfa-4029-96e6-a290ca2d3fa3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:42.620978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939556d-0cfa-4029-96e6-a290ca2d3fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:42.621250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b939556d-0cfa-4029-96e6-a290ca2d3fa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:42.638122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939556d-0cfa-4029-96e6-a290ca2d3fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:42.643170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b939556d-0cfa-4029-96e6-a290ca2d3fa3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:42.650508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ac5dc-bb3a-4705-b451-3421330d1a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:42.651209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac5dc-bb3a-4705-b451-3421330d1a6a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:42.651483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac5dc-bb3a-4705-b451-3421330d1a6a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:42.651749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6ac5dc-bb3a-4705-b451-3421330d1a6a None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:42.652462 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ac5dc-bb3a-4705-b451-3421330d1a6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:42.652761 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ac5dc-bb3a-4705-b451-3421330d1a6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:42.654238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6ac5dc-bb3a-4705-b451-3421330d1a6a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b939556d-0cfa-4029-96e6-a290ca2d3fa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:42.663043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:42.663984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:42.665235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:42.665235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:42.665235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:42.665235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:42.665235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:42.665235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:42.665235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:42.665235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:42.665235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 272/535] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:42.665696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:42.670419 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939556d-0cfa-4029-96e6-a290ca2d3fa3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:42.678518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 264/536] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:42.696650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ac5dc-bb3a-4705-b451-3421330d1a6a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:42.717993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:42.795495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b939556d-0cfa-4029-96e6-a290ca2d3fa3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:42.830219 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5865a-21a6-4c55-aaf7-3b48bfdc7cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:42.830758 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5865a-21a6-4c55-aaf7-3b48bfdc7cab None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:42.831034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5865a-21a6-4c55-aaf7-3b48bfdc7cab None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:42.831304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a5865a-21a6-4c55-aaf7-3b48bfdc7cab None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:42.831996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5865a-21a6-4c55-aaf7-3b48bfdc7cab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:42.832303 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5865a-21a6-4c55-aaf7-3b48bfdc7cab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:42.834376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a5865a-21a6-4c55-aaf7-3b48bfdc7cab None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:42.867859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 273/537] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:42.872066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5865a-21a6-4c55-aaf7-3b48bfdc7cab None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:42.904042 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6ac5dc-bb3a-4705-b451-3421330d1a6a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:42.976389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76413e30-262d-4054-ba62-c0b53465d49d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:42.977042 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76413e30-262d-4054-ba62-c0b53465d49d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:42.977416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76413e30-262d-4054-ba62-c0b53465d49d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:42.977694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76413e30-262d-4054-ba62-c0b53465d49d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:42.995065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76413e30-262d-4054-ba62-c0b53465d49d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:42.996642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76413e30-262d-4054-ba62-c0b53465d49d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:43.002213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:43.021452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a5865a-21a6-4c55-aaf7-3b48bfdc7cab None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-76413e30-262d-4054-ba62-c0b53465d49d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:43.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:43.029368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:43.030643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:43.030643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:43.030643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:43.030643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:43.030643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:43.030643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:43.030643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:43.030643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:43.030643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 265/538] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:43.038757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76413e30-262d-4054-ba62-c0b53465d49d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:43.056099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb104df7-6bc6-477d-9f86-4c39df221bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:43.056715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb104df7-6bc6-477d-9f86-4c39df221bbc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:43.056991 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb104df7-6bc6-477d-9f86-4c39df221bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:43.057264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb104df7-6bc6-477d-9f86-4c39df221bbc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:43.058022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb104df7-6bc6-477d-9f86-4c39df221bbc None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=677623b8ea5042ffa0169be83a7205d4) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:43.058326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb104df7-6bc6-477d-9f86-4c39df221bbc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:43.059758 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb104df7-6bc6-477d-9f86-4c39df221bbc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:43.065726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 274/539] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:42 2022] GET /identity/v3/role_assignments?user.id=677623b8ea5042ffa0169be83a7205d4&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:43.155897 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:43.228773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76413e30-262d-4054-ba62-c0b53465d49d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:43.290624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e367ec92-3859-4c5e-a830-720a05c992d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:43.291261 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367ec92-3859-4c5e-a830-720a05c992d2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:43.291534 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367ec92-3859-4c5e-a830-720a05c992d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:43.291801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e367ec92-3859-4c5e-a830-720a05c992d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:43.292514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367ec92-3859-4c5e-a830-720a05c992d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:43.292809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367ec92-3859-4c5e-a830-720a05c992d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:43.296825 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e367ec92-3859-4c5e-a830-720a05c992d2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:43.314267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 266/540] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:43.321160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb104df7-6bc6-477d-9f86-4c39df221bbc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:43.446088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb104df7-6bc6-477d-9f86-4c39df221bbc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:43.492307 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b6b8c0-1472-4eb8-bbb7-2b0f545525b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:43.493321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6b8c0-1472-4eb8-bbb7-2b0f545525b5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:43.493812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6b8c0-1472-4eb8-bbb7-2b0f545525b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:43.494270 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b6b8c0-1472-4eb8-bbb7-2b0f545525b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:43.495201 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6b8c0-1472-4eb8-bbb7-2b0f545525b5 None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=4591e01ab4954b22a81f6b09cdb2d544) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:43.495693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6b8c0-1472-4eb8-bbb7-2b0f545525b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:43.497364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b6b8c0-1472-4eb8-bbb7-2b0f545525b5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:43.506601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 275/541] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:43 2022] GET /identity/v3/role_assignments?user.id=4591e01ab4954b22a81f6b09cdb2d544&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:43.791638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc446280-600c-48df-8167-97d5cb50bdb9 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:43.791952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc446280-600c-48df-8167-97d5cb50bdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:43.792232 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc446280-600c-48df-8167-97d5cb50bdb9 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:43.794093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 267/542] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:43.799993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c53513-c968-4ff0-8f71-be89214fc848 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:43.800330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c53513-c968-4ff0-8f71-be89214fc848 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:43.800526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c53513-c968-4ff0-8f71-be89214fc848 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:43.803882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a43a6-23ca-424a-acf9-3faf59d5527f None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:43.804167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a43a6-23ca-424a-acf9-3faf59d5527f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:43.804444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3a43a6-23ca-424a-acf9-3faf59d5527f None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:43.806104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 268/543] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:43.811790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36183f1f-4b76-43c0-8edd-9295ac401e4b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:43.812112 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36183f1f-4b76-43c0-8edd-9295ac401e4b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:43.812342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36183f1f-4b76-43c0-8edd-9295ac401e4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:43.831712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-16c53513-c968-4ff0-8f71-be89214fc848 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:43.832972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-16c53513-c968-4ff0-8f71-be89214fc848 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:43.834965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-36183f1f-4b76-43c0-8edd-9295ac401e4b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:43.836576 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-36183f1f-4b76-43c0-8edd-9295ac401e4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:43.836702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:43.911038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 276/544] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:43.956579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 269/545] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:04:44.249337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c53513-c968-4ff0-8f71-be89214fc848 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:44.303196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36183f1f-4b76-43c0-8edd-9295ac401e4b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:44.382259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:44.382519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c53513-c968-4ff0-8f71-be89214fc848 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:44.431901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bd8bd-fb3c-4ac5-91da-76d186adfe1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:44.432586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bd8bd-fb3c-4ac5-91da-76d186adfe1e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:44.432868 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bd8bd-fb3c-4ac5-91da-76d186adfe1e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:44.433140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8bd8bd-fb3c-4ac5-91da-76d186adfe1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:44.437307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36183f1f-4b76-43c0-8edd-9295ac401e4b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:44.456877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:44.462380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8bd8bd-fb3c-4ac5-91da-76d186adfe1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-aa8bd8bd-fb3c-4ac5-91da-76d186adfe1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:44.473736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:44.475797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:44.476611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:44.476611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:44.476611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:44.476611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:44.476611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:44.476611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:44.476611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:44.476611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:44.476611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:44.476611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:44.476611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:44.476611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:44.483897 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74107d1b-5306-4a79-aa75-38c6694747ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:44.484054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 277/546] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:44.484183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74107d1b-5306-4a79-aa75-38c6694747ad None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:44.484183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74107d1b-5306-4a79-aa75-38c6694747ad None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:44.484183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74107d1b-5306-4a79-aa75-38c6694747ad None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:44.487075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74107d1b-5306-4a79-aa75-38c6694747ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:44.488207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bd8bd-fb3c-4ac5-91da-76d186adfe1e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-74107d1b-5306-4a79-aa75-38c6694747ad None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:44.492356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:44.494279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:44.495317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:44.495317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:44.495317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:44.495317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:44.495317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:44.495317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:44.495317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:44.495317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:44.495317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:44.495317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:44.495317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:44.495317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:44.495317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 270/547] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:44.499601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74107d1b-5306-4a79-aa75-38c6694747ad None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:44.689462 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74107d1b-5306-4a79-aa75-38c6694747ad None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:44.710027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:44.730643 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8bd8bd-fb3c-4ac5-91da-76d186adfe1e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:44.758140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed1a1b-81e4-4e0f-bb9e-e1e11576f3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:44.758698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed1a1b-81e4-4e0f-bb9e-e1e11576f3b6 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:44.758970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed1a1b-81e4-4e0f-bb9e-e1e11576f3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:44.759233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ed1a1b-81e4-4e0f-bb9e-e1e11576f3b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:44.759920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed1a1b-81e4-4e0f-bb9e-e1e11576f3b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:44.760226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed1a1b-81e4-4e0f-bb9e-e1e11576f3b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:44.761669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ed1a1b-81e4-4e0f-bb9e-e1e11576f3b6 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:44.782895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 271/548] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:44.786176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed1a1b-81e4-4e0f-bb9e-e1e11576f3b6 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:44.802729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218a1c5-6747-4cee-b1e2-42f68d30e8df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:44.803359 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218a1c5-6747-4cee-b1e2-42f68d30e8df None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:44.803636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218a1c5-6747-4cee-b1e2-42f68d30e8df None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:44.803908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218a1c5-6747-4cee-b1e2-42f68d30e8df None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:44.804584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218a1c5-6747-4cee-b1e2-42f68d30e8df None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:44.804890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218a1c5-6747-4cee-b1e2-42f68d30e8df None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:44.806327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7218a1c5-6747-4cee-b1e2-42f68d30e8df None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:44.817106 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 278/549] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:44.828167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218a1c5-6747-4cee-b1e2-42f68d30e8df None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:44.946034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:44.983592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ed1a1b-81e4-4e0f-bb9e-e1e11576f3b6 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:44.990869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218a1c5-6747-4cee-b1e2-42f68d30e8df None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:45.030351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9041f9-dfbf-4a6b-80ed-7a40143a5718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:45.031511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9041f9-dfbf-4a6b-80ed-7a40143a5718 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:45.031983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9041f9-dfbf-4a6b-80ed-7a40143a5718 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:45.032465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9041f9-dfbf-4a6b-80ed-7a40143a5718 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:45.046053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9041f9-dfbf-4a6b-80ed-7a40143a5718 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:45.047903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9041f9-dfbf-4a6b-80ed-7a40143a5718 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-3f9041f9-dfbf-4a6b-80ed-7a40143a5718 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:45.063933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:45.065116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:45.066023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:45.066023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:45.066023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:45.066196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9db74c-079f-40b1-b1f8-6092c6d0c2de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:45.066760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9db74c-079f-40b1-b1f8-6092c6d0c2de None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:45.071947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9db74c-079f-40b1-b1f8-6092c6d0c2de None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:45.072088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 279/550] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:45.072175 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9db74c-079f-40b1-b1f8-6092c6d0c2de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:45.073604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9041f9-dfbf-4a6b-80ed-7a40143a5718 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:45.102728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9db74c-079f-40b1-b1f8-6092c6d0c2de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:45.104178 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9db74c-079f-40b1-b1f8-6092c6d0c2de None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-9c9db74c-079f-40b1-b1f8-6092c6d0c2de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:45.131665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:45.132674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:45.133709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:45.133709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:45.133709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:45.139389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 272/551] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:45.144768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9db74c-079f-40b1-b1f8-6092c6d0c2de None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:45.195430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9041f9-dfbf-4a6b-80ed-7a40143a5718 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:45.197030 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:45.221397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:45.242594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc1455-8f54-439c-b75a-4392de379836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:45.243613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc1455-8f54-439c-b75a-4392de379836 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:45.245323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc1455-8f54-439c-b75a-4392de379836 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:45.245852 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc1455-8f54-439c-b75a-4392de379836 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:45.246732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc1455-8f54-439c-b75a-4392de379836 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:45.247467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc1455-8f54-439c-b75a-4392de379836 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:45.250010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdc1455-8f54-439c-b75a-4392de379836 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:45.275775 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 280/552] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:45.283384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc1455-8f54-439c-b75a-4392de379836 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:45.344410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9db74c-079f-40b1-b1f8-6092c6d0c2de None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:45.387331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdd69cf-dfbc-49e1-b846-43f675da6a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:45.388578 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd69cf-dfbc-49e1-b846-43f675da6a67 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:45.389423 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd69cf-dfbc-49e1-b846-43f675da6a67 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:45.389939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdd69cf-dfbc-49e1-b846-43f675da6a67 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:45.390810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd69cf-dfbc-49e1-b846-43f675da6a67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:45.391404 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd69cf-dfbc-49e1-b846-43f675da6a67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:45.393885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdd69cf-dfbc-49e1-b846-43f675da6a67 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:45.404504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc1455-8f54-439c-b75a-4392de379836 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:45.410682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 273/553] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:45.412923 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8b788-d687-4a4a-aed2-7155a61f89e4 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:45.413451 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8b788-d687-4a4a-aed2-7155a61f89e4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:45.413984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8b788-d687-4a4a-aed2-7155a61f89e4 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:45.416055 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 274/554] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:45.417142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8b788-d687-4a4a-aed2-7155a61f89e4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:45.450046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc9c43-be3c-44f4-ae54-09cb4a62177c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:45.450701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc9c43-be3c-44f4-ae54-09cb4a62177c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:45.450981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc9c43-be3c-44f4-ae54-09cb4a62177c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:45.451248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc9c43-be3c-44f4-ae54-09cb4a62177c None admin] PATH_INFO: `/v3/users/swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:45.459988 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc9c43-be3c-44f4-ae54-09cb4a62177c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:45.461456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dc9c43-be3c-44f4-ae54-09cb4a62177c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-32dc9c43-be3c-44f4-ae54-09cb4a62177c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:45.476336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:45.477352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:45.478677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:45.478677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:45.478677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:45.478677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:45.478677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:45.478677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:45.478677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:45.478677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:45.478677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 19:04:45.478677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:45.478677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 281/555] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:04:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:45.479271 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0e0d5-42ae-4c5e-9432-ae9a1663b4d6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:45.479271 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0e0d5-42ae-4c5e-9432-ae9a1663b4d6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:45.479728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0e0d5-42ae-4c5e-9432-ae9a1663b4d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:45.498762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-aba0e0d5-42ae-4c5e-9432-ae9a1663b4d6 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:45.500079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-aba0e0d5-42ae-4c5e-9432-ae9a1663b4d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:45.529099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:45.547452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8b788-d687-4a4a-aed2-7155a61f89e4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:45.570226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:45.575737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 282/556] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:45.577161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0e0d5-42ae-4c5e-9432-ae9a1663b4d6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:45.586409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09223a-bba2-4a47-8008-07cdd333c88c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:45.587403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09223a-bba2-4a47-8008-07cdd333c88c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:45.587882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09223a-bba2-4a47-8008-07cdd333c88c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:45.588479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd09223a-bba2-4a47-8008-07cdd333c88c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:45.597644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09223a-bba2-4a47-8008-07cdd333c88c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:45.599650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd09223a-bba2-4a47-8008-07cdd333c88c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-cd09223a-bba2-4a47-8008-07cdd333c88c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:45.629636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:45.631470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:45.632398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:45.632398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:45.632398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:45.632398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:45.632398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:45.632398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:45.632398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:45.632398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:45.632398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:04:45.632398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:45.635094 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 275/557] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 19:04:45 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:45.640816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09223a-bba2-4a47-8008-07cdd333c88c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:45.720546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba0e0d5-42ae-4c5e-9432-ae9a1663b4d6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:45.757375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278910a1-6042-4d7e-8e50-5186a4aad830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:45.758043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278910a1-6042-4d7e-8e50-5186a4aad830 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:45.758317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278910a1-6042-4d7e-8e50-5186a4aad830 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:45.758586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278910a1-6042-4d7e-8e50-5186a4aad830 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:45.759324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278910a1-6042-4d7e-8e50-5186a4aad830 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:45.759626 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278910a1-6042-4d7e-8e50-5186a4aad830 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:45.761349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278910a1-6042-4d7e-8e50-5186a4aad830 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:45.782126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 283/558] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 15 19:04:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:45.783399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af61fae-5c4c-4245-bbc5-f558edc4d01e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:45.783677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af61fae-5c4c-4245-bbc5-f558edc4d01e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:45.783940 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af61fae-5c4c-4245-bbc5-f558edc4d01e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:45.789155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 284/559] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:45.789155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af61fae-5c4c-4245-bbc5-f558edc4d01e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:45.821629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:45.830492 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd09223a-bba2-4a47-8008-07cdd333c88c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:45.867397 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb771db-fc43-46ac-88fc-13fcf583bc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:45.867998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb771db-fc43-46ac-88fc-13fcf583bc1c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:45.868218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb771db-fc43-46ac-88fc-13fcf583bc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:45.868487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb771db-fc43-46ac-88fc-13fcf583bc1c None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:45.869219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb771db-fc43-46ac-88fc-13fcf583bc1c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:45.869523 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb771db-fc43-46ac-88fc-13fcf583bc1c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:45.871121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb771db-fc43-46ac-88fc-13fcf583bc1c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:45.889592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:45.893998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 276/560] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 19:04:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:45.895365 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebfc28-0938-4e7d-92bb-3a7ba74c1039 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:45.895712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebfc28-0938-4e7d-92bb-3a7ba74c1039 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:45.895988 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcebfc28-0938-4e7d-92bb-3a7ba74c1039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:45.917533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-bcebfc28-0938-4e7d-92bb-3a7ba74c1039 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:45.918766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bcebfc28-0938-4e7d-92bb-3a7ba74c1039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:45.921060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af61fae-5c4c-4245-bbc5-f558edc4d01e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:45.971537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c349ae-1dcd-470c-b48b-2a8c57b86e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:45.972595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c349ae-1dcd-470c-b48b-2a8c57b86e45 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:45.972944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c349ae-1dcd-470c-b48b-2a8c57b86e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:45.973308 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c349ae-1dcd-470c-b48b-2a8c57b86e45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:46.004011 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 277/561] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:46.006857 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebfc28-0938-4e7d-92bb-3a7ba74c1039 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:46.068223 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c349ae-1dcd-470c-b48b-2a8c57b86e45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:46.069732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c349ae-1dcd-470c-b48b-2a8c57b86e45 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:46.104596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:46.133968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcebfc28-0938-4e7d-92bb-3a7ba74c1039 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:46.178299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:46.187057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f90d8-b57f-4ceb-9a86-b28e54576181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:46.188188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f90d8-b57f-4ceb-9a86-b28e54576181 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:46.188646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f90d8-b57f-4ceb-9a86-b28e54576181 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:46.189166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f90d8-b57f-4ceb-9a86-b28e54576181 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:46.203611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f90d8-b57f-4ceb-9a86-b28e54576181 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:46.205471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82f90d8-b57f-4ceb-9a86-b28e54576181 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:46.211730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 285/562] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:46.212685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c349ae-1dcd-470c-b48b-2a8c57b86e45 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-f82f90d8-b57f-4ceb-9a86-b28e54576181 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:46.226869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:46.227946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:46.228885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:46.228885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:46.228885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:46.230710 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 278/563] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:46.236046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f90d8-b57f-4ceb-9a86-b28e54576181 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:46.336051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c349ae-1dcd-470c-b48b-2a8c57b86e45 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:46.361658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:46.371062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82f90d8-b57f-4ceb-9a86-b28e54576181 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:46.377214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212e1e7-dcbc-49b3-ab08-ddd6b2d66f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:46.377896 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212e1e7-dcbc-49b3-ab08-ddd6b2d66f16 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:46.378173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212e1e7-dcbc-49b3-ab08-ddd6b2d66f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:46.378866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5212e1e7-dcbc-49b3-ab08-ddd6b2d66f16 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:46.390713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5212e1e7-dcbc-49b3-ab08-ddd6b2d66f16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-5212e1e7-dcbc-49b3-ab08-ddd6b2d66f16 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:46.396232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:46.397350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:46.398446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:46.398446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:46.398446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:46.398446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:46.398446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:46.398446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:46.398446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:46.398446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:46.398446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:46.398446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:46.398446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:46.398446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:46.398446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 286/564] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:46.399277 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212e1e7-dcbc-49b3-ab08-ddd6b2d66f16 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:46.414067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c306b44d-373b-4358-bb05-dcd7edb407ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:46.414718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306b44d-373b-4358-bb05-dcd7edb407ae None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:46.414996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306b44d-373b-4358-bb05-dcd7edb407ae None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:46.415267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c306b44d-373b-4358-bb05-dcd7edb407ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:46.427698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306b44d-373b-4358-bb05-dcd7edb407ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:46.428988 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c306b44d-373b-4358-bb05-dcd7edb407ae None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c306b44d-373b-4358-bb05-dcd7edb407ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:46.443510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:46.444509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:46.445394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:46.445394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:46.445394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:46.445394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 279/565] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:46.450831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce479296-f7ee-4137-aa13-eaff9dfd5780 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:46.450831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce479296-f7ee-4137-aa13-eaff9dfd5780 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:46.450831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce479296-f7ee-4137-aa13-eaff9dfd5780 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:46.450831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 280/566] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:46 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:46.450831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce479296-f7ee-4137-aa13-eaff9dfd5780 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:46.488011 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:46.507181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5212e1e7-dcbc-49b3-ab08-ddd6b2d66f16 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:46.546825 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6c0e4-5451-4bc2-8628-836b586e4251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:46.547509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6c0e4-5451-4bc2-8628-836b586e4251 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:46.547784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6c0e4-5451-4bc2-8628-836b586e4251 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:46.548029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6c0e4-5451-4bc2-8628-836b586e4251 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:46.548687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6c0e4-5451-4bc2-8628-836b586e4251 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:46.548986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6c0e4-5451-4bc2-8628-836b586e4251 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:46.550456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6c0e4-5451-4bc2-8628-836b586e4251 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:46.562621 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce479296-f7ee-4137-aa13-eaff9dfd5780 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:46.564143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 287/567] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:46.566819 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6c0e4-5451-4bc2-8628-836b586e4251 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:46.600322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac996f-e9d5-4ee7-83d7-adfbb7326105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:46.600970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac996f-e9d5-4ee7-83d7-adfbb7326105 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:46.601242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac996f-e9d5-4ee7-83d7-adfbb7326105 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:46.601509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baac996f-e9d5-4ee7-83d7-adfbb7326105 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:46.617685 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baac996f-e9d5-4ee7-83d7-adfbb7326105 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:46.618247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-baac996f-e9d5-4ee7-83d7-adfbb7326105 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:46.625910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:46.627056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:46.627886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:46.627886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:46.627886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:46.627886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:46.627886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:46.627886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:46.627886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:46.627886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:46.627886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:46.627886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:46.627886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:46.627886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:46.627886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 281/568] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:46.628738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac996f-e9d5-4ee7-83d7-adfbb7326105 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:46.685983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6c0e4-5451-4bc2-8628-836b586e4251 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:46.737770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d58a24c-9dde-4f49-914e-7b6571d69ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:46.738402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58a24c-9dde-4f49-914e-7b6571d69ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:46.738674 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58a24c-9dde-4f49-914e-7b6571d69ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:46.738941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d58a24c-9dde-4f49-914e-7b6571d69ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:46.739760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58a24c-9dde-4f49-914e-7b6571d69ad3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:46.739973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:46.740122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58a24c-9dde-4f49-914e-7b6571d69ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:46.741671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d58a24c-9dde-4f49-914e-7b6571d69ad3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:46.748899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baac996f-e9d5-4ee7-83d7-adfbb7326105 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:46.750309 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 288/569] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:46.751523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf409-1ba3-4785-8d07-9ad143b2fe31 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:46.751786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf409-1ba3-4785-8d07-9ad143b2fe31 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:46.752054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dcf409-1ba3-4785-8d07-9ad143b2fe31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:46.770121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-63dcf409-1ba3-4785-8d07-9ad143b2fe31 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:46.771473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-63dcf409-1ba3-4785-8d07-9ad143b2fe31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:46.786700 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d4e5f-e833-4247-97a1-848027de95b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:46.787320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d4e5f-e833-4247-97a1-848027de95b6 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:46.787595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d4e5f-e833-4247-97a1-848027de95b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:46.787866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d4e5f-e833-4247-97a1-848027de95b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:46.788506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d4e5f-e833-4247-97a1-848027de95b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:46.788807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d4e5f-e833-4247-97a1-848027de95b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:46.790228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592d4e5f-e833-4247-97a1-848027de95b6 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:46.802396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 282/570] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:46.803259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d4e5f-e833-4247-97a1-848027de95b6 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:46.845804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 289/571] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:46.847126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcf409-1ba3-4785-8d07-9ad143b2fe31 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:46.884785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:46.909333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d4e5f-e833-4247-97a1-848027de95b6 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:46.946074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5547f-15b5-45e5-b14f-507633fd0b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:46.946716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5547f-15b5-45e5-b14f-507633fd0b02 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:46.946990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5547f-15b5-45e5-b14f-507633fd0b02 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:46.947320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb5547f-15b5-45e5-b14f-507633fd0b02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:46.954680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5547f-15b5-45e5-b14f-507633fd0b02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:46.956343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb5547f-15b5-45e5-b14f-507633fd0b02 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:46.959131 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dcf409-1ba3-4785-8d07-9ad143b2fe31 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ddb5547f-15b5-45e5-b14f-507633fd0b02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:46.968638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:46.969771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:46.971032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:46.971032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:46.971032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:46.971032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:46.971032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:46.971032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:46.971032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:46.971032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:46.971763 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 283/572] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:46.972930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5547f-15b5-45e5-b14f-507633fd0b02 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:46.992793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:47.002833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17fdcf-b0a3-4de9-a214-1e9f398879e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:47.003457 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17fdcf-b0a3-4de9-a214-1e9f398879e7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:47.003741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17fdcf-b0a3-4de9-a214-1e9f398879e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:47.004007 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c17fdcf-b0a3-4de9-a214-1e9f398879e7 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:47.004739 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17fdcf-b0a3-4de9-a214-1e9f398879e7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:47.005004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17fdcf-b0a3-4de9-a214-1e9f398879e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:47.006407 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c17fdcf-b0a3-4de9-a214-1e9f398879e7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:47.014838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 290/573] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:47.015287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17fdcf-b0a3-4de9-a214-1e9f398879e7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:47.092411 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb5547f-15b5-45e5-b14f-507633fd0b02 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:47.115840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:47.122185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c17fdcf-b0a3-4de9-a214-1e9f398879e7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:47.130198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc5157-0230-4801-ba0c-c16fac47ec57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:47.131043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc5157-0230-4801-ba0c-c16fac47ec57 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:47.131343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc5157-0230-4801-ba0c-c16fac47ec57 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:47.131614 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30cc5157-0230-4801-ba0c-c16fac47ec57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:47.143605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc5157-0230-4801-ba0c-c16fac47ec57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:47.145045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30cc5157-0230-4801-ba0c-c16fac47ec57 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:47.155587 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91877941-9705-4018-bbfc-401a0a070e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:47.156226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91877941-9705-4018-bbfc-401a0a070e87 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:47.156506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91877941-9705-4018-bbfc-401a0a070e87 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:47.156776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91877941-9705-4018-bbfc-401a0a070e87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-30cc5157-0230-4801-ba0c-c16fac47ec57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:47.159716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:47.160847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:47.162080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:47.162080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:47.162080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:47.163858 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91877941-9705-4018-bbfc-401a0a070e87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:47.165296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91877941-9705-4018-bbfc-401a0a070e87 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:47.165901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 284/574] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:47.166800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc5157-0230-4801-ba0c-c16fac47ec57 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-91877941-9705-4018-bbfc-401a0a070e87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:47.176982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:47.178198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:47.179072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:47.179072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:47.179072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:47.179072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:47.179072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:47.179072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:47.179072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:47.179072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:47.179072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 291/575] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:47.179072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91877941-9705-4018-bbfc-401a0a070e87 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:47.239657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:47.275409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30cc5157-0230-4801-ba0c-c16fac47ec57 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:47.278621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91877941-9705-4018-bbfc-401a0a070e87 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:47.314107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3e617-0c8e-4836-a574-e5d971bdaa2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:47.315137 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e617-0c8e-4836-a574-e5d971bdaa2b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:47.315630 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e617-0c8e-4836-a574-e5d971bdaa2b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:47.316095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e617-0c8e-4836-a574-e5d971bdaa2b None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:47.316188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51815d3-283a-4501-9303-929a9743368b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:47.316745 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51815d3-283a-4501-9303-929a9743368b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:47.317029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51815d3-283a-4501-9303-929a9743368b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:47.317314 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51815d3-283a-4501-9303-929a9743368b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:47.317442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3e617-0c8e-4836-a574-e5d971bdaa2b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:47.317973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3e617-0c8e-4836-a574-e5d971bdaa2b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:47.320666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da3e617-0c8e-4836-a574-e5d971bdaa2b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:47.329427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51815d3-283a-4501-9303-929a9743368b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:47.330913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51815d3-283a-4501-9303-929a9743368b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:47.335227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 285/576] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:47.336076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3e617-0c8e-4836-a574-e5d971bdaa2b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-a51815d3-283a-4501-9303-929a9743368b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:47.347213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:47.348349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:47.349326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:47.349326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:47.349326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:47.349326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 292/577] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:47.349326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51815d3-283a-4501-9303-929a9743368b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:47.361379 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:47.448644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3e617-0c8e-4836-a574-e5d971bdaa2b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:47.459274 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51815d3-283a-4501-9303-929a9743368b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:47.475858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:47.485361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dd820-7d3c-4351-93e4-cea350a1e9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:47.486056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dd820-7d3c-4351-93e4-cea350a1e9b3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:47.486326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dd820-7d3c-4351-93e4-cea350a1e9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:47.486586 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4dd820-7d3c-4351-93e4-cea350a1e9b3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:47.496575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d6aae-06f1-4270-9417-2760674becbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:47.497202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d6aae-06f1-4270-9417-2760674becbc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:47.497482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d6aae-06f1-4270-9417-2760674becbc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:47.497753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7d6aae-06f1-4270-9417-2760674becbc None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:47.498168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c4dd820-7d3c-4351-93e4-cea350a1e9b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:47.498582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d6aae-06f1-4270-9417-2760674becbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:47.498887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d6aae-06f1-4270-9417-2760674becbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:47.500305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7d6aae-06f1-4270-9417-2760674becbc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-1c4dd820-7d3c-4351-93e4-cea350a1e9b3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:47.503098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:47.504059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:47.504933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:47.504933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:47.504933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:47.504933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:47.504933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:47.504933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:47.504933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:47.504933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:47.504933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:47.504933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:47.504933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:47.504933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:47.504933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 286/578] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:47 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:47.505617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dd820-7d3c-4351-93e4-cea350a1e9b3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:47.514955 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 293/579] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:47.515809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d6aae-06f1-4270-9417-2760674becbc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:47.587189 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:47.614832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4dd820-7d3c-4351-93e4-cea350a1e9b3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:47.621890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7d6aae-06f1-4270-9417-2760674becbc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:47.651254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92cd48-6dff-4e0e-ad95-db832a92f7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:47.651877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92cd48-6dff-4e0e-ad95-db832a92f7bc None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:47.652154 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92cd48-6dff-4e0e-ad95-db832a92f7bc None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:47.652426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b92cd48-6dff-4e0e-ad95-db832a92f7bc None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:47.653149 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92cd48-6dff-4e0e-ad95-db832a92f7bc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:47.653455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92cd48-6dff-4e0e-ad95-db832a92f7bc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:47.654942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b92cd48-6dff-4e0e-ad95-db832a92f7bc None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:47.659131 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb82391-a832-4cae-8fc8-92d675a8b5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:47.659807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82391-a832-4cae-8fc8-92d675a8b5f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:47.660082 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82391-a832-4cae-8fc8-92d675a8b5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:47.660352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb82391-a832-4cae-8fc8-92d675a8b5f8 None admin] PATH_INFO: `/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/38b19e4add2a4321a2fbfeb9a3a1b61d/roles/4f6a1ac8e24d4fbbb77c428a26d085ac` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:47.667263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 287/580] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:47.668103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92cd48-6dff-4e0e-ad95-db832a92f7bc None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:47.676593 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82391-a832-4cae-8fc8-92d675a8b5f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=2958a115e7974fc4b5c74a633fc4322c, user_id=38b19e4add2a4321a2fbfeb9a3a1b61d, role_id=4f6a1ac8e24d4fbbb77c428a26d085ac)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:47.678394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb82391-a832-4cae-8fc8-92d675a8b5f8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:47.693933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 294/581] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:04:47 2022] PUT /identity/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/38b19e4add2a4321a2fbfeb9a3a1b61d/roles/4f6a1ac8e24d4fbbb77c428a26d085ac => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:04:47.694816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb82391-a832-4cae-8fc8-92d675a8b5f8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:47.754623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:47.814706 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb82391-a832-4cae-8fc8-92d675a8b5f8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:47.823144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b92cd48-6dff-4e0e-ad95-db832a92f7bc None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:47.835773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:47.861548 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba5a78-9fbd-41f1-a084-c9ea99230dc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:47.862246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba5a78-9fbd-41f1-a084-c9ea99230dc0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:47.862523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba5a78-9fbd-41f1-a084-c9ea99230dc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:47.862793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ba5a78-9fbd-41f1-a084-c9ea99230dc0 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:47.863485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba5a78-9fbd-41f1-a084-c9ea99230dc0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:47.863787 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba5a78-9fbd-41f1-a084-c9ea99230dc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:47.865547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ba5a78-9fbd-41f1-a084-c9ea99230dc0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:47.865698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55249b-0baf-4092-8009-6b858405cf53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:47.866352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55249b-0baf-4092-8009-6b858405cf53 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:47.866634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55249b-0baf-4092-8009-6b858405cf53 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:47.866906 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f55249b-0baf-4092-8009-6b858405cf53 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:47.867692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55249b-0baf-4092-8009-6b858405cf53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:47.867999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55249b-0baf-4092-8009-6b858405cf53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:47.869424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f55249b-0baf-4092-8009-6b858405cf53 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:47.880523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 295/582] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:47 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:47.880523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba5a78-9fbd-41f1-a084-c9ea99230dc0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:47.888193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 288/583] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:47.890317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55249b-0baf-4092-8009-6b858405cf53 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:47.999628 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ba5a78-9fbd-41f1-a084-c9ea99230dc0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:48.001626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f55249b-0baf-4092-8009-6b858405cf53 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:48.011424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:48.041237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b817fb-0d44-4831-8042-6f697f5fce82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:48.041494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019a90d-44d4-4316-ab78-3d4f71ed904e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:48.041917 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b817fb-0d44-4831-8042-6f697f5fce82 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:48.042036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a90d-44d4-4316-ab78-3d4f71ed904e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:48.042195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b817fb-0d44-4831-8042-6f697f5fce82 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:48.042291 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a90d-44d4-4316-ab78-3d4f71ed904e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:48.042449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b817fb-0d44-4831-8042-6f697f5fce82 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:48.042556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5019a90d-44d4-4316-ab78-3d4f71ed904e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:48.043277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019a90d-44d4-4316-ab78-3d4f71ed904e None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=3940f3578cc44d4d8ebe074216a65f2e) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:48.043593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019a90d-44d4-4316-ab78-3d4f71ed904e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:48.046017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5019a90d-44d4-4316-ab78-3d4f71ed904e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:48.050958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b817fb-0d44-4831-8042-6f697f5fce82 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:48.052477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b817fb-0d44-4831-8042-6f697f5fce82 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:48.062078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 289/584] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:47 2022] GET /identity/v3/role_assignments?user.id=3940f3578cc44d4d8ebe074216a65f2e&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:48.062078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019a90d-44d4-4316-ab78-3d4f71ed904e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-67b817fb-0d44-4831-8042-6f697f5fce82 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:48.075681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:48.076935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:48.078094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:48.078094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:48.078094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:48.078094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:48.078094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:48.078094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:48.078094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:48.078094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:48.078094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 19:04:48.078094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:48.078094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 296/585] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:47 2022] GET /identity/v3/users/glance => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:48.078791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b817fb-0d44-4831-8042-6f697f5fce82 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:48.129609 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:48.189197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5019a90d-44d4-4316-ab78-3d4f71ed904e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:48.209117 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b817fb-0d44-4831-8042-6f697f5fce82 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:48.239742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c04e9-d44d-461f-ad00-33d5649783be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:48.240927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c04e9-d44d-461f-ad00-33d5649783be None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:48.241309 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c04e9-d44d-461f-ad00-33d5649783be None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:48.242088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703c04e9-d44d-461f-ad00-33d5649783be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:48.253733 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67267567-38b7-4cd5-a579-7950500acaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:48.254529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67267567-38b7-4cd5-a579-7950500acaa6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:48.254907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67267567-38b7-4cd5-a579-7950500acaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:48.255183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67267567-38b7-4cd5-a579-7950500acaa6 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:48.257443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c04e9-d44d-461f-ad00-33d5649783be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:48.260115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703c04e9-d44d-461f-ad00-33d5649783be None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:48.266498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67267567-38b7-4cd5-a579-7950500acaa6 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:48.268060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67267567-38b7-4cd5-a579-7950500acaa6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-703c04e9-d44d-461f-ad00-33d5649783be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:48.280013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:48.281209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:48.282113 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:48.282113 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:48.282113 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:48.282483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 290/586] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:48.283662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c04e9-d44d-461f-ad00-33d5649783be None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-67267567-38b7-4cd5-a579-7950500acaa6 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:48.286549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:48.288190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:48.289353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:48.289353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:48.289353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:48.289353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:48.289353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:48.289353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:48.289353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:48.289353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:48.289353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 19:04:48.289353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:48.295134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 297/587] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:48 2022] GET /identity/v3/users/cinder => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:48.297774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67267567-38b7-4cd5-a579-7950500acaa6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:48.330872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:48.417734 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:48.421447 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67267567-38b7-4cd5-a579-7950500acaa6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:48.428537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703c04e9-d44d-461f-ad00-33d5649783be None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:48.459197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcdddc-df80-4105-aae0-b3b8410229f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:48.460502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcdddc-df80-4105-aae0-b3b8410229f5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:48.461276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcdddc-df80-4105-aae0-b3b8410229f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:48.461708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbcdddc-df80-4105-aae0-b3b8410229f5 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:48.462536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcdddc-df80-4105-aae0-b3b8410229f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:48.462978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcdddc-df80-4105-aae0-b3b8410229f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:48.464543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cbcdddc-df80-4105-aae0-b3b8410229f5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:48.471690 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaedf00-4b22-4982-99a1-7b6edfd58713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:48.472790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaedf00-4b22-4982-99a1-7b6edfd58713 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:48.473180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaedf00-4b22-4982-99a1-7b6edfd58713 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:48.473899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffaedf00-4b22-4982-99a1-7b6edfd58713 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:48.474466 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaedf00-4b22-4982-99a1-7b6edfd58713 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:48.474869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaedf00-4b22-4982-99a1-7b6edfd58713 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:48.477060 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffaedf00-4b22-4982-99a1-7b6edfd58713 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:48.485698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 298/588] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:48.487753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcdddc-df80-4105-aae0-b3b8410229f5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:48.504012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 291/589] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 15 19:04:48 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:48.504012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaedf00-4b22-4982-99a1-7b6edfd58713 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:48.608480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:48.610261 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbcdddc-df80-4105-aae0-b3b8410229f5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:48.633374 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffaedf00-4b22-4982-99a1-7b6edfd58713 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:48.657120 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa029-44a4-4419-8b55-90009960128e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:48.657913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa029-44a4-4419-8b55-90009960128e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:48.658185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa029-44a4-4419-8b55-90009960128e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:48.658522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f90fa029-44a4-4419-8b55-90009960128e None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:48.659247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fa029-44a4-4419-8b55-90009960128e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:48.659551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fa029-44a4-4419-8b55-90009960128e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:48.661474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f90fa029-44a4-4419-8b55-90009960128e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:48.674111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856b3b3-d9a2-4696-9939-cb3b81532887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:48.675118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856b3b3-d9a2-4696-9939-cb3b81532887 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:48.675601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856b3b3-d9a2-4696-9939-cb3b81532887 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:48.676071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b856b3b3-d9a2-4696-9939-cb3b81532887 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:48.684455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856b3b3-d9a2-4696-9939-cb3b81532887 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:48.686275 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b856b3b3-d9a2-4696-9939-cb3b81532887 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:48.686812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 299/590] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 15 19:04:48 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:48.687924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa029-44a4-4419-8b55-90009960128e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-b856b3b3-d9a2-4696-9939-cb3b81532887 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:48.700952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:48.702021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:48.702977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:48.702977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:48.702977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:48.702977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:48.702977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:48.702977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:48.702977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:48.702977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:48.702977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 19:04:48.702977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:48.710481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 292/591] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:48 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:48.711315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:48.712332 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856b3b3-d9a2-4696-9939-cb3b81532887 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:48.806558 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f90fa029-44a4-4419-8b55-90009960128e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:48.818400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b856b3b3-d9a2-4696-9939-cb3b81532887 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:48.850642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbe954-1336-4289-aff2-d94a3cb471e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:48.851571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbe954-1336-4289-aff2-d94a3cb471e9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:48.851848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbe954-1336-4289-aff2-d94a3cb471e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:48.852124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbe954-1336-4289-aff2-d94a3cb471e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:48.858415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7b820-41be-4674-9ac6-691a1bf19065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:48.859128 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7b820-41be-4674-9ac6-691a1bf19065 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:48.859346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7b820-41be-4674-9ac6-691a1bf19065 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:48.859656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc7b820-41be-4674-9ac6-691a1bf19065 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:48.865746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbe954-1336-4289-aff2-d94a3cb471e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:48.867289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbe954-1336-4289-aff2-d94a3cb471e9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:48.871084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:48.874078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7b820-41be-4674-9ac6-691a1bf19065 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:48.875801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc7b820-41be-4674-9ac6-691a1bf19065 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8abbe954-1336-4289-aff2-d94a3cb471e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:48.886590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:48.887803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:48.888698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:48.888698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:48.888698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:48.888698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 300/592] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:48.888698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbe954-1336-4289-aff2-d94a3cb471e9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-8bc7b820-41be-4674-9ac6-691a1bf19065 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:48.902237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:48.903268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:48.904160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:48.904160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:48.904160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:48.908236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 293/593] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:48.908986 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7b820-41be-4674-9ac6-691a1bf19065 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:48.973431 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:49.011172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbe954-1336-4289-aff2-d94a3cb471e9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:49.029323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc7b820-41be-4674-9ac6-691a1bf19065 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:49.047735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f367e9d-f576-447f-b68a-8755d0ee74fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:49.048356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f367e9d-f576-447f-b68a-8755d0ee74fa None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:49.048632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f367e9d-f576-447f-b68a-8755d0ee74fa None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:49.049204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f367e9d-f576-447f-b68a-8755d0ee74fa None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:49.049635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f367e9d-f576-447f-b68a-8755d0ee74fa None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:49.049974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f367e9d-f576-447f-b68a-8755d0ee74fa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:49.051463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f367e9d-f576-447f-b68a-8755d0ee74fa None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:49.076448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 301/594] 10.222.0.25 () {56 vars in 1139 bytes} [Thu Sep 15 19:04:48 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:49.076448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f367e9d-f576-447f-b68a-8755d0ee74fa None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:49.080693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4656a-4c2e-4048-9191-f21969a24088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:49.081563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4656a-4c2e-4048-9191-f21969a24088 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:49.082055 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4656a-4c2e-4048-9191-f21969a24088 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:49.082533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b4656a-4c2e-4048-9191-f21969a24088 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:49.084330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4656a-4c2e-4048-9191-f21969a24088 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:49.084879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4656a-4c2e-4048-9191-f21969a24088 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:49.087188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b4656a-4c2e-4048-9191-f21969a24088 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:49.108273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 294/595] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:49.108273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4656a-4c2e-4048-9191-f21969a24088 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:49.162434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:49.210692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b4656a-4c2e-4048-9191-f21969a24088 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:49.216809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f367e9d-f576-447f-b68a-8755d0ee74fa None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:49.247915 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7862086-c2f2-461b-9414-ac96f33f68bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:49.248483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7862086-c2f2-461b-9414-ac96f33f68bc None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:49.248868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7862086-c2f2-461b-9414-ac96f33f68bc None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:49.249225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7862086-c2f2-461b-9414-ac96f33f68bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:49.251815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:49.262779 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7a3d7-b8b5-4021-a42a-4d7a870e7376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:49.263410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7a3d7-b8b5-4021-a42a-4d7a870e7376 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:49.263687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7a3d7-b8b5-4021-a42a-4d7a870e7376 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:49.263962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a7a3d7-b8b5-4021-a42a-4d7a870e7376 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:49.264338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7862086-c2f2-461b-9414-ac96f33f68bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:49.264613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7a3d7-b8b5-4021-a42a-4d7a870e7376 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:49.264916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7a3d7-b8b5-4021-a42a-4d7a870e7376 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:49.266414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a7a3d7-b8b5-4021-a42a-4d7a870e7376 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:49.266771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7862086-c2f2-461b-9414-ac96f33f68bc None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:49.283727 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 302/596] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:49.284971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7a3d7-b8b5-4021-a42a-4d7a870e7376 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-a7862086-c2f2-461b-9414-ac96f33f68bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:49.288592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:49.289522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:49.290447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:49.290447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:49.290447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:49.296958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 295/597] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:49.296958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7862086-c2f2-461b-9414-ac96f33f68bc None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:49.424375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a7a3d7-b8b5-4021-a42a-4d7a870e7376 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:49.426364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7862086-c2f2-461b-9414-ac96f33f68bc None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:49.430008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:49.464838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782a15f-59e0-4a4d-a2eb-6d0a7dc8098e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:49.465485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782a15f-59e0-4a4d-a2eb-6d0a7dc8098e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:49.465753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782a15f-59e0-4a4d-a2eb-6d0a7dc8098e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:49.466055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9782a15f-59e0-4a4d-a2eb-6d0a7dc8098e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:49.474516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782a15f-59e0-4a4d-a2eb-6d0a7dc8098e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:49.474852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb529e-a4d2-4593-824b-d61ced534ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:49.475975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9782a15f-59e0-4a4d-a2eb-6d0a7dc8098e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:49.476310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb529e-a4d2-4593-824b-d61ced534ca5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:49.476892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb529e-a4d2-4593-824b-d61ced534ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:49.477308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bb529e-a4d2-4593-824b-d61ced534ca5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:49.486089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb529e-a4d2-4593-824b-d61ced534ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:49.488349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bb529e-a4d2-4593-824b-d61ced534ca5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9782a15f-59e0-4a4d-a2eb-6d0a7dc8098e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:49.490259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:49.491334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:49.492485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:49.492485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:49.492485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:49.492485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:49.492485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:49.492485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:49.492485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:49.492485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:49.499206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 303/598] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:49.499206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782a15f-59e0-4a4d-a2eb-6d0a7dc8098e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-82bb529e-a4d2-4593-824b-d61ced534ca5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:49.512447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:49.513611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:49.514775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:49.514775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:49.514775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:49.514775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:49.514775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:49.514775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:49.514775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:49.514775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:49.517703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 296/599] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:49.518754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb529e-a4d2-4593-824b-d61ced534ca5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:49.559941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:49.618560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9782a15f-59e0-4a4d-a2eb-6d0a7dc8098e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:49.659815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bb529e-a4d2-4593-824b-d61ced534ca5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:49.664281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee99dc-54b3-4ccb-b06c-a83fa7665ad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:49.664760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee99dc-54b3-4ccb-b06c-a83fa7665ad2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:49.665037 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee99dc-54b3-4ccb-b06c-a83fa7665ad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:49.665303 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee99dc-54b3-4ccb-b06c-a83fa7665ad2 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:49.665987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee99dc-54b3-4ccb-b06c-a83fa7665ad2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:49.666343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee99dc-54b3-4ccb-b06c-a83fa7665ad2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:49.667799 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee99dc-54b3-4ccb-b06c-a83fa7665ad2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:49.686848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 304/600] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:49.686848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee99dc-54b3-4ccb-b06c-a83fa7665ad2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:49.718547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed92e21-37be-423d-aea1-17a3a43a290f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:49.719558 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed92e21-37be-423d-aea1-17a3a43a290f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:49.720031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed92e21-37be-423d-aea1-17a3a43a290f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:49.720739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed92e21-37be-423d-aea1-17a3a43a290f None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:49.722745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed92e21-37be-423d-aea1-17a3a43a290f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:49.723056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed92e21-37be-423d-aea1-17a3a43a290f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:49.724554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed92e21-37be-423d-aea1-17a3a43a290f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:49.743609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 297/601] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:49.743609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed92e21-37be-423d-aea1-17a3a43a290f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:49.778169 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:49.839284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee99dc-54b3-4ccb-b06c-a83fa7665ad2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:49.857504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:49.880160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed92e21-37be-423d-aea1-17a3a43a290f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:49.902617 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adb151-1c70-4ca9-8901-a358538b932d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:49.903338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adb151-1c70-4ca9-8901-a358538b932d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:49.903673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adb151-1c70-4ca9-8901-a358538b932d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:49.904029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29adb151-1c70-4ca9-8901-a358538b932d None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:49.905349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adb151-1c70-4ca9-8901-a358538b932d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:49.905736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adb151-1c70-4ca9-8901-a358538b932d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:49.907504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29adb151-1c70-4ca9-8901-a358538b932d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:49.929651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 305/602] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:49.929651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adb151-1c70-4ca9-8901-a358538b932d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:49.940956 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b64b1-43b7-495f-977d-ffd646b31b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:49.941987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b64b1-43b7-495f-977d-ffd646b31b40 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:49.942504 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b64b1-43b7-495f-977d-ffd646b31b40 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:49.943614 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b64b1-43b7-495f-977d-ffd646b31b40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:49.955316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b64b1-43b7-495f-977d-ffd646b31b40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:49.958168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b64b1-43b7-495f-977d-ffd646b31b40 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-da7b64b1-43b7-495f-977d-ffd646b31b40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:49.980102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:49.981126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:49.982053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:49.982053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:49.982053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:49.982053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:49.982053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:49.982053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:49.982053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:49.982053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:49.986141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 298/603] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:49.987843 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff769d92-9200-46bc-b3ba-45a93c7d18c1 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:49.988131 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff769d92-9200-46bc-b3ba-45a93c7d18c1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:49.988403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff769d92-9200-46bc-b3ba-45a93c7d18c1 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:49.990588 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 299/604] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:49.991118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff769d92-9200-46bc-b3ba-45a93c7d18c1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:50.046169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29adb151-1c70-4ca9-8901-a358538b932d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:50.083138 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4adc7-aa1a-44d5-93b3-436b6e8c3014 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:50.083983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4adc7-aa1a-44d5-93b3-436b6e8c3014 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:50.084253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4adc7-aa1a-44d5-93b3-436b6e8c3014 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:50.084371 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:50.084513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e4adc7-aa1a-44d5-93b3-436b6e8c3014 None admin] PATH_INFO: `/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/b06d8a144ecf43fc8de82346758b6065/roles/4f6a1ac8e24d4fbbb77c428a26d085ac` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:50.101555 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4adc7-aa1a-44d5-93b3-436b6e8c3014 None admin] RBAC: Authorizing `identity:create_grant(project_id=2958a115e7974fc4b5c74a633fc4322c, user_id=b06d8a144ecf43fc8de82346758b6065, role_id=4f6a1ac8e24d4fbbb77c428a26d085ac)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:50.103058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e4adc7-aa1a-44d5-93b3-436b6e8c3014 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:50.103166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff769d92-9200-46bc-b3ba-45a93c7d18c1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:50.122471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 306/605] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:04:49 2022] PUT /identity/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/b06d8a144ecf43fc8de82346758b6065/roles/4f6a1ac8e24d4fbbb77c428a26d085ac => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:04:50.123492 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4adc7-aa1a-44d5-93b3-436b6e8c3014 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:50.146391 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:50.150833 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1044c17f-2851-45ee-baae-0542ac066bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:50.151521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c17f-2851-45ee-baae-0542ac066bae None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:50.153059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c17f-2851-45ee-baae-0542ac066bae None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:50.153430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1044c17f-2851-45ee-baae-0542ac066bae None admin] PATH_INFO: `/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/677623b8ea5042ffa0169be83a7205d4/roles/4f6a1ac8e24d4fbbb77c428a26d085ac` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:50.178385 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044c17f-2851-45ee-baae-0542ac066bae None admin] RBAC: Authorizing `identity:create_grant(project_id=2958a115e7974fc4b5c74a633fc4322c, user_id=677623b8ea5042ffa0169be83a7205d4, role_id=4f6a1ac8e24d4fbbb77c428a26d085ac)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:50.181010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1044c17f-2851-45ee-baae-0542ac066bae None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:50.210219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 300/606] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:04:49 2022] PUT /identity/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/677623b8ea5042ffa0169be83a7205d4/roles/4f6a1ac8e24d4fbbb77c428a26d085ac => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:04:50.210219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c8fef-ad04-46fe-b8be-9647aa88564a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:50.210219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c8fef-ad04-46fe-b8be-9647aa88564a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:50.210219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c8fef-ad04-46fe-b8be-9647aa88564a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:50.252038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e02c8fef-ad04-46fe-b8be-9647aa88564a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:50.253280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e02c8fef-ad04-46fe-b8be-9647aa88564a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:50.316502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e4adc7-aa1a-44d5-93b3-436b6e8c3014 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:50.375300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50740bb-634e-4b70-a98a-8f24c428b721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:50.376262 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50740bb-634e-4b70-a98a-8f24c428b721 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:50.376603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50740bb-634e-4b70-a98a-8f24c428b721 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:50.376851 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50740bb-634e-4b70-a98a-8f24c428b721 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:50.377570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50740bb-634e-4b70-a98a-8f24c428b721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:50.377915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50740bb-634e-4b70-a98a-8f24c428b721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:50.379368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50740bb-634e-4b70-a98a-8f24c428b721 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:50.380179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 301/607] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:50.402434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 307/608] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:50.403877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73c6b9-2f51-4948-a7d5-156179403e4e None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:50.404166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73c6b9-2f51-4948-a7d5-156179403e4e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:50.404444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73c6b9-2f51-4948-a7d5-156179403e4e None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:50.406104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 302/609] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:04:50.410996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50740bb-634e-4b70-a98a-8f24c428b721 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:50.412223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ce537-af49-4e6e-9ccc-54094ca3c633 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:50.412532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ce537-af49-4e6e-9ccc-54094ca3c633 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:50.412831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9ce537-af49-4e6e-9ccc-54094ca3c633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:50.432753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-eb9ce537-af49-4e6e-9ccc-54094ca3c633 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:50.434062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-eb9ce537-af49-4e6e-9ccc-54094ca3c633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:50.515967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:50.526557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:50.530904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 303/610] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:04:50.548686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50740bb-634e-4b70-a98a-8f24c428b721 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:50.585209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f41d38-cae7-4fb9-bc0f-d3ee3ebacd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:50.586341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f41d38-cae7-4fb9-bc0f-d3ee3ebacd3b None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:50.586852 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f41d38-cae7-4fb9-bc0f-d3ee3ebacd3b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:50.587330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f41d38-cae7-4fb9-bc0f-d3ee3ebacd3b None admin] PATH_INFO: `/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/4591e01ab4954b22a81f6b09cdb2d544/roles/4f6a1ac8e24d4fbbb77c428a26d085ac` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:50.603945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f41d38-cae7-4fb9-bc0f-d3ee3ebacd3b None admin] RBAC: Authorizing `identity:create_grant(project_id=2958a115e7974fc4b5c74a633fc4322c, user_id=4591e01ab4954b22a81f6b09cdb2d544, role_id=4f6a1ac8e24d4fbbb77c428a26d085ac)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:50.605832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f41d38-cae7-4fb9-bc0f-d3ee3ebacd3b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:50.625731 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 308/611] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:04:50 2022] PUT /identity/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/4591e01ab4954b22a81f6b09cdb2d544/roles/4f6a1ac8e24d4fbbb77c428a26d085ac => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:04:50.714670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ce537-af49-4e6e-9ccc-54094ca3c633 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:50.851611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9ce537-af49-4e6e-9ccc-54094ca3c633 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:50.902957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f41d38-cae7-4fb9-bc0f-d3ee3ebacd3b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:50.903521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd066ce-f390-4a1e-8595-df4c1eb7151a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:50.904197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd066ce-f390-4a1e-8595-df4c1eb7151a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:50.904475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd066ce-f390-4a1e-8595-df4c1eb7151a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:50.904755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd066ce-f390-4a1e-8595-df4c1eb7151a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:50.917103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd066ce-f390-4a1e-8595-df4c1eb7151a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-cdd066ce-f390-4a1e-8595-df4c1eb7151a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:50.922014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:50.923075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:50.923907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:50.923907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:50.923907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:50.923907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:50.923907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:50.923907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:50.923907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:50.923907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:50.923907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:50.923907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:50.923907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:50.923907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:50.923907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 304/612] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:50.930883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd066ce-f390-4a1e-8595-df4c1eb7151a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:51.026632 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:51.032193 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f41d38-cae7-4fb9-bc0f-d3ee3ebacd3b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:51.062655 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:51.074194 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f570aa-b9e5-495a-abe2-a18669d764ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:51.074873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f570aa-b9e5-495a-abe2-a18669d764ba None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:51.075368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f570aa-b9e5-495a-abe2-a18669d764ba None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:51.075810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f570aa-b9e5-495a-abe2-a18669d764ba None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:51.090639 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f570aa-b9e5-495a-abe2-a18669d764ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-64f570aa-b9e5-495a-abe2-a18669d764ba None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:51.095707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:51.096658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:51.097879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:51.097879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:51.097879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:51.097879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:51.097879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:51.097879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:51.097879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:51.097879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:51.097879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:51.097879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:51.097879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:51.097879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:51.097879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 309/613] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:51.098688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd066ce-f390-4a1e-8595-df4c1eb7151a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:51.110951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f570aa-b9e5-495a-abe2-a18669d764ba None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:51.151862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7b7bf-77dc-45e5-ba18-6083d9a265ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:51.153629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b7bf-77dc-45e5-ba18-6083d9a265ea None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:51.155302 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b7bf-77dc-45e5-ba18-6083d9a265ea None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:51.155780 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae7b7bf-77dc-45e5-ba18-6083d9a265ea None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:51.156685 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7b7bf-77dc-45e5-ba18-6083d9a265ea None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:51.162402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7b7bf-77dc-45e5-ba18-6083d9a265ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:51.163728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ae7b7bf-77dc-45e5-ba18-6083d9a265ea None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:51.177264 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 305/614] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:51.188281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7b7bf-77dc-45e5-ba18-6083d9a265ea None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:51.270138 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f570aa-b9e5-495a-abe2-a18669d764ba None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:51.324369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcc842-71ef-434f-a1bc-bdf19cb1c8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:51.325000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcc842-71ef-434f-a1bc-bdf19cb1c8e0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:51.325281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcc842-71ef-434f-a1bc-bdf19cb1c8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:51.325551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afcc842-71ef-434f-a1bc-bdf19cb1c8e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:51.326262 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcc842-71ef-434f-a1bc-bdf19cb1c8e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:51.326566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcc842-71ef-434f-a1bc-bdf19cb1c8e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:51.327966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afcc842-71ef-434f-a1bc-bdf19cb1c8e0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:51.345823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 310/615] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:51.354118 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcc842-71ef-434f-a1bc-bdf19cb1c8e0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:51.401562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae7b7bf-77dc-45e5-ba18-6083d9a265ea None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:51.420435 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:51.447584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe85fe1-defb-4705-b75b-0332e0467ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:51.449254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe85fe1-defb-4705-b75b-0332e0467ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:51.449869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe85fe1-defb-4705-b75b-0332e0467ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:51.450151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe85fe1-defb-4705-b75b-0332e0467ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:51.477484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe85fe1-defb-4705-b75b-0332e0467ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:51.482737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe85fe1-defb-4705-b75b-0332e0467ce9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:51.491635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-4fe85fe1-defb-4705-b75b-0332e0467ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:51.507039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:51.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:51.509448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:51.509448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:51.509448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:51.518271 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 306/616] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:51.535774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe85fe1-defb-4705-b75b-0332e0467ce9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:51.562349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afcc842-71ef-434f-a1bc-bdf19cb1c8e0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:51.608070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5303644-233d-4603-acab-8039380814ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:51.608729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5303644-233d-4603-acab-8039380814ab None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:51.609007 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5303644-233d-4603-acab-8039380814ab None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:51.609282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5303644-233d-4603-acab-8039380814ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:51.637814 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5303644-233d-4603-acab-8039380814ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:51.639300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5303644-233d-4603-acab-8039380814ab None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b5303644-233d-4603-acab-8039380814ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:51.668229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:51.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:51.670144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:51.670144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:51.670144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:51.670144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 311/617] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:51.676360 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5303644-233d-4603-acab-8039380814ab None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:51.687486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe85fe1-defb-4705-b75b-0332e0467ce9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:51.725849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe16b5-6d2e-496f-a129-708490b7d43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:51.728973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe16b5-6d2e-496f-a129-708490b7d43c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:51.729266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe16b5-6d2e-496f-a129-708490b7d43c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:51.729540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebe16b5-6d2e-496f-a129-708490b7d43c None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:51.730300 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe16b5-6d2e-496f-a129-708490b7d43c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:51.730606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe16b5-6d2e-496f-a129-708490b7d43c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:51.732015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebe16b5-6d2e-496f-a129-708490b7d43c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:51.751109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 307/618] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:51.757657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe16b5-6d2e-496f-a129-708490b7d43c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:51.805689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:51.833188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5303644-233d-4603-acab-8039380814ab None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:51.835167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:51.883562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7543a8c-a79f-4050-b7f8-4c44d3b92f86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:51.884608 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7543a8c-a79f-4050-b7f8-4c44d3b92f86 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:51.885096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7543a8c-a79f-4050-b7f8-4c44d3b92f86 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:51.885559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7543a8c-a79f-4050-b7f8-4c44d3b92f86 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:51.886451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7543a8c-a79f-4050-b7f8-4c44d3b92f86 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:51.886973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7543a8c-a79f-4050-b7f8-4c44d3b92f86 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:51.888557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7543a8c-a79f-4050-b7f8-4c44d3b92f86 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:51.914986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 312/619] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:51.920865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7543a8c-a79f-4050-b7f8-4c44d3b92f86 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:51.948810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebe16b5-6d2e-496f-a129-708490b7d43c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:52.029287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b346d25-b660-4a12-acb8-60f6c17ba0fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:52.029984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346d25-b660-4a12-acb8-60f6c17ba0fe None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:52.030262 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346d25-b660-4a12-acb8-60f6c17ba0fe None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:52.030533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b346d25-b660-4a12-acb8-60f6c17ba0fe None admin] PATH_INFO: `/v3/users/nova` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:52.047019 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b346d25-b660-4a12-acb8-60f6c17ba0fe None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:52.048498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b346d25-b660-4a12-acb8-60f6c17ba0fe None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:52.069498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7543a8c-a79f-4050-b7f8-4c44d3b92f86 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-2b346d25-b660-4a12-acb8-60f6c17ba0fe None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:52.071475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:52.072424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:52.073396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:52.073396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:52.073396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:52.073396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:52.073396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:52.073396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:52.073396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:52.073396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:52.073396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:04:52.073396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:52.073396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 308/620] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 19:04:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:52.083073 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b346d25-b660-4a12-acb8-60f6c17ba0fe None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:52.117610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14771589-edb2-42f9-bed6-d34954df1a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:52.118716 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14771589-edb2-42f9-bed6-d34954df1a48 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:52.119230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14771589-edb2-42f9-bed6-d34954df1a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:52.119721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14771589-edb2-42f9-bed6-d34954df1a48 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:52.134716 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14771589-edb2-42f9-bed6-d34954df1a48 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:52.137369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14771589-edb2-42f9-bed6-d34954df1a48 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-14771589-edb2-42f9-bed6-d34954df1a48 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:52.164095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:52.165125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:52.166098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:52.166098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:52.166098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:52.166098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:52.166098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:52.166098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:52.166098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:52.166098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:52.166098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 19:04:52.166098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:52.170482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 313/621] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:04:51 2022] GET /identity/v3/users/swift => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:52.176254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14771589-edb2-42f9-bed6-d34954df1a48 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:52.206474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:52.236199 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:52.249675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b346d25-b660-4a12-acb8-60f6c17ba0fe None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:52.285042 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2e98f-2c29-4e4b-ab22-3b525b0f8153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:52.285678 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2e98f-2c29-4e4b-ab22-3b525b0f8153 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:52.286027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2e98f-2c29-4e4b-ab22-3b525b0f8153 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:52.286374 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e2e98f-2c29-4e4b-ab22-3b525b0f8153 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:52.287111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2e98f-2c29-4e4b-ab22-3b525b0f8153 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:52.287412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2e98f-2c29-4e4b-ab22-3b525b0f8153 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:52.288843 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e2e98f-2c29-4e4b-ab22-3b525b0f8153 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:52.296932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14771589-edb2-42f9-bed6-d34954df1a48 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:52.313940 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 309/622] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 19:04:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:52.318730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2e98f-2c29-4e4b-ab22-3b525b0f8153 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:52.342954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0130ff-75a5-429b-a7e8-e27fae68ab7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:52.344130 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0130ff-75a5-429b-a7e8-e27fae68ab7d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:52.344609 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0130ff-75a5-429b-a7e8-e27fae68ab7d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:52.345119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0130ff-75a5-429b-a7e8-e27fae68ab7d None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:52.346222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0130ff-75a5-429b-a7e8-e27fae68ab7d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:52.347127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0130ff-75a5-429b-a7e8-e27fae68ab7d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:52.348943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0130ff-75a5-429b-a7e8-e27fae68ab7d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:52.370047 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 314/623] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 15 19:04:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:04:52.395818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0130ff-75a5-429b-a7e8-e27fae68ab7d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:52.468540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e2e98f-2c29-4e4b-ab22-3b525b0f8153 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:52.504708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71c6be0-581b-44ce-a539-65649b025896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:52.505340 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c6be0-581b-44ce-a539-65649b025896 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:52.505617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c6be0-581b-44ce-a539-65649b025896 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:52.505912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71c6be0-581b-44ce-a539-65649b025896 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:52.522931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:52.583585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c6be0-581b-44ce-a539-65649b025896 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:52.585101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71c6be0-581b-44ce-a539-65649b025896 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:52.610091 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:52.657816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0130ff-75a5-429b-a7e8-e27fae68ab7d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:52.695116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0e3ee0-1c5b-442c-a368-06dc0978cb9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:52.695366 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 310/624] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:52.696159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e3ee0-1c5b-442c-a368-06dc0978cb9b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:52.696613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e3ee0-1c5b-442c-a368-06dc0978cb9b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:52.696801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae640d-0ff2-4765-9384-0ce4afbfef14 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:52.697084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae640d-0ff2-4765-9384-0ce4afbfef14 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:52.697315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0e3ee0-1c5b-442c-a368-06dc0978cb9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:52.697422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cae640d-0ff2-4765-9384-0ce4afbfef14 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:52.699203 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 311/625] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:52.700157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae640d-0ff2-4765-9384-0ce4afbfef14 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:52.710029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e3ee0-1c5b-442c-a368-06dc0978cb9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:52.711745 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0e3ee0-1c5b-442c-a368-06dc0978cb9b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-fc0e3ee0-1c5b-442c-a368-06dc0978cb9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:52.728140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:52.729345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:52.730557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:52.730557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:52.730557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:52.732301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 315/626] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:52.734094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c1572-8d4d-4ada-8e98-03d218f13e2d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:52.734585 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c1572-8d4d-4ada-8e98-03d218f13e2d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:52.735076 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438c1572-8d4d-4ada-8e98-03d218f13e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:52.754371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-438c1572-8d4d-4ada-8e98-03d218f13e2d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:52.756273 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-438c1572-8d4d-4ada-8e98-03d218f13e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:52.774219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:52.826805 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cae640d-0ff2-4765-9384-0ce4afbfef14 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:52.829810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 316/627] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:52.830938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c1572-8d4d-4ada-8e98-03d218f13e2d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:52.872677 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4a759-4589-4e50-8d4d-e7efa0887412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:52.873331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4a759-4589-4e50-8d4d-e7efa0887412 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:52.873601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4a759-4589-4e50-8d4d-e7efa0887412 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:52.873914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4a759-4589-4e50-8d4d-e7efa0887412 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:52.888163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4a759-4589-4e50-8d4d-e7efa0887412 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:52.889662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4a759-4589-4e50-8d4d-e7efa0887412 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:52.901222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-0fd4a759-4589-4e50-8d4d-e7efa0887412 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:52.910598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:52.911738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:52.912623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:52.912623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:52.912623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:52.916630 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 312/628] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:52.918836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4a759-4589-4e50-8d4d-e7efa0887412 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:52.964198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438c1572-8d4d-4ada-8e98-03d218f13e2d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:53.037378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c52e2-6cda-4345-9557-36bdd758da0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:53.038552 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c52e2-6cda-4345-9557-36bdd758da0e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:53.039054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c52e2-6cda-4345-9557-36bdd758da0e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:53.039532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193c52e2-6cda-4345-9557-36bdd758da0e None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:53.040499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c52e2-6cda-4345-9557-36bdd758da0e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:53.041009 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c52e2-6cda-4345-9557-36bdd758da0e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:53.045817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193c52e2-6cda-4345-9557-36bdd758da0e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:53.066982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 317/629] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:53.073296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c52e2-6cda-4345-9557-36bdd758da0e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:53.103168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:53.108527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4a759-4589-4e50-8d4d-e7efa0887412 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:53.147800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8f1be9-f3ea-456b-8d88-23064b1d78b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:53.148941 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f1be9-f3ea-456b-8d88-23064b1d78b1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:53.149358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f1be9-f3ea-456b-8d88-23064b1d78b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:53.149761 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8f1be9-f3ea-456b-8d88-23064b1d78b1 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:53.150731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f1be9-f3ea-456b-8d88-23064b1d78b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:53.151187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f1be9-f3ea-456b-8d88-23064b1d78b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:53.153633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8f1be9-f3ea-456b-8d88-23064b1d78b1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:53.169558 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 313/630] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:53.171529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400c557-e40b-41b0-a967-39d35894f8e6 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:53.171952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400c557-e40b-41b0-a967-39d35894f8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:53.172387 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400c557-e40b-41b0-a967-39d35894f8e6 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:53.175206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 314/631] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:53.176286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400c557-e40b-41b0-a967-39d35894f8e6 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:53.237816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193c52e2-6cda-4345-9557-36bdd758da0e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:53.264893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:53.278443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905f10a8-d974-4fba-88bd-ba2bcd4645c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:53.279086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f10a8-d974-4fba-88bd-ba2bcd4645c2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:53.279360 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f10a8-d974-4fba-88bd-ba2bcd4645c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:53.279628 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f10a8-d974-4fba-88bd-ba2bcd4645c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:53.287798 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f10a8-d974-4fba-88bd-ba2bcd4645c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:53.289195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-905f10a8-d974-4fba-88bd-ba2bcd4645c2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:53.297120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400c557-e40b-41b0-a967-39d35894f8e6 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-905f10a8-d974-4fba-88bd-ba2bcd4645c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:53.305596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:53.306827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:53.307946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:53.307946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:53.307946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:53.307946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:53.307946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:53.307946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:53.307946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:53.307946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:53.312451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 318/632] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:53.314742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48da17-7205-4af0-b33b-ad00affcfdc1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:53.315025 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48da17-7205-4af0-b33b-ad00affcfdc1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:53.315470 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48da17-7205-4af0-b33b-ad00affcfdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:53.335883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7f48da17-7205-4af0-b33b-ad00affcfdc1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:53.337080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7f48da17-7205-4af0-b33b-ad00affcfdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:53.341935 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cfc76-785b-4190-8ed2-cea68525a28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:53.342587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cfc76-785b-4190-8ed2-cea68525a28e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:53.342863 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cfc76-785b-4190-8ed2-cea68525a28e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:53.343133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60cfc76-785b-4190-8ed2-cea68525a28e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:53.351087 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cfc76-785b-4190-8ed2-cea68525a28e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:53.352565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e60cfc76-785b-4190-8ed2-cea68525a28e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-e60cfc76-785b-4190-8ed2-cea68525a28e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:53.364568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:53.365604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:53.371744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:53.371744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:53.371744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:53.371744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:53.371744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:53.371744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:53.371744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:53.371744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:53.371744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 315/633] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:53.371744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cfc76-785b-4190-8ed2-cea68525a28e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:53.390717 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:53.437809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 319/634] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:53.437809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48da17-7205-4af0-b33b-ad00affcfdc1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:53.486108 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60cfc76-785b-4190-8ed2-cea68525a28e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:53.521520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3b017-449d-4167-872d-805515daed38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:53.522345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3b017-449d-4167-872d-805515daed38 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:53.522729 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3b017-449d-4167-872d-805515daed38 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:53.523075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3b017-449d-4167-872d-805515daed38 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:53.533806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f3b017-449d-4167-872d-805515daed38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-16f3b017-449d-4167-872d-805515daed38 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:53.539604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:53.540570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:53.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:53.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:53.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:53.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:53.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:53.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:53.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:53.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:53.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:53.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:53.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:53.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:53.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 316/635] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:53.542139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3b017-449d-4167-872d-805515daed38 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:53.547577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48da17-7205-4af0-b33b-ad00affcfdc1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:53.562200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:53.586773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f5c08b-b03c-44b4-8570-68fb1cd73fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:53.587395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5c08b-b03c-44b4-8570-68fb1cd73fda None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:53.587669 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5c08b-b03c-44b4-8570-68fb1cd73fda None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:53.587937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f5c08b-b03c-44b4-8570-68fb1cd73fda None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:53.588746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5c08b-b03c-44b4-8570-68fb1cd73fda None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:53.589062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5c08b-b03c-44b4-8570-68fb1cd73fda None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:53.590656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f5c08b-b03c-44b4-8570-68fb1cd73fda None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:53.608317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 320/636] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:53.608317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cb373-4419-4ad6-81b4-4f47731ca647 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:53.608317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cb373-4419-4ad6-81b4-4f47731ca647 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:53.608317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0cb373-4419-4ad6-81b4-4f47731ca647 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:53.608317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 321/637] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:53.608317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cb373-4419-4ad6-81b4-4f47731ca647 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:53.636667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:53.662433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3b017-449d-4167-872d-805515daed38 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:53.701662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66744ad2-bde1-4c81-882e-7a940a199b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:53.702318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66744ad2-bde1-4c81-882e-7a940a199b7a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:53.702598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66744ad2-bde1-4c81-882e-7a940a199b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:53.702873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66744ad2-bde1-4c81-882e-7a940a199b7a None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:53.703572 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66744ad2-bde1-4c81-882e-7a940a199b7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:53.703881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66744ad2-bde1-4c81-882e-7a940a199b7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:53.705342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66744ad2-bde1-4c81-882e-7a940a199b7a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:53.718912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 317/638] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:53.719725 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66744ad2-bde1-4c81-882e-7a940a199b7a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:53.726402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0cb373-4419-4ad6-81b4-4f47731ca647 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:53.761676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0837a1-f7d8-4c71-9bb8-975ab47c23ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:53.762340 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0837a1-f7d8-4c71-9bb8-975ab47c23ca None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:53.762629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0837a1-f7d8-4c71-9bb8-975ab47c23ca None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:53.762904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0837a1-f7d8-4c71-9bb8-975ab47c23ca None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:53.763567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0837a1-f7d8-4c71-9bb8-975ab47c23ca None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:53.763870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0837a1-f7d8-4c71-9bb8-975ab47c23ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:53.765250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0837a1-f7d8-4c71-9bb8-975ab47c23ca None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:53.774353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 322/639] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:53.775614 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77edcef-76bb-4024-8d61-013713ef2bda None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:53.776183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77edcef-76bb-4024-8d61-013713ef2bda None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:53.776463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77edcef-76bb-4024-8d61-013713ef2bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:53.794590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c77edcef-76bb-4024-8d61-013713ef2bda None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:53.795736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c77edcef-76bb-4024-8d61-013713ef2bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:53.820358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66744ad2-bde1-4c81-882e-7a940a199b7a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:53.822031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:53.856189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23edd67-ffd3-40b0-adaf-56112e9cf3b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:53.856858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23edd67-ffd3-40b0-adaf-56112e9cf3b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:53.857168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23edd67-ffd3-40b0-adaf-56112e9cf3b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:53.857414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23edd67-ffd3-40b0-adaf-56112e9cf3b2 None admin] PATH_INFO: `/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/3940f3578cc44d4d8ebe074216a65f2e/roles/4f6a1ac8e24d4fbbb77c428a26d085ac` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:53.867014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:53.869962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 323/640] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:53.870851 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77edcef-76bb-4024-8d61-013713ef2bda None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:53.883048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23edd67-ffd3-40b0-adaf-56112e9cf3b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=2958a115e7974fc4b5c74a633fc4322c, user_id=3940f3578cc44d4d8ebe074216a65f2e, role_id=4f6a1ac8e24d4fbbb77c428a26d085ac)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:53.884557 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23edd67-ffd3-40b0-adaf-56112e9cf3b2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:53.899737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 318/641] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:04:53 2022] PUT /identity/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/3940f3578cc44d4d8ebe074216a65f2e/roles/4f6a1ac8e24d4fbbb77c428a26d085ac => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:04:53.900571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23edd67-ffd3-40b0-adaf-56112e9cf3b2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:54.008679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77edcef-76bb-4024-8d61-013713ef2bda None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:54.048996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0813e-1d3a-4727-b072-34da09295b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:54.049622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0813e-1d3a-4727-b072-34da09295b56 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:54.049924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0813e-1d3a-4727-b072-34da09295b56 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:54.050193 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6e0813e-1d3a-4727-b072-34da09295b56 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:54.056986 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23edd67-ffd3-40b0-adaf-56112e9cf3b2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:54.063667 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6e0813e-1d3a-4727-b072-34da09295b56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b6e0813e-1d3a-4727-b072-34da09295b56 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:54.069875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:54.070924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:54.071770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:54.071770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:54.071770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:54.071770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:54.071770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:54.071770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:54.071770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:54.071770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:54.071770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:54.071770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:54.071770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:54.071770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:54.074656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 324/642] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:53 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:54.075891 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0813e-1d3a-4727-b072-34da09295b56 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:54.102005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e4275-887d-4c32-9cfe-be56039da65f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:54.102650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e4275-887d-4c32-9cfe-be56039da65f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:54.102932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e4275-887d-4c32-9cfe-be56039da65f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:54.103214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281e4275-887d-4c32-9cfe-be56039da65f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:54.104135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e4275-887d-4c32-9cfe-be56039da65f None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=38b19e4add2a4321a2fbfeb9a3a1b61d) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:54.104484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e4275-887d-4c32-9cfe-be56039da65f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:54.105997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281e4275-887d-4c32-9cfe-be56039da65f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:54.108864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:54.114089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 319/643] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:53 2022] GET /identity/v3/role_assignments?user.id=38b19e4add2a4321a2fbfeb9a3a1b61d&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:54.115440 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e4275-887d-4c32-9cfe-be56039da65f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:54.182082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:54.209017 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6e0813e-1d3a-4727-b072-34da09295b56 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:54.248821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281e4275-887d-4c32-9cfe-be56039da65f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:54.272615 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a9a46-3709-4b0b-aea9-e70b97ba4053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:54.273514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a9a46-3709-4b0b-aea9-e70b97ba4053 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:54.273644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a9a46-3709-4b0b-aea9-e70b97ba4053 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:54.273955 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a9a46-3709-4b0b-aea9-e70b97ba4053 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:54.287879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a9a46-3709-4b0b-aea9-e70b97ba4053 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:54.289430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a9a46-3709-4b0b-aea9-e70b97ba4053 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:54.296717 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d25d1-0822-4032-9b9d-a95e81d72b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:54.297727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d25d1-0822-4032-9b9d-a95e81d72b60 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:54.298250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d25d1-0822-4032-9b9d-a95e81d72b60 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:54.298737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673d25d1-0822-4032-9b9d-a95e81d72b60 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:54.299788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d25d1-0822-4032-9b9d-a95e81d72b60 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:54.300371 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d25d1-0822-4032-9b9d-a95e81d72b60 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:54.302173 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673d25d1-0822-4032-9b9d-a95e81d72b60 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:54.314869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 320/644] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:54.316161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d25d1-0822-4032-9b9d-a95e81d72b60 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-a08a9a46-3709-4b0b-aea9-e70b97ba4053 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:54.316720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:54.317722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:54.319034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:54.319034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:54.319034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:54.319034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 325/645] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:54.324260 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a9a46-3709-4b0b-aea9-e70b97ba4053 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:54.423234 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:54.440434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673d25d1-0822-4032-9b9d-a95e81d72b60 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:54.455860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:54.460367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a9a46-3709-4b0b-aea9-e70b97ba4053 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:54.488035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cc208-707b-46ee-bee4-bdecbaa6247a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:54.489554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cc208-707b-46ee-bee4-bdecbaa6247a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:54.490547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cc208-707b-46ee-bee4-bdecbaa6247a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:54.491281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180cc208-707b-46ee-bee4-bdecbaa6247a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:54.501177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6b2da-aeec-451f-af42-119e59219d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:54.501859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b2da-aeec-451f-af42-119e59219d4e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:54.502139 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b2da-aeec-451f-af42-119e59219d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:54.502405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf6b2da-aeec-451f-af42-119e59219d4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:54.507820 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180cc208-707b-46ee-bee4-bdecbaa6247a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:54.513826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6b2da-aeec-451f-af42-119e59219d4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:54.515282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf6b2da-aeec-451f-af42-119e59219d4e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-180cc208-707b-46ee-bee4-bdecbaa6247a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:54.515484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:54.516353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:54.517311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:54.517311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:54.517311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:54.517311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:54.517311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:54.517311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:54.517311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:54.517311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:54.517311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:54.517311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:54.517311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:54.517311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:54.519203 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 321/646] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:54.521473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cc208-707b-46ee-bee4-bdecbaa6247a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-3cf6b2da-aeec-451f-af42-119e59219d4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:54.540430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:54.541654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:54.542796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:54.542796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:54.542796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:54.544706 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 326/647] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:54.545996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6b2da-aeec-451f-af42-119e59219d4e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:54.648107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180cc208-707b-46ee-bee4-bdecbaa6247a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:54.669350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf6b2da-aeec-451f-af42-119e59219d4e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:54.699134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1771a41-741c-4a44-adea-fcf67809fb4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:54.699768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771a41-741c-4a44-adea-fcf67809fb4a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:54.700045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771a41-741c-4a44-adea-fcf67809fb4a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:54.700309 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1771a41-741c-4a44-adea-fcf67809fb4a None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:54.700955 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1771a41-741c-4a44-adea-fcf67809fb4a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:54.701266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1771a41-741c-4a44-adea-fcf67809fb4a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:54.702681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1771a41-741c-4a44-adea-fcf67809fb4a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:54.714664 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:54.720401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 322/648] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:54.722257 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1771a41-741c-4a44-adea-fcf67809fb4a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:54.726168 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5dcc5-2f7f-468d-af6a-91ea9046fb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:54.727112 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5dcc5-2f7f-468d-af6a-91ea9046fb78 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:54.727651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5dcc5-2f7f-468d-af6a-91ea9046fb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:54.727651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5dcc5-2f7f-468d-af6a-91ea9046fb78 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:54.728312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5dcc5-2f7f-468d-af6a-91ea9046fb78 None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:54.729630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5dcc5-2f7f-468d-af6a-91ea9046fb78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:54.731061 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5dcc5-2f7f-468d-af6a-91ea9046fb78 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:54.742647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 327/649] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:54.743624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5dcc5-2f7f-468d-af6a-91ea9046fb78 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:54.767820 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:54.840425 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1771a41-741c-4a44-adea-fcf67809fb4a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:54.871779 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5dcc5-2f7f-468d-af6a-91ea9046fb78 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:54.878634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80630a7d-b415-4c34-9ad6-20b8ff38dd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:54.879253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80630a7d-b415-4c34-9ad6-20b8ff38dd92 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:54.879606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80630a7d-b415-4c34-9ad6-20b8ff38dd92 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:54.879894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80630a7d-b415-4c34-9ad6-20b8ff38dd92 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:54.880866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80630a7d-b415-4c34-9ad6-20b8ff38dd92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:54.881168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80630a7d-b415-4c34-9ad6-20b8ff38dd92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:54.882752 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80630a7d-b415-4c34-9ad6-20b8ff38dd92 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:54.895643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 323/650] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:54.896607 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80630a7d-b415-4c34-9ad6-20b8ff38dd92 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:54.913726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebfbc1-0b17-4bdd-bd1d-2411c88367cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:54.914342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebfbc1-0b17-4bdd-bd1d-2411c88367cc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:54.914617 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebfbc1-0b17-4bdd-bd1d-2411c88367cc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:54.914940 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eebfbc1-0b17-4bdd-bd1d-2411c88367cc None admin] PATH_INFO: `/v3/users/glance` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:54.923419 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebfbc1-0b17-4bdd-bd1d-2411c88367cc None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:54.924981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eebfbc1-0b17-4bdd-bd1d-2411c88367cc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8eebfbc1-0b17-4bdd-bd1d-2411c88367cc None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:54.937398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:54.938481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:54.939412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:54.939412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:54.939412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:54.939412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:54.939412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:54.939412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:54.939412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:54.939412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:54.939412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 15 19:04:54.939412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:54.943600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 328/651] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:54 2022] GET /identity/v3/users/glance => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:54.944664 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebfbc1-0b17-4bdd-bd1d-2411c88367cc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:55.004876 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:55.014259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:55.022017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80630a7d-b415-4c34-9ad6-20b8ff38dd92 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:55.059311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cce0bd-ca67-4d87-942b-22a0ae394fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:55.059987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cce0bd-ca67-4d87-942b-22a0ae394fed None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:55.060234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cce0bd-ca67-4d87-942b-22a0ae394fed None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:55.060511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cce0bd-ca67-4d87-942b-22a0ae394fed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:55.067489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eebfbc1-0b17-4bdd-bd1d-2411c88367cc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:55.072185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cce0bd-ca67-4d87-942b-22a0ae394fed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:55.073684 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cce0bd-ca67-4d87-942b-22a0ae394fed None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-51cce0bd-ca67-4d87-942b-22a0ae394fed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:55.088869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:55.090124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:55.091392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:55.091392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:55.091392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:55.091392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 324/652] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:55.091392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cce0bd-ca67-4d87-942b-22a0ae394fed None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:55.110161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e5a67-8b59-47ea-87d4-d4c924f26a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:55.111260 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e5a67-8b59-47ea-87d4-d4c924f26a94 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:55.111764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e5a67-8b59-47ea-87d4-d4c924f26a94 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:55.112191 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e5a67-8b59-47ea-87d4-d4c924f26a94 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:55.121762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e5a67-8b59-47ea-87d4-d4c924f26a94 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:55.123634 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e5a67-8b59-47ea-87d4-d4c924f26a94 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b26e5a67-8b59-47ea-87d4-d4c924f26a94 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:55.138461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:55.139676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:55.140835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:55.140835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:55.140835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:55.140835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:55.140835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:55.140835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:55.140835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:55.140835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:55.140835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 19:04:55.140835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:55.143975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 329/653] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:55.145225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e5a67-8b59-47ea-87d4-d4c924f26a94 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:55.198679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cce0bd-ca67-4d87-942b-22a0ae394fed None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:55.238359 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921bbc4-caca-4d73-8711-a906ee46cd4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:55.239058 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921bbc4-caca-4d73-8711-a906ee46cd4d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:55.239478 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921bbc4-caca-4d73-8711-a906ee46cd4d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:55.239667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7921bbc4-caca-4d73-8711-a906ee46cd4d None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:55.240464 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921bbc4-caca-4d73-8711-a906ee46cd4d None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:55.241502 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921bbc4-caca-4d73-8711-a906ee46cd4d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:55.242306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7921bbc4-caca-4d73-8711-a906ee46cd4d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:55.276295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 325/654] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 15 19:04:55 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:55.277616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921bbc4-caca-4d73-8711-a906ee46cd4d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:55.282067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:55.282895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e5a67-8b59-47ea-87d4-d4c924f26a94 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:55.294289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:55.332003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8871-fa02-40c1-8eac-4c35fd840a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:55.332764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8871-fa02-40c1-8eac-4c35fd840a74 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:55.333109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8871-fa02-40c1-8eac-4c35fd840a74 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:55.333728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651b8871-fa02-40c1-8eac-4c35fd840a74 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:55.333946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8871-fa02-40c1-8eac-4c35fd840a74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:55.334252 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8871-fa02-40c1-8eac-4c35fd840a74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:55.335955 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651b8871-fa02-40c1-8eac-4c35fd840a74 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:55.352558 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 330/655] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:55.353523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8871-fa02-40c1-8eac-4c35fd840a74 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:55.401901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7921bbc4-caca-4d73-8711-a906ee46cd4d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:55.446510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b756d-4ccf-4865-8017-4e2a462653ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:55.447492 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b756d-4ccf-4865-8017-4e2a462653ac None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:55.447912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b756d-4ccf-4865-8017-4e2a462653ac None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:55.448422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b756d-4ccf-4865-8017-4e2a462653ac None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:55.449403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b756d-4ccf-4865-8017-4e2a462653ac None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:55.449951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b756d-4ccf-4865-8017-4e2a462653ac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:55.451681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b756d-4ccf-4865-8017-4e2a462653ac None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:55.469659 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651b8871-fa02-40c1-8eac-4c35fd840a74 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:55.476055 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 326/656] 10.222.0.25 () {56 vars in 1137 bytes} [Thu Sep 15 19:04:55 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:55.477248 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b756d-4ccf-4865-8017-4e2a462653ac None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:55.511223 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03539db5-ed56-418c-8a99-1eaf73d1a557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:55.512177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03539db5-ed56-418c-8a99-1eaf73d1a557 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:55.512459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03539db5-ed56-418c-8a99-1eaf73d1a557 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:55.512732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03539db5-ed56-418c-8a99-1eaf73d1a557 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:55.561839 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:55.566063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:55.600312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03539db5-ed56-418c-8a99-1eaf73d1a557 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:55.602489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03539db5-ed56-418c-8a99-1eaf73d1a557 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:55.611341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b756d-4ccf-4865-8017-4e2a462653ac None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:55.651990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038161a-1117-4aef-9d07-248a0270aa3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:55.652711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038161a-1117-4aef-9d07-248a0270aa3a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:55.653039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038161a-1117-4aef-9d07-248a0270aa3a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:55.653311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b038161a-1117-4aef-9d07-248a0270aa3a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:55.662311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038161a-1117-4aef-9d07-248a0270aa3a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:55.664421 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b038161a-1117-4aef-9d07-248a0270aa3a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-b038161a-1117-4aef-9d07-248a0270aa3a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:55.682354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:55.683412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:55.684343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:55.684343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:55.684343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:55.684343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:55.684343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:55.684343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:55.684343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:55.684343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:55.684343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 15 19:04:55.684343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:55.690297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 327/657] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:55 2022] GET /identity/v3/users/neutron => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:55.691730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038161a-1117-4aef-9d07-248a0270aa3a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:55.733557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 331/658] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:55.734659 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03539db5-ed56-418c-8a99-1eaf73d1a557 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:55.816744 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:55.837062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b038161a-1117-4aef-9d07-248a0270aa3a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:55.865942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:55.869002 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03539db5-ed56-418c-8a99-1eaf73d1a557 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:55.885550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe3325-1e6f-4c24-acf3-e5aec988d338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:55.886673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe3325-1e6f-4c24-acf3-e5aec988d338 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:55.887442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe3325-1e6f-4c24-acf3-e5aec988d338 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:55.887920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfe3325-1e6f-4c24-acf3-e5aec988d338 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:55.906846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcc62a-f908-4868-8370-68e0c6ca12bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:55.907468 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcc62a-f908-4868-8370-68e0c6ca12bd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:55.907743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcc62a-f908-4868-8370-68e0c6ca12bd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:55.908010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bcc62a-f908-4868-8370-68e0c6ca12bd None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:55.908748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcc62a-f908-4868-8370-68e0c6ca12bd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:55.909048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcc62a-f908-4868-8370-68e0c6ca12bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:55.911128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bcc62a-f908-4868-8370-68e0c6ca12bd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:55.940403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 332/659] 10.222.0.25 () {56 vars in 1139 bytes} [Thu Sep 15 19:04:55 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:55.940403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcc62a-f908-4868-8370-68e0c6ca12bd None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:55.991904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe3325-1e6f-4c24-acf3-e5aec988d338 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:55.994694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfe3325-1e6f-4c24-acf3-e5aec988d338 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:56.066054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bcc62a-f908-4868-8370-68e0c6ca12bd None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:56.095678 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:56.105245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c62166-e1e2-4ece-a349-dc6c1f8063e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:56.105715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c62166-e1e2-4ece-a349-dc6c1f8063e2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:56.106018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c62166-e1e2-4ece-a349-dc6c1f8063e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:56.106283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c62166-e1e2-4ece-a349-dc6c1f8063e2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:56.117550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c62166-e1e2-4ece-a349-dc6c1f8063e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:56.119091 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c62166-e1e2-4ece-a349-dc6c1f8063e2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:56.126806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 328/660] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:56.127975 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe3325-1e6f-4c24-acf3-e5aec988d338 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-e6c62166-e1e2-4ece-a349-dc6c1f8063e2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:56.135949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:56.136946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:56.137847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:56.137847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:56.137847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:56.137847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 333/661] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:56.138516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c62166-e1e2-4ece-a349-dc6c1f8063e2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:56.162980 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:56.259321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfe3325-1e6f-4c24-acf3-e5aec988d338 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:56.267532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c62166-e1e2-4ece-a349-dc6c1f8063e2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:56.311189 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4659426-215f-48cf-9b38-256cb8e35fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:56.311841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4659426-215f-48cf-9b38-256cb8e35fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:56.312115 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4659426-215f-48cf-9b38-256cb8e35fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:56.312320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5897f-d749-46fd-94fd-85fd3160c0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:56.312547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4659426-215f-48cf-9b38-256cb8e35fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:56.312942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5897f-d749-46fd-94fd-85fd3160c0fd None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:56.313217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5897f-d749-46fd-94fd-85fd3160c0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:56.313481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5897f-d749-46fd-94fd-85fd3160c0fd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:56.324070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4659426-215f-48cf-9b38-256cb8e35fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:56.325537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4659426-215f-48cf-9b38-256cb8e35fc3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-f4659426-215f-48cf-9b38-256cb8e35fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:56.341180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:56.342212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:56.343073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:56.343073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:56.343073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:56.345945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 334/662] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:56.347790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4659426-215f-48cf-9b38-256cb8e35fc3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:56.381603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:56.399812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5897f-d749-46fd-94fd-85fd3160c0fd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:56.401305 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5897f-d749-46fd-94fd-85fd3160c0fd None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:56.429087 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:56.462692 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4659426-215f-48cf-9b38-256cb8e35fc3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:56.503266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2125166-966e-4be0-94da-c6336b2a7180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:56.504539 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125166-966e-4be0-94da-c6336b2a7180 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:56.505004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125166-966e-4be0-94da-c6336b2a7180 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:56.505285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2125166-966e-4be0-94da-c6336b2a7180 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:56.506069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2125166-966e-4be0-94da-c6336b2a7180 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:56.506482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2125166-966e-4be0-94da-c6336b2a7180 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:56.507937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2125166-966e-4be0-94da-c6336b2a7180 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:56.516756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 329/663] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:56.525621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 335/664] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:56.525621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2125166-966e-4be0-94da-c6336b2a7180 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:56.525943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a009055-a6ba-4b55-b598-5020aefb387d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:56.525943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a009055-a6ba-4b55-b598-5020aefb387d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:56.525943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a009055-a6ba-4b55-b598-5020aefb387d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:56.525943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 330/665] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:56.526424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a009055-a6ba-4b55-b598-5020aefb387d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:56.622264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:56.631039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a009055-a6ba-4b55-b598-5020aefb387d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:56.631934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2125166-966e-4be0-94da-c6336b2a7180 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:56.654575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:56.666876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e9a5c2-1dd9-4107-9b80-84c441c14ef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:56.667520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a5c2-1dd9-4107-9b80-84c441c14ef8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:56.667793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a5c2-1dd9-4107-9b80-84c441c14ef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:56.668059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e9a5c2-1dd9-4107-9b80-84c441c14ef8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:56.668187 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e27c1-703e-47fb-bd66-9b3f3d27eb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:56.668807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e27c1-703e-47fb-bd66-9b3f3d27eb0d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:56.669086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e27c1-703e-47fb-bd66-9b3f3d27eb0d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:56.669358 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd6e27c1-703e-47fb-bd66-9b3f3d27eb0d None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:56.670037 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e27c1-703e-47fb-bd66-9b3f3d27eb0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:56.670340 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e27c1-703e-47fb-bd66-9b3f3d27eb0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:56.671713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd6e27c1-703e-47fb-bd66-9b3f3d27eb0d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:56.678346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9a5c2-1dd9-4107-9b80-84c441c14ef8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:56.679796 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e9a5c2-1dd9-4107-9b80-84c441c14ef8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:56.687772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 336/666] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:56.687772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e27c1-703e-47fb-bd66-9b3f3d27eb0d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-10e9a5c2-1dd9-4107-9b80-84c441c14ef8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:56.695222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:56.696174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:56.697044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:56.697044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:56.697044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:56.697044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 331/667] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:56.697568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3974a2-2f41-4f9d-aa8e-20a2bb2f2b41 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:56.697896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3974a2-2f41-4f9d-aa8e-20a2bb2f2b41 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:56.698111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3974a2-2f41-4f9d-aa8e-20a2bb2f2b41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:56.716524 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-da3974a2-2f41-4f9d-aa8e-20a2bb2f2b41 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:56.717814 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-da3974a2-2f41-4f9d-aa8e-20a2bb2f2b41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:56.784904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 332/668] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:56.786168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a37c05-6a6e-4538-89e6-af5321dcd9b9 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:56.786451 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a37c05-6a6e-4538-89e6-af5321dcd9b9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:56.786717 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a37c05-6a6e-4538-89e6-af5321dcd9b9 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:56.788158 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 333/669] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:04:56.788711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a37c05-6a6e-4538-89e6-af5321dcd9b9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:56.808345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd6e27c1-703e-47fb-bd66-9b3f3d27eb0d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:56.850280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fefdf0-dde0-4d64-bbe1-8c4f460a8242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:56.850940 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fefdf0-dde0-4d64-bbe1-8c4f460a8242 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:56.851218 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fefdf0-dde0-4d64-bbe1-8c4f460a8242 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:56.851488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fefdf0-dde0-4d64-bbe1-8c4f460a8242 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:56.858983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fefdf0-dde0-4d64-bbe1-8c4f460a8242 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:56.860455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1fefdf0-dde0-4d64-bbe1-8c4f460a8242 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-e1fefdf0-dde0-4d64-bbe1-8c4f460a8242 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:56.874498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:56.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:56.876321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:56.876321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:56.876321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:56.876321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:56.876321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:56.876321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:56.876321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:56.876321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:56.881064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 337/670] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:56.881685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fefdf0-dde0-4d64-bbe1-8c4f460a8242 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:56.899192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:56.903556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a37c05-6a6e-4538-89e6-af5321dcd9b9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:56.907567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:56.943826 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02b3c81-34b4-473a-a984-75075a2ba11b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:56.944478 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b3c81-34b4-473a-a984-75075a2ba11b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:56.944759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b3c81-34b4-473a-a984-75075a2ba11b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:56.945025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02b3c81-34b4-473a-a984-75075a2ba11b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:56.952294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b3c81-34b4-473a-a984-75075a2ba11b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:56.953750 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02b3c81-34b4-473a-a984-75075a2ba11b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-e02b3c81-34b4-473a-a984-75075a2ba11b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:56.965624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:56.966766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:56.967883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:56.967883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:56.967883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:56.967883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:56.967883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:56.967883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:56.967883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:56.967883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:56.971477 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 334/671] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:56.973226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46239ba5-a8cc-4eb4-9b64-577e95bafcef None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:56.973506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46239ba5-a8cc-4eb4-9b64-577e95bafcef None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:56.973806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46239ba5-a8cc-4eb4-9b64-577e95bafcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:56.991852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-46239ba5-a8cc-4eb4-9b64-577e95bafcef None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:04:56.993039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-46239ba5-a8cc-4eb4-9b64-577e95bafcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:04:57.001957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fefdf0-dde0-4d64-bbe1-8c4f460a8242 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:57.037421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be5a0-d08c-4a3c-96dc-94bcfdc88195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:57.037982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be5a0-d08c-4a3c-96dc-94bcfdc88195 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:57.038252 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be5a0-d08c-4a3c-96dc-94bcfdc88195 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:57.038515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281be5a0-d08c-4a3c-96dc-94bcfdc88195 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:57.039155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281be5a0-d08c-4a3c-96dc-94bcfdc88195 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:57.039454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281be5a0-d08c-4a3c-96dc-94bcfdc88195 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:57.040838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-281be5a0-d08c-4a3c-96dc-94bcfdc88195 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:57.053530 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 338/672] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:57.054500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be5a0-d08c-4a3c-96dc-94bcfdc88195 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:57.064627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 335/673] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:04:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:04:57.065341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46239ba5-a8cc-4eb4-9b64-577e95bafcef None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:57.133821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:57.165456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:57.166984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-281be5a0-d08c-4a3c-96dc-94bcfdc88195 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:57.173116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46239ba5-a8cc-4eb4-9b64-577e95bafcef None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:57.205803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b48419-c5ac-4148-a158-576af6a087a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:57.206449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48419-c5ac-4148-a158-576af6a087a2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:57.206713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48419-c5ac-4148-a158-576af6a087a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:57.206983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b48419-c5ac-4148-a158-576af6a087a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:57.207765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b48419-c5ac-4148-a158-576af6a087a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:57.208105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b48419-c5ac-4148-a158-576af6a087a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:57.209511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b48419-c5ac-4148-a158-576af6a087a2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:57.211021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ada115-159c-4358-94fc-84748c8cbfd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:57.211827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada115-159c-4358-94fc-84748c8cbfd3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:57.212271 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada115-159c-4358-94fc-84748c8cbfd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:57.212535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ada115-159c-4358-94fc-84748c8cbfd3 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:57.213312 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ada115-159c-4358-94fc-84748c8cbfd3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:57.213620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ada115-159c-4358-94fc-84748c8cbfd3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:57.215134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ada115-159c-4358-94fc-84748c8cbfd3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:57.227573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 339/674] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:57.227573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b48419-c5ac-4148-a158-576af6a087a2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:57.228720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 336/675] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:57.229630 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ada115-159c-4358-94fc-84748c8cbfd3 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:57.342533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ada115-159c-4358-94fc-84748c8cbfd3 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:57.343676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b48419-c5ac-4148-a158-576af6a087a2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:57.374155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:57.378328 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e93f57-9a0f-4652-89c7-a2c8afa6c096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:57.378972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e93f57-9a0f-4652-89c7-a2c8afa6c096 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:57.379250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e93f57-9a0f-4652-89c7-a2c8afa6c096 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:57.379385 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1995e4-8959-4e84-9fbb-146a66ffed87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:57.379565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e93f57-9a0f-4652-89c7-a2c8afa6c096 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:57.380019 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1995e4-8959-4e84-9fbb-146a66ffed87 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:57.380295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1995e4-8959-4e84-9fbb-146a66ffed87 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:57.380567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1995e4-8959-4e84-9fbb-146a66ffed87 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:57.386767 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e93f57-9a0f-4652-89c7-a2c8afa6c096 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:57.388637 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e93f57-9a0f-4652-89c7-a2c8afa6c096 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:57.391086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1995e4-8959-4e84-9fbb-146a66ffed87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-5a1995e4-8959-4e84-9fbb-146a66ffed87 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:57.396642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:57.397824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:57.398703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:57.398703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:57.398703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:57.398703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:57.398703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:57.398703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:57.398703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:57.398703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:57.398703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:57.398703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:57.398703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:04:57.398703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:57.398703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 340/676] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:04:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:57.399399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1995e4-8959-4e84-9fbb-146a66ffed87 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-35e93f57-9a0f-4652-89c7-a2c8afa6c096 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:04:57.400114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:57.400971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:57.402378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:04:57.402378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:04:57.402378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:04:57.402378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:04:57.402378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:04:57.402378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:04:57.402378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:04:57.402378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:57.402378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 337/677] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:57.402378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e93f57-9a0f-4652-89c7-a2c8afa6c096 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:57.421818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:57.501805 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1995e4-8959-4e84-9fbb-146a66ffed87 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:57.505683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e93f57-9a0f-4652-89c7-a2c8afa6c096 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:57.535199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1cc20-150d-4fb0-989b-b00fbe23c46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:57.535862 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1cc20-150d-4fb0-989b-b00fbe23c46c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:57.536314 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1cc20-150d-4fb0-989b-b00fbe23c46c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:57.536594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b1cc20-150d-4fb0-989b-b00fbe23c46c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:57.537328 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1cc20-150d-4fb0-989b-b00fbe23c46c None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=b06d8a144ecf43fc8de82346758b6065) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:57.537646 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1cc20-150d-4fb0-989b-b00fbe23c46c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:57.539101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f101a3-a480-4cee-a833-dab284cca387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:57.539232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b1cc20-150d-4fb0-989b-b00fbe23c46c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:57.539706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f101a3-a480-4cee-a833-dab284cca387 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:57.539982 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f101a3-a480-4cee-a833-dab284cca387 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:57.540250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f101a3-a480-4cee-a833-dab284cca387 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:57.540961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f101a3-a480-4cee-a833-dab284cca387 None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=677623b8ea5042ffa0169be83a7205d4) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:57.541268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f101a3-a480-4cee-a833-dab284cca387 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:57.542723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f101a3-a480-4cee-a833-dab284cca387 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:57.545038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 341/678] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:57 2022] GET /identity/v3/role_assignments?user.id=b06d8a144ecf43fc8de82346758b6065&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:57.545871 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1cc20-150d-4fb0-989b-b00fbe23c46c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:57.560061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 338/679] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:57 2022] GET /identity/v3/role_assignments?user.id=677623b8ea5042ffa0169be83a7205d4&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:57.567695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f101a3-a480-4cee-a833-dab284cca387 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:57.626178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:57.699485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b1cc20-150d-4fb0-989b-b00fbe23c46c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:57.701301 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:57.731584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f101a3-a480-4cee-a833-dab284cca387 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:57.741550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab47e57-bd4a-4dfc-9d10-3ebe692f529d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:57.741957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab47e57-bd4a-4dfc-9d10-3ebe692f529d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:57.742333 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab47e57-bd4a-4dfc-9d10-3ebe692f529d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:57.742706 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab47e57-bd4a-4dfc-9d10-3ebe692f529d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:57.755376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab47e57-bd4a-4dfc-9d10-3ebe692f529d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8ab47e57-bd4a-4dfc-9d10-3ebe692f529d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:04:57.761039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:57.762109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:57.762919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:57.762919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:57.762919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:57.762919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:57.762919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:04:57.762919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:04:57.762919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:04:57.762919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:04:57.762919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:04:57.762919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:04:57.762919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:04:57.762919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:57.763563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 342/680] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:04:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:57.764418 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab47e57-bd4a-4dfc-9d10-3ebe692f529d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:57.783802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0ebb5-cf8e-4e20-b232-b5d943bf5444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:57.784753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0ebb5-cf8e-4e20-b232-b5d943bf5444 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:57.784753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0ebb5-cf8e-4e20-b232-b5d943bf5444 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:57.784978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e0ebb5-cf8e-4e20-b232-b5d943bf5444 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:57.787074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0ebb5-cf8e-4e20-b232-b5d943bf5444 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:57.787074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0ebb5-cf8e-4e20-b232-b5d943bf5444 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:57.788280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e0ebb5-cf8e-4e20-b232-b5d943bf5444 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:57.797745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 339/681] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:04:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:57.798755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0ebb5-cf8e-4e20-b232-b5d943bf5444 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:57.894270 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab47e57-bd4a-4dfc-9d10-3ebe692f529d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:57.916532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:57.935185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e0ebb5-cf8e-4e20-b232-b5d943bf5444 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:57.945665 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7a736-5d4f-497a-a3b7-39085784c619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:57.946709 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7a736-5d4f-497a-a3b7-39085784c619 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:57.947284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7a736-5d4f-497a-a3b7-39085784c619 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:57.947809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbd7a736-5d4f-497a-a3b7-39085784c619 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:57.948721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7a736-5d4f-497a-a3b7-39085784c619 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:57.949324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7a736-5d4f-497a-a3b7-39085784c619 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:57.951019 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbd7a736-5d4f-497a-a3b7-39085784c619 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:57.966936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 343/682] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:04:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:57.968231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7a736-5d4f-497a-a3b7-39085784c619 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:57.976266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7174205-e505-42c8-85bd-1389cc354873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:57.976958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7174205-e505-42c8-85bd-1389cc354873 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:57.977234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7174205-e505-42c8-85bd-1389cc354873 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:57.977556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7174205-e505-42c8-85bd-1389cc354873 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:57.978290 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7174205-e505-42c8-85bd-1389cc354873 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:57.978595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7174205-e505-42c8-85bd-1389cc354873 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:57.980006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7174205-e505-42c8-85bd-1389cc354873 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:57.990082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 340/683] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:04:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:57.991042 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7174205-e505-42c8-85bd-1389cc354873 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:57.994260 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:58.094411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbd7a736-5d4f-497a-a3b7-39085784c619 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:58.122992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7174205-e505-42c8-85bd-1389cc354873 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:58.135495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a74fa1-09e8-49d7-b9ec-ccafce039716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:58.136143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a74fa1-09e8-49d7-b9ec-ccafce039716 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:58.136421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a74fa1-09e8-49d7-b9ec-ccafce039716 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:58.136693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a74fa1-09e8-49d7-b9ec-ccafce039716 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:58.150265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a74fa1-09e8-49d7-b9ec-ccafce039716 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:58.152156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a74fa1-09e8-49d7-b9ec-ccafce039716 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:58.166889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b6d50-f5da-451f-83f5-9e625845f6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:58.167891 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b6d50-f5da-451f-83f5-9e625845f6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-25a74fa1-09e8-49d7-b9ec-ccafce039716 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:58.167997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:58.168848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:58.169715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:58.169715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:58.169715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:58.170718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b6d50-f5da-451f-83f5-9e625845f6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:58.171193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4b6d50-f5da-451f-83f5-9e625845f6d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:58.172112 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b6d50-f5da-451f-83f5-9e625845f6d9 None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=4591e01ab4954b22a81f6b09cdb2d544) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:58.172609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b6d50-f5da-451f-83f5-9e625845f6d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:58.173812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 344/684] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:58.174682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a74fa1-09e8-49d7-b9ec-ccafce039716 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:58.174805 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4b6d50-f5da-451f-83f5-9e625845f6d9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:58.183082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 341/685] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:04:57 2022] GET /identity/v3/role_assignments?user.id=4591e01ab4954b22a81f6b09cdb2d544&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:58.184859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b6d50-f5da-451f-83f5-9e625845f6d9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:58.206291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:58.306192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:58.363650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a74fa1-09e8-49d7-b9ec-ccafce039716 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:58.388208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4b6d50-f5da-451f-83f5-9e625845f6d9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:58.412294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952ef1f-2b44-4d68-8321-b5f93d1c40df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:58.412868 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952ef1f-2b44-4d68-8321-b5f93d1c40df None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:58.413153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952ef1f-2b44-4d68-8321-b5f93d1c40df None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:58.413420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d952ef1f-2b44-4d68-8321-b5f93d1c40df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:58.427039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952ef1f-2b44-4d68-8321-b5f93d1c40df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:58.428688 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d952ef1f-2b44-4d68-8321-b5f93d1c40df None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:58.446874 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81ceaf-437e-486b-b615-42966bd5f2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:58.447774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81ceaf-437e-486b-b615-42966bd5f2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:58.448198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81ceaf-437e-486b-b615-42966bd5f2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:58.448600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81ceaf-437e-486b-b615-42966bd5f2c2 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:58.450788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81ceaf-437e-486b-b615-42966bd5f2c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:58.451359 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81ceaf-437e-486b-b615-42966bd5f2c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d952ef1f-2b44-4d68-8321-b5f93d1c40df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:58.452013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:58.452926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:58.454010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:58.454010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:58.454010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:58.455167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf81ceaf-437e-486b-b615-42966bd5f2c2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:58.455302 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 345/686] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:58.461481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952ef1f-2b44-4d68-8321-b5f93d1c40df None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:58.470737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 342/687] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:58.477661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81ceaf-437e-486b-b615-42966bd5f2c2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:58.563381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:58.590244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d952ef1f-2b44-4d68-8321-b5f93d1c40df None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:58.611147 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81ceaf-437e-486b-b615-42966bd5f2c2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:58.640698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d5265-b16c-4e50-a136-03c845b5635b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:58.641413 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d5265-b16c-4e50-a136-03c845b5635b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:58.641691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d5265-b16c-4e50-a136-03c845b5635b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:58.641986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56d5265-b16c-4e50-a136-03c845b5635b None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:58.642636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d5265-b16c-4e50-a136-03c845b5635b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:58.642935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d5265-b16c-4e50-a136-03c845b5635b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:58.645092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c56d5265-b16c-4e50-a136-03c845b5635b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:58.648030 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:58.657366 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5aa88-6b32-40e5-8a41-f266653867c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:58.658041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5aa88-6b32-40e5-8a41-f266653867c5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:58.658324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5aa88-6b32-40e5-8a41-f266653867c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:58.658590 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c5aa88-6b32-40e5-8a41-f266653867c5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:58.662791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 346/688] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:58.667495 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5aa88-6b32-40e5-8a41-f266653867c5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:58.668433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d5265-b16c-4e50-a136-03c845b5635b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:58.668974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c5aa88-6b32-40e5-8a41-f266653867c5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-54c5aa88-6b32-40e5-8a41-f266653867c5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:58.685537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:58.686548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:58.687469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:58.687469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:58.687469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:58.687469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:58.687469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:58.687469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:58.687469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:58.687469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:58.687469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 19:04:58.687469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:58.687991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 343/689] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:04:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:04:58.694118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5aa88-6b32-40e5-8a41-f266653867c5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:58.843725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56d5265-b16c-4e50-a136-03c845b5635b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:58.900102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c5aa88-6b32-40e5-8a41-f266653867c5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:58.930675 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7333e-ee27-47f8-99ca-878048ddd781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:58.932008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7333e-ee27-47f8-99ca-878048ddd781 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:58.932480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7333e-ee27-47f8-99ca-878048ddd781 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:58.932971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a7333e-ee27-47f8-99ca-878048ddd781 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:58.938184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410ff9a-af71-45a7-bb8c-df5142771e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:58.938944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410ff9a-af71-45a7-bb8c-df5142771e8f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:58.939194 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410ff9a-af71-45a7-bb8c-df5142771e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:58.939466 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3410ff9a-af71-45a7-bb8c-df5142771e8f None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:58.940200 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410ff9a-af71-45a7-bb8c-df5142771e8f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:58.940514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410ff9a-af71-45a7-bb8c-df5142771e8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:58.942015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3410ff9a-af71-45a7-bb8c-df5142771e8f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:58.953809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7333e-ee27-47f8-99ca-878048ddd781 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:58.955730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a7333e-ee27-47f8-99ca-878048ddd781 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:58.959516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:58.962433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 344/690] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 15 19:04:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:58.968229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410ff9a-af71-45a7-bb8c-df5142771e8f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b9a7333e-ee27-47f8-99ca-878048ddd781 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:04:58.981071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:58.982452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:58.983380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:58.983380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:58.983380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:04:58.983380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:04:58.983380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:04:58.983380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:04:58.983380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:04:58.983380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:04:58.983380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:04:58.983380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:04:58.985756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 347/691] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 19:04:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:58.991333 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7333e-ee27-47f8-99ca-878048ddd781 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:59.022205 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:59.079299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3410ff9a-af71-45a7-bb8c-df5142771e8f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:59.101172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a7333e-ee27-47f8-99ca-878048ddd781 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:59.116556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a1143-f986-40f9-8517-b736be76419e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:59.117176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a1143-f986-40f9-8517-b736be76419e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:59.117454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a1143-f986-40f9-8517-b736be76419e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:59.117725 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a1143-f986-40f9-8517-b736be76419e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:59.137732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad76052-b1e4-4aae-a92c-789448990263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:59.138833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76052-b1e4-4aae-a92c-789448990263 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:59.139326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76052-b1e4-4aae-a92c-789448990263 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:59.139785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad76052-b1e4-4aae-a92c-789448990263 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:59.140714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad76052-b1e4-4aae-a92c-789448990263 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:59.141217 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad76052-b1e4-4aae-a92c-789448990263 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:59.142866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ad76052-b1e4-4aae-a92c-789448990263 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:59.161372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 348/692] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 19:04:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:59.169610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad76052-b1e4-4aae-a92c-789448990263 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:59.191662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a1143-f986-40f9-8517-b736be76419e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:59.193415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a1143-f986-40f9-8517-b736be76419e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:59.243528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:59.250151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:59.315832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 345/693] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 15 19:04:59.317295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a1143-f986-40f9-8517-b736be76419e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:59.391755 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad76052-b1e4-4aae-a92c-789448990263 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:59.428133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a1143-f986-40f9-8517-b736be76419e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:59.464196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13599548-641a-4365-9b86-76476ff517a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:59.464767 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13599548-641a-4365-9b86-76476ff517a4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:59.465046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13599548-641a-4365-9b86-76476ff517a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:59.465319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13599548-641a-4365-9b86-76476ff517a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:59.466474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59707f2c-f1a7-4d36-94b6-8557ed4f9541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:59.467097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59707f2c-f1a7-4d36-94b6-8557ed4f9541 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:59.467428 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59707f2c-f1a7-4d36-94b6-8557ed4f9541 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:59.467698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59707f2c-f1a7-4d36-94b6-8557ed4f9541 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:59.491847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13599548-641a-4365-9b86-76476ff517a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:59.493323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13599548-641a-4365-9b86-76476ff517a4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:59.506165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-13599548-641a-4365-9b86-76476ff517a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:04:59.521838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:04:59.522852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:04:59.524057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:04:59.524057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:04:59.524057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:04:59.524057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 346/694] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:04:59.531922 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13599548-641a-4365-9b86-76476ff517a4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:59.588793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59707f2c-f1a7-4d36-94b6-8557ed4f9541 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:59.590444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59707f2c-f1a7-4d36-94b6-8557ed4f9541 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:59.674087 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:04:59.723143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 349/695] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:04:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 554 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:04:59.733766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59707f2c-f1a7-4d36-94b6-8557ed4f9541 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:59.786076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13599548-641a-4365-9b86-76476ff517a4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:59.864602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5edef0-c1a7-4517-981b-a1fbb6811fe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:59.865392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5edef0-c1a7-4517-981b-a1fbb6811fe8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:59.865673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5edef0-c1a7-4517-981b-a1fbb6811fe8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:59.865977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5edef0-c1a7-4517-981b-a1fbb6811fe8 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:59.866635 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5edef0-c1a7-4517-981b-a1fbb6811fe8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:04:59.866938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5edef0-c1a7-4517-981b-a1fbb6811fe8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:59.871732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5edef0-c1a7-4517-981b-a1fbb6811fe8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:04:59.887252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 347/696] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:04:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 356 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:04:59.897761 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5edef0-c1a7-4517-981b-a1fbb6811fe8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:04:59.909548 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59707f2c-f1a7-4d36-94b6-8557ed4f9541 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:04:59.962038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886b3e4-3eec-45a0-8ece-e1d3b36d3021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:04:59.962687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886b3e4-3eec-45a0-8ece-e1d3b36d3021 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:04:59.963222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886b3e4-3eec-45a0-8ece-e1d3b36d3021 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:04:59.963490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9886b3e4-3eec-45a0-8ece-e1d3b36d3021 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:04:59.988869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886b3e4-3eec-45a0-8ece-e1d3b36d3021 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:04:59.993460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9886b3e4-3eec-45a0-8ece-e1d3b36d3021 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9886b3e4-3eec-45a0-8ece-e1d3b36d3021 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:00.013491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:00.014542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:00.015442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:00.015442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:00.015442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:00.015442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 350/697] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:04:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:00.018764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:00.021328 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886b3e4-3eec-45a0-8ece-e1d3b36d3021 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:00.040046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:00.082675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5edef0-c1a7-4517-981b-a1fbb6811fe8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:00.132129 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cffa04c-3e68-4212-9fff-2fee2694b8c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:00.133207 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffa04c-3e68-4212-9fff-2fee2694b8c3 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:00.133707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffa04c-3e68-4212-9fff-2fee2694b8c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:00.134206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cffa04c-3e68-4212-9fff-2fee2694b8c3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:00.144552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffa04c-3e68-4212-9fff-2fee2694b8c3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:00.146682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cffa04c-3e68-4212-9fff-2fee2694b8c3 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-4cffa04c-3e68-4212-9fff-2fee2694b8c3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:00.163107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:00.164051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:00.164959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:00.164959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:00.164959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:00.164959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:00.164959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:00.164959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:00.164959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:00.164959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:00.165390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9886b3e4-3eec-45a0-8ece-e1d3b36d3021 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:00.168250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 348/698] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:04:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:00.169737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fd99e-24c5-4434-8bd1-0de87583ce99 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:00.170279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fd99e-24c5-4434-8bd1-0de87583ce99 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:00.170698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78fd99e-24c5-4434-8bd1-0de87583ce99 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:00.172413 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 349/699] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:00.181815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb1160-4704-4fd9-8ed7-3408181714f8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:00.181815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb1160-4704-4fd9-8ed7-3408181714f8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:00.181815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfb1160-4704-4fd9-8ed7-3408181714f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:00.200732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1cfb1160-4704-4fd9-8ed7-3408181714f8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:00.202324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1cfb1160-4704-4fd9-8ed7-3408181714f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:00.205603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fc43a-53ce-4ed9-852a-5e8f66c376f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:00.206681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fc43a-53ce-4ed9-852a-5e8f66c376f1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:00.206963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fc43a-53ce-4ed9-852a-5e8f66c376f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:00.207236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4fc43a-53ce-4ed9-852a-5e8f66c376f1 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:00.208337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fc43a-53ce-4ed9-852a-5e8f66c376f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:00.208709 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fc43a-53ce-4ed9-852a-5e8f66c376f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:00.210203 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4fc43a-53ce-4ed9-852a-5e8f66c376f1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:00.228037 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 351/700] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:00.229320 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fc43a-53ce-4ed9-852a-5e8f66c376f1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:00.293810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 350/701] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:05:00.293810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb1160-4704-4fd9-8ed7-3408181714f8 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:00.328502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:00.345139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:00.375271 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4fc43a-53ce-4ed9-852a-5e8f66c376f1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:00.409739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfb1160-4704-4fd9-8ed7-3408181714f8 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:00.421086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9856f-1904-4329-a024-cbf23a05eda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:00.422901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9856f-1904-4329-a024-cbf23a05eda7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:00.423292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9856f-1904-4329-a024-cbf23a05eda7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:00.423568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9856f-1904-4329-a024-cbf23a05eda7 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:00.424286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9856f-1904-4329-a024-cbf23a05eda7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:00.424593 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9856f-1904-4329-a024-cbf23a05eda7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:00.426073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9856f-1904-4329-a024-cbf23a05eda7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:00.446347 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 352/702] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:00.448549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea9f96-e8e5-45ac-931a-77a313522505 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:00.448935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea9f96-e8e5-45ac-931a-77a313522505 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:00.449352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ea9f96-e8e5-45ac-931a-77a313522505 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:00.452236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 353/703] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:00.453435 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea9f96-e8e5-45ac-931a-77a313522505 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:00.460436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085c0a65-271f-4ccb-a37e-6fad3ea9de88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:00.461450 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c0a65-271f-4ccb-a37e-6fad3ea9de88 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:00.461977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c0a65-271f-4ccb-a37e-6fad3ea9de88 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:00.462452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085c0a65-271f-4ccb-a37e-6fad3ea9de88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:00.472120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c0a65-271f-4ccb-a37e-6fad3ea9de88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:00.474597 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085c0a65-271f-4ccb-a37e-6fad3ea9de88 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-085c0a65-271f-4ccb-a37e-6fad3ea9de88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:00.490760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:00.491936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:00.493061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:00.493061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:00.493061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:00.493061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:00.493061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:00.493061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:00.493061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:00.493061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:00.500999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 351/704] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:00.500999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd5578-7797-48ae-b4b5-141f5f945331 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:00.500999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd5578-7797-48ae-b4b5-141f5f945331 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:00.500999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dd5578-7797-48ae-b4b5-141f5f945331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:00.522410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-47dd5578-7797-48ae-b4b5-141f5f945331 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:00.523615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-47dd5578-7797-48ae-b4b5-141f5f945331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:00.590337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ea9f96-e8e5-45ac-931a-77a313522505 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:00.599315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 352/705] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:05:00.600796 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd5578-7797-48ae-b4b5-141f5f945331 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:00.623252 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:00.631527 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3369c-a8ec-4612-8b36-1f0c90e289ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:00.632155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3369c-a8ec-4612-8b36-1f0c90e289ff None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:00.632429 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3369c-a8ec-4612-8b36-1f0c90e289ff None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:00.632702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef3369c-a8ec-4612-8b36-1f0c90e289ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:00.633491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3369c-a8ec-4612-8b36-1f0c90e289ff None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=3940f3578cc44d4d8ebe074216a65f2e) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:00.633821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3369c-a8ec-4612-8b36-1f0c90e289ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:00.635450 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef3369c-a8ec-4612-8b36-1f0c90e289ff None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:00.650169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 354/706] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:05:00 2022] GET /identity/v3/role_assignments?user.id=3940f3578cc44d4d8ebe074216a65f2e&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:00.650169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3369c-a8ec-4612-8b36-1f0c90e289ff None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:00.702450 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:00.759532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dd5578-7797-48ae-b4b5-141f5f945331 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:00.803850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b4bb5-0625-4ef5-99a9-da22cfc29ae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:00.806646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b4bb5-0625-4ef5-99a9-da22cfc29ae8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:00.808856 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b4bb5-0625-4ef5-99a9-da22cfc29ae8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:00.809394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b4bb5-0625-4ef5-99a9-da22cfc29ae8 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:00.810384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b4bb5-0625-4ef5-99a9-da22cfc29ae8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:00.812110 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b4bb5-0625-4ef5-99a9-da22cfc29ae8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:00.816144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b4bb5-0625-4ef5-99a9-da22cfc29ae8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:00.846148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 353/707] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:00.854909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b4bb5-0625-4ef5-99a9-da22cfc29ae8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:00.884489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef3369c-a8ec-4612-8b36-1f0c90e289ff None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:00.927783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1dc5ff-f27f-45d6-888e-e45e399be812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:00.930151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc5ff-f27f-45d6-888e-e45e399be812 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:00.930750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc5ff-f27f-45d6-888e-e45e399be812 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:00.931232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1dc5ff-f27f-45d6-888e-e45e399be812 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:00.932040 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dc5ff-f27f-45d6-888e-e45e399be812 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:00.933801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1dc5ff-f27f-45d6-888e-e45e399be812 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-2a1dc5ff-f27f-45d6-888e-e45e399be812 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:00.947553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:00.948632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:00.949467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 355/708] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Sep 15 19:05:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:00.950796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353abc9-c023-4791-87d3-dde62a7ebf40 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:00.950796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353abc9-c023-4791-87d3-dde62a7ebf40 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:00.951258 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9353abc9-c023-4791-87d3-dde62a7ebf40 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:00.954268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 356/709] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:00.957319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353abc9-c023-4791-87d3-dde62a7ebf40 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:01.009518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:01.016508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b4bb5-0625-4ef5-99a9-da22cfc29ae8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:01.025021 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:01.054936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b23143-7721-4efa-abc8-5d3619d63223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:01.055552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b23143-7721-4efa-abc8-5d3619d63223 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:01.055829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b23143-7721-4efa-abc8-5d3619d63223 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:01.056094 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b23143-7721-4efa-abc8-5d3619d63223 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:01.056816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b23143-7721-4efa-abc8-5d3619d63223 None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=38b19e4add2a4321a2fbfeb9a3a1b61d) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:01.057126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b23143-7721-4efa-abc8-5d3619d63223 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:01.058684 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b23143-7721-4efa-abc8-5d3619d63223 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:01.064292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 354/710] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:05:00 2022] GET /identity/v3/role_assignments?user.id=38b19e4add2a4321a2fbfeb9a3a1b61d&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:01.065103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b23143-7721-4efa-abc8-5d3619d63223 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:01.086331 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9353abc9-c023-4791-87d3-dde62a7ebf40 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:01.127212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649fd42c-455a-4fa4-aabe-c0c5be710caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:01.127783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fd42c-455a-4fa4-aabe-c0c5be710caf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:01.128062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fd42c-455a-4fa4-aabe-c0c5be710caf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:01.128330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649fd42c-455a-4fa4-aabe-c0c5be710caf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:01.141420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fd42c-455a-4fa4-aabe-c0c5be710caf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:01.143193 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649fd42c-455a-4fa4-aabe-c0c5be710caf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-649fd42c-455a-4fa4-aabe-c0c5be710caf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:01.160962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:01.162351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:01.163232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:01.163232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:01.163232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:01.163232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 357/711] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:01.163867 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405f8c1-2916-4d8f-8346-acb9e1d86d77 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:01.164171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405f8c1-2916-4d8f-8346-acb9e1d86d77 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:01.165011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405f8c1-2916-4d8f-8346-acb9e1d86d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:01.186132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4405f8c1-2916-4d8f-8346-acb9e1d86d77 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:01.187412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4405f8c1-2916-4d8f-8346-acb9e1d86d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:01.197007 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b23143-7721-4efa-abc8-5d3619d63223 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:01.244576 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de6e9a-7a17-4f24-8c7b-dce7907044e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:01.245866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de6e9a-7a17-4f24-8c7b-dce7907044e9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:01.246908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de6e9a-7a17-4f24-8c7b-dce7907044e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:01.247496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20de6e9a-7a17-4f24-8c7b-dce7907044e9 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:01.248417 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de6e9a-7a17-4f24-8c7b-dce7907044e9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:01.248884 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de6e9a-7a17-4f24-8c7b-dce7907044e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:01.251246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20de6e9a-7a17-4f24-8c7b-dce7907044e9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:01.264620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 355/712] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 15 19:05:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:01.264620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de6e9a-7a17-4f24-8c7b-dce7907044e9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:01.291408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 358/713] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:05:01.292474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405f8c1-2916-4d8f-8346-acb9e1d86d77 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:01.322209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:01.361820 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:01.398068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20de6e9a-7a17-4f24-8c7b-dce7907044e9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:01.443669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16662514-5d28-4727-ba7b-8662935cbf4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:01.445340 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16662514-5d28-4727-ba7b-8662935cbf4f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:01.445968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16662514-5d28-4727-ba7b-8662935cbf4f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:01.448020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16662514-5d28-4727-ba7b-8662935cbf4f None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:01.449889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16662514-5d28-4727-ba7b-8662935cbf4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:01.450359 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16662514-5d28-4727-ba7b-8662935cbf4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:01.452702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16662514-5d28-4727-ba7b-8662935cbf4f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:01.477938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 356/714] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:01.484355 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405f8c1-2916-4d8f-8346-acb9e1d86d77 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:01.485444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16662514-5d28-4727-ba7b-8662935cbf4f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:01.546811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f32a2-7760-4f72-a394-2e5979fd14ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:01.547417 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f32a2-7760-4f72-a394-2e5979fd14ef None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:01.547689 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f32a2-7760-4f72-a394-2e5979fd14ef None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:01.547952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9f32a2-7760-4f72-a394-2e5979fd14ef None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:01.548588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f32a2-7760-4f72-a394-2e5979fd14ef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:01.548887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f32a2-7760-4f72-a394-2e5979fd14ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:01.553814 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9f32a2-7760-4f72-a394-2e5979fd14ef None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:01.560356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 359/715] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 15 19:05:01 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:01.597502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f32a2-7760-4f72-a394-2e5979fd14ef None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:01.617900 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:01.640512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16662514-5d28-4727-ba7b-8662935cbf4f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:01.707823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4639b-c025-461d-b514-9268613a5ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:01.708902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4639b-c025-461d-b514-9268613a5ee0 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:01.709481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4639b-c025-461d-b514-9268613a5ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:01.710014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd4639b-c025-461d-b514-9268613a5ee0 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:01.710933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4639b-c025-461d-b514-9268613a5ee0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:01.712685 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd4639b-c025-461d-b514-9268613a5ee0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:01.748699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 357/716] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:05:01 2022] POST /identity/v3/users => generated 254 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:05:01.783435 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9f32a2-7760-4f72-a394-2e5979fd14ef None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:01.787572 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:01.828529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ba11f-13c1-44bd-8248-67784ee4adf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:01.829189 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ba11f-13c1-44bd-8248-67784ee4adf2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:01.829461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ba11f-13c1-44bd-8248-67784ee4adf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:01.829726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346ba11f-13c1-44bd-8248-67784ee4adf2 None admin] PATH_INFO: `/v3/services/network` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:01.830350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ba11f-13c1-44bd-8248-67784ee4adf2 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:01.831759 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346ba11f-13c1-44bd-8248-67784ee4adf2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-346ba11f-13c1-44bd-8248-67784ee4adf2 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:01.843296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:01.845072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:01.846427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 360/717] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:01 2022] GET /identity/v3/services/network => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:01.851212 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4639b-c025-461d-b514-9268613a5ee0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:01.982349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd4639b-c025-461d-b514-9268613a5ee0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:02.019494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17dd1f1b-49dc-4b3b-b60a-cef93593d944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:02.020552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd1f1b-49dc-4b3b-b60a-cef93593d944 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:02.020968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd1f1b-49dc-4b3b-b60a-cef93593d944 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:02.021370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17dd1f1b-49dc-4b3b-b60a-cef93593d944 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:02.022177 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd1f1b-49dc-4b3b-b60a-cef93593d944 None admin] RBAC: Adding query filter params (name=network) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:02.022616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd1f1b-49dc-4b3b-b60a-cef93593d944 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:02.024155 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17dd1f1b-49dc-4b3b-b60a-cef93593d944 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:02.029541 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 358/718] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 19:05:01 2022] GET /identity/v3/services?name=network => generated 124 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:02.035037 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ba11f-13c1-44bd-8248-67784ee4adf2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:02.152776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346ba11f-13c1-44bd-8248-67784ee4adf2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:02.198553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2853fbcd-7a79-41e7-9288-02dd74db3b25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:02.199233 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853fbcd-7a79-41e7-9288-02dd74db3b25 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:02.199516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853fbcd-7a79-41e7-9288-02dd74db3b25 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:02.199788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2853fbcd-7a79-41e7-9288-02dd74db3b25 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:02.200440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853fbcd-7a79-41e7-9288-02dd74db3b25 None admin] RBAC: Adding query filter params (type=network) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:02.200743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853fbcd-7a79-41e7-9288-02dd74db3b25 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:02.202235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2853fbcd-7a79-41e7-9288-02dd74db3b25 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:02.211110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 361/719] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 19:05:02 2022] GET /identity/v3/services?type=network => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:03.550261 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534534f-f4eb-4378-bc02-a4e6ad043be4 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:03.551377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534534f-f4eb-4378-bc02-a4e6ad043be4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:03.551887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4534534f-f4eb-4378-bc02-a4e6ad043be4 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:03.553443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 359/720] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:03.563394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a256ad-cfed-48ca-9209-71e12a3c9711 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:03.563904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a256ad-cfed-48ca-9209-71e12a3c9711 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:03.563979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a256ad-cfed-48ca-9209-71e12a3c9711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:03.583672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bdfcb-573b-48b7-b3ec-bc9e4ce9d1c3 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:03.584311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bdfcb-573b-48b7-b3ec-bc9e4ce9d1c3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:03.584776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739bdfcb-573b-48b7-b3ec-bc9e4ce9d1c3 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:03.586815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 360/721] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:03.591174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-58a256ad-cfed-48ca-9209-71e12a3c9711 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:03.592538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-58a256ad-cfed-48ca-9209-71e12a3c9711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:03.593496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48316ba-1667-400a-9b63-075b03ba1744 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:03.594036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48316ba-1667-400a-9b63-075b03ba1744 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:03.594529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48316ba-1667-400a-9b63-075b03ba1744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:03.603204 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:03.615619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e48316ba-1667-400a-9b63-075b03ba1744 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:03.617607 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e48316ba-1667-400a-9b63-075b03ba1744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:03.650465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:03.691951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 361/722] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 15 19:05:03.751430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 362/723] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:05:03.995532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48316ba-1667-400a-9b63-075b03ba1744 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:04.087180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a256ad-cfed-48ca-9209-71e12a3c9711 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:04.138343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48316ba-1667-400a-9b63-075b03ba1744 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:04.214624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74389cd1-cc43-44ae-9e00-9cb02e21c3ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:04.215282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74389cd1-cc43-44ae-9e00-9cb02e21c3ac None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:04.215556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74389cd1-cc43-44ae-9e00-9cb02e21c3ac None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:04.215823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74389cd1-cc43-44ae-9e00-9cb02e21c3ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:04.220446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:04.240390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74389cd1-cc43-44ae-9e00-9cb02e21c3ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-74389cd1-cc43-44ae-9e00-9cb02e21c3ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:04.250333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:04.251349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:04.252192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:04.252192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:04.252192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:04.252192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:04.252192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:04.252192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:04.252192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:04.252192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:04.252192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:04.252192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:04.252192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:04.252192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:04.255064 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 362/724] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:05:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:04.261024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74389cd1-cc43-44ae-9e00-9cb02e21c3ac None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:04.261605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a256ad-cfed-48ca-9209-71e12a3c9711 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:04.325183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa3bb6-846f-44df-a91e-9e8dcb382cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:04.326248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa3bb6-846f-44df-a91e-9e8dcb382cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:04.326740 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa3bb6-846f-44df-a91e-9e8dcb382cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:04.327193 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa3bb6-846f-44df-a91e-9e8dcb382cb1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:04.341411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa3bb6-846f-44df-a91e-9e8dcb382cb1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-75aa3bb6-846f-44df-a91e-9e8dcb382cb1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:04.346950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:04.348093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:04.348985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:04.348985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:04.348985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:04.348985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:04.348985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:04.348985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:04.348985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:04.348985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:04.348985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:04.348985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:04.348985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:04.348985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:04.351680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 363/725] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:05:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:04.353092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407907d-819d-4028-84c2-c993275ea3b6 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:04.353562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407907d-819d-4028-84c2-c993275ea3b6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:04.354042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0407907d-819d-4028-84c2-c993275ea3b6 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:04.355759 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 364/726] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:04.361414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407907d-819d-4028-84c2-c993275ea3b6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:04.399951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74389cd1-cc43-44ae-9e00-9cb02e21c3ac None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:04.402204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:04.444768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5540b0e7-ab2c-493e-96e1-8e38e331723b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:04.445659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540b0e7-ab2c-493e-96e1-8e38e331723b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:04.445978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540b0e7-ab2c-493e-96e1-8e38e331723b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:04.446250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5540b0e7-ab2c-493e-96e1-8e38e331723b None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:04.447176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540b0e7-ab2c-493e-96e1-8e38e331723b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:04.447892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540b0e7-ab2c-493e-96e1-8e38e331723b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:04.449550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5540b0e7-ab2c-493e-96e1-8e38e331723b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:04.461016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 363/727] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:05:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:04.462840 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf66e-1c3d-496d-919b-6ed7a47b0453 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:04.463125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf66e-1c3d-496d-919b-6ed7a47b0453 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:04.463428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95adf66e-1c3d-496d-919b-6ed7a47b0453 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:04.488373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-95adf66e-1c3d-496d-919b-6ed7a47b0453 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:04.489773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-95adf66e-1c3d-496d-919b-6ed7a47b0453 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:04.490123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0407907d-819d-4028-84c2-c993275ea3b6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:04.528489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba2ed5-2437-477d-bab7-16d96231bad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:04.529295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba2ed5-2437-477d-bab7-16d96231bad2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:04.529673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba2ed5-2437-477d-bab7-16d96231bad2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:04.530071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba2ed5-2437-477d-bab7-16d96231bad2 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:04.530836 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba2ed5-2437-477d-bab7-16d96231bad2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:04.531244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba2ed5-2437-477d-bab7-16d96231bad2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:04.532762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba2ed5-2437-477d-bab7-16d96231bad2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:04.543052 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 365/728] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:05:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:04.544070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba2ed5-2437-477d-bab7-16d96231bad2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:04.559596 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:04.578524 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 364/729] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:05:04.579580 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adf66e-1c3d-496d-919b-6ed7a47b0453 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:04.749224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:04.752817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95adf66e-1c3d-496d-919b-6ed7a47b0453 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:04.783063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba2ed5-2437-477d-bab7-16d96231bad2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:04.809102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbea926-2e7f-4afd-b43f-78beb9ec234d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:04.809756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbea926-2e7f-4afd-b43f-78beb9ec234d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:04.810056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbea926-2e7f-4afd-b43f-78beb9ec234d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:04.810322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbea926-2e7f-4afd-b43f-78beb9ec234d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:04.821295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbea926-2e7f-4afd-b43f-78beb9ec234d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:04.822987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbea926-2e7f-4afd-b43f-78beb9ec234d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:04.823643 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f4166-326c-471d-a4ba-f130e66fbace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:04.824513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f4166-326c-471d-a4ba-f130e66fbace None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:04.824972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f4166-326c-471d-a4ba-f130e66fbace None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:04.825441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f4166-326c-471d-a4ba-f130e66fbace None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:04.837696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f4166-326c-471d-a4ba-f130e66fbace None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ffbea926-2e7f-4afd-b43f-78beb9ec234d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:04.839014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:04.839942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:04.840819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:04.840819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:04.840819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:04.840819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 365/730] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:04.841914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f4166-326c-471d-a4ba-f130e66fbace None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:04.846384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b80137-8e83-4e36-a4c0-359db489059d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:04.847069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b80137-8e83-4e36-a4c0-359db489059d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:04.847410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b80137-8e83-4e36-a4c0-359db489059d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:04.853412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 366/731] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:04 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:04.853412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b80137-8e83-4e36-a4c0-359db489059d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-626f4166-326c-471d-a4ba-f130e66fbace None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:04.866718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:04.867933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:04.869050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:04.869050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:04.869050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:04.875245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 366/732] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:04.875245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017c392-4eca-440e-8da4-d2b0a3e50d83 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:04.875245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017c392-4eca-440e-8da4-d2b0a3e50d83 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:04.875245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017c392-4eca-440e-8da4-d2b0a3e50d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:04.893721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e017c392-4eca-440e-8da4-d2b0a3e50d83 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:04.896096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e017c392-4eca-440e-8da4-d2b0a3e50d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:04.909754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:04.969080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 367/733] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:05:04.970038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017c392-4eca-440e-8da4-d2b0a3e50d83 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:04.989166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b80137-8e83-4e36-a4c0-359db489059d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:05.034663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3a317-b1c8-413a-afb3-ea4d242214cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:05.036015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3a317-b1c8-413a-afb3-ea4d242214cf None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:05.036613 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3a317-b1c8-413a-afb3-ea4d242214cf None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:05.037077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3a317-b1c8-413a-afb3-ea4d242214cf None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:05.037976 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:05.038614 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3a317-b1c8-413a-afb3-ea4d242214cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:05.040059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3a317-b1c8-413a-afb3-ea4d242214cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:05.042131 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3a317-b1c8-413a-afb3-ea4d242214cf None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:05.062825 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 367/734] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:05.063050 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3a317-b1c8-413a-afb3-ea4d242214cf None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:05.080994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017c392-4eca-440e-8da4-d2b0a3e50d83 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:05.122810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dc2af-76c9-4ecc-803c-0298499dbfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:05.123424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dc2af-76c9-4ecc-803c-0298499dbfba None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:05.123702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dc2af-76c9-4ecc-803c-0298499dbfba None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:05.123977 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936dc2af-76c9-4ecc-803c-0298499dbfba None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:05.124632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dc2af-76c9-4ecc-803c-0298499dbfba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:05.124935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dc2af-76c9-4ecc-803c-0298499dbfba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:05.126356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936dc2af-76c9-4ecc-803c-0298499dbfba None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:05.138812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 368/735] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:05.139774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dc2af-76c9-4ecc-803c-0298499dbfba None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:05.202905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:05.206829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3a317-b1c8-413a-afb3-ea4d242214cf None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:05.241309 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8555c21-0bd9-4fb3-b58f-4d1eca39977b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:05.241949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8555c21-0bd9-4fb3-b58f-4d1eca39977b None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:05.242233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8555c21-0bd9-4fb3-b58f-4d1eca39977b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:05.242501 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8555c21-0bd9-4fb3-b58f-4d1eca39977b None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:05.243146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8555c21-0bd9-4fb3-b58f-4d1eca39977b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:05.244518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8555c21-0bd9-4fb3-b58f-4d1eca39977b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:05.265403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 368/736] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:05:05 2022] POST /identity/v3/services => generated 251 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:05:05.266627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8555c21-0bd9-4fb3-b58f-4d1eca39977b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:05.267797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936dc2af-76c9-4ecc-803c-0298499dbfba None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:05.310981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:05.347003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577bf8b-303b-49be-85b3-766fe519ef71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:05.348173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577bf8b-303b-49be-85b3-766fe519ef71 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:05.348516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577bf8b-303b-49be-85b3-766fe519ef71 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:05.348787 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577bf8b-303b-49be-85b3-766fe519ef71 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:05.359037 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577bf8b-303b-49be-85b3-766fe519ef71 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:05.360542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577bf8b-303b-49be-85b3-766fe519ef71 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0577bf8b-303b-49be-85b3-766fe519ef71 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:05.373323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:05.374701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:05.375650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:05.375650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:05.375650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:05.375650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:05.375650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:05.375650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:05.375650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:05.375650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:05.375650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:05:05.375650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:05.375650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 369/737] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 19:05:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:05.376229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6498-c99a-4712-9912-c54b6dc5b65a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:05.376229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6498-c99a-4712-9912-c54b6dc5b65a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:05.376830 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2a6498-c99a-4712-9912-c54b6dc5b65a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:05.378108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 370/738] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:05.378863 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a6498-c99a-4712-9912-c54b6dc5b65a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:05.413737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8555c21-0bd9-4fb3-b58f-4d1eca39977b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:05.461112 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebb341-b650-40cd-9749-946a9f252bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:05.461799 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebb341-b650-40cd-9749-946a9f252bca None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:05.462117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebb341-b650-40cd-9749-946a9f252bca None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:05.462392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebb341-b650-40cd-9749-946a9f252bca None admin] PATH_INFO: `/v3/users/swift` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:05.471306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebb341-b650-40cd-9749-946a9f252bca None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:05.473458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebb341-b650-40cd-9749-946a9f252bca None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-10ebb341-b650-40cd-9749-946a9f252bca None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:05.490188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:05.491372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:05.492527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:05.492527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:05.492527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:05.492527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:05.492527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:05.492527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:05.492527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:05.492527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:05.492527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 19:05:05.492527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:05.494902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 369/739] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:05:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:05.495837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebb341-b650-40cd-9749-946a9f252bca None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:05.515900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2a6498-c99a-4712-9912-c54b6dc5b65a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:05.518980 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:05.558801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2882553-1a17-4164-a63e-6085d7768d52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:05.559357 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2882553-1a17-4164-a63e-6085d7768d52 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:05.559644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2882553-1a17-4164-a63e-6085d7768d52 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:05.559888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2882553-1a17-4164-a63e-6085d7768d52 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:05.573411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2882553-1a17-4164-a63e-6085d7768d52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d2882553-1a17-4164-a63e-6085d7768d52 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:05.578515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:05.579594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:05.580448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:05.580448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:05.580448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:05.580448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:05.580448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:05.580448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:05.580448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:05.580448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:05.580448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:05.580448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:05.580448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:05:05.580448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:05.584822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 371/740] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:05:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:05.585947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4083c-a2dd-4635-9bf0-02295b070b92 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:05.586226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4083c-a2dd-4635-9bf0-02295b070b92 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:05.586495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed4083c-a2dd-4635-9bf0-02295b070b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:05.607820 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3ed4083c-a2dd-4635-9bf0-02295b070b92 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:05.609020 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3ed4083c-a2dd-4635-9bf0-02295b070b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:05.614370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebb341-b650-40cd-9749-946a9f252bca None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:05.649978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:05.666402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe7047-6973-401e-853c-a1dec81a43c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:05.666980 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe7047-6973-401e-853c-a1dec81a43c8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:05.667260 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe7047-6973-401e-853c-a1dec81a43c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:05.667535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fe7047-6973-401e-853c-a1dec81a43c8 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:05.668267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe7047-6973-401e-853c-a1dec81a43c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:05.668571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe7047-6973-401e-853c-a1dec81a43c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:05.670031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fe7047-6973-401e-853c-a1dec81a43c8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:05.685257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 372/741] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:05 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 15 19:05:05.686138 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4083c-a2dd-4635-9bf0-02295b070b92 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:05.699253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 370/742] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 19:05:05 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:05.700497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe7047-6973-401e-853c-a1dec81a43c8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:05.806108 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:05.811090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed4083c-a2dd-4635-9bf0-02295b070b92 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:05.838632 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fe7047-6973-401e-853c-a1dec81a43c8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:05.851888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d4992-b0a5-4fad-a7e5-08bab1721449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:05.852649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d4992-b0a5-4fad-a7e5-08bab1721449 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:05.853039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d4992-b0a5-4fad-a7e5-08bab1721449 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:05.853395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00d4992-b0a5-4fad-a7e5-08bab1721449 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:05.854276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d4992-b0a5-4fad-a7e5-08bab1721449 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:05.854676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d4992-b0a5-4fad-a7e5-08bab1721449 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:05.856364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00d4992-b0a5-4fad-a7e5-08bab1721449 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:05.878638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 373/743] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 15 19:05:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:05.880464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d4992-b0a5-4fad-a7e5-08bab1721449 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:05.885350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322a07e-83ce-414d-86e8-784c43e638e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:05.886231 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322a07e-83ce-414d-86e8-784c43e638e5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:05.886650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322a07e-83ce-414d-86e8-784c43e638e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:05.887057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a322a07e-83ce-414d-86e8-784c43e638e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:05.887877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322a07e-83ce-414d-86e8-784c43e638e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:05.888316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322a07e-83ce-414d-86e8-784c43e638e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:05.889855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a322a07e-83ce-414d-86e8-784c43e638e5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:05.908180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 371/744] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:05:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:05.908180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322a07e-83ce-414d-86e8-784c43e638e5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:05.926027 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:06.004972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00d4992-b0a5-4fad-a7e5-08bab1721449 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:06.030669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a322a07e-83ce-414d-86e8-784c43e638e5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:06.041130 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f1a11-1442-4e3b-ac0c-dca689f77c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:06.041913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f1a11-1442-4e3b-ac0c-dca689f77c42 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:06.042115 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f1a11-1442-4e3b-ac0c-dca689f77c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:06.042381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f1a11-1442-4e3b-ac0c-dca689f77c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:06.052841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f1a11-1442-4e3b-ac0c-dca689f77c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:06.054383 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f1a11-1442-4e3b-ac0c-dca689f77c42 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:06.067744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a05b5e-b653-4616-a6a7-9bdd82fe58a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:06.068267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a05b5e-b653-4616-a6a7-9bdd82fe58a7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:06.068541 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a05b5e-b653-4616-a6a7-9bdd82fe58a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:06.068831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a05b5e-b653-4616-a6a7-9bdd82fe58a7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-2f8f1a11-1442-4e3b-ac0c-dca689f77c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:06.069956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:06.070842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:06.076718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:06.076718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:06.076718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:06.076718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 374/745] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:06.076718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f1a11-1442-4e3b-ac0c-dca689f77c42 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:06.078292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:06.142145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a05b5e-b653-4616-a6a7-9bdd82fe58a7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:06.143596 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a05b5e-b653-4616-a6a7-9bdd82fe58a7 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:06.165920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:06.192831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f1a11-1442-4e3b-ac0c-dca689f77c42 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:06.232790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7d2ad-c7df-421f-a5a0-3dac21bbff7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:06.233432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7d2ad-c7df-421f-a5a0-3dac21bbff7a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:06.233712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7d2ad-c7df-421f-a5a0-3dac21bbff7a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:06.234033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c7d2ad-c7df-421f-a5a0-3dac21bbff7a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:06.245813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7d2ad-c7df-421f-a5a0-3dac21bbff7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:06.247268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c7d2ad-c7df-421f-a5a0-3dac21bbff7a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:06.251422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 372/746] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:05:05 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 15 19:05:06.256902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a05b5e-b653-4616-a6a7-9bdd82fe58a7 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-a6c7d2ad-c7df-421f-a5a0-3dac21bbff7a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:06.262483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:06.263423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:06.269071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:06.269071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:06.269071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:06.269071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 375/747] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:06.269071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7d2ad-c7df-421f-a5a0-3dac21bbff7a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:06.304050 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:06.368622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a05b5e-b653-4616-a6a7-9bdd82fe58a7 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:06.389306 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c7d2ad-c7df-421f-a5a0-3dac21bbff7a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:06.402804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b368d-8fa8-4f99-a490-5e1a5c1d75ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:06.403526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b368d-8fa8-4f99-a490-5e1a5c1d75ca None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:06.403723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b368d-8fa8-4f99-a490-5e1a5c1d75ca None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:06.403944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454b368d-8fa8-4f99-a490-5e1a5c1d75ca None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:06.404589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b368d-8fa8-4f99-a490-5e1a5c1d75ca None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:06.406021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454b368d-8fa8-4f99-a490-5e1a5c1d75ca None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:06.422589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 373/748] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:05:06 2022] POST /identity/v3/services => generated 240 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:05:06.423748 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b368d-8fa8-4f99-a490-5e1a5c1d75ca None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:06.438086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf52bad-2554-4a2f-83c5-cd0649336218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:06.438920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf52bad-2554-4a2f-83c5-cd0649336218 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:06.439196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf52bad-2554-4a2f-83c5-cd0649336218 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:06.439470 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf52bad-2554-4a2f-83c5-cd0649336218 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:06.440261 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf52bad-2554-4a2f-83c5-cd0649336218 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:06.440634 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf52bad-2554-4a2f-83c5-cd0649336218 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:06.442376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf52bad-2554-4a2f-83c5-cd0649336218 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:06.454239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:06.460014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 376/749] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:06.461029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf52bad-2554-4a2f-83c5-cd0649336218 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:06.560676 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454b368d-8fa8-4f99-a490-5e1a5c1d75ca None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:06.578207 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:06.603832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f8cd8-b1ab-4c6e-97e2-ce95a0da1e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:06.604755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f8cd8-b1ab-4c6e-97e2-ce95a0da1e2d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:06.605143 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f8cd8-b1ab-4c6e-97e2-ce95a0da1e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:06.605417 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f8cd8-b1ab-4c6e-97e2-ce95a0da1e2d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:06.616111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf52bad-2554-4a2f-83c5-cd0649336218 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:06.619507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f8cd8-b1ab-4c6e-97e2-ce95a0da1e2d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:06.621563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18f8cd8-b1ab-4c6e-97e2-ce95a0da1e2d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-a18f8cd8-b1ab-4c6e-97e2-ce95a0da1e2d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:06.639089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:06.640103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:06.640972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:06.640972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:06.640972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:06.640972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 374/750] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:06.642436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f8cd8-b1ab-4c6e-97e2-ce95a0da1e2d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:06.668016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d4dd8-0cb8-47a5-bdee-249a75da4cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:06.669484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d4dd8-0cb8-47a5-bdee-249a75da4cf4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:06.669993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d4dd8-0cb8-47a5-bdee-249a75da4cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:06.671041 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d4dd8-0cb8-47a5-bdee-249a75da4cf4 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:06.672322 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d4dd8-0cb8-47a5-bdee-249a75da4cf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:06.672914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d4dd8-0cb8-47a5-bdee-249a75da4cf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:06.675146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d4dd8-0cb8-47a5-bdee-249a75da4cf4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:06.693327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 377/751] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:06.695847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d4dd8-0cb8-47a5-bdee-249a75da4cf4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:06.767797 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18f8cd8-b1ab-4c6e-97e2-ce95a0da1e2d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:06.773094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:06.811776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9719803-d019-4e6f-8595-caeda247a80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:06.813223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9719803-d019-4e6f-8595-caeda247a80b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:06.813881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9719803-d019-4e6f-8595-caeda247a80b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:06.814483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9719803-d019-4e6f-8595-caeda247a80b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:06.819315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d4dd8-0cb8-47a5-bdee-249a75da4cf4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:06.824488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9719803-d019-4e6f-8595-caeda247a80b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:06.826205 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9719803-d019-4e6f-8595-caeda247a80b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-a9719803-d019-4e6f-8595-caeda247a80b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:06.845816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:06.847116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:06.848187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:06.848187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:06.848187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:06.848187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:06.848187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:06.848187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:06.848187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:06.848187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:06.851307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 375/752] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:06.852379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9719803-d019-4e6f-8595-caeda247a80b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:06.862871 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58130ab4-8291-4bcc-ace2-43aa27953949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:06.864035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58130ab4-8291-4bcc-ace2-43aa27953949 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:06.864526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58130ab4-8291-4bcc-ace2-43aa27953949 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:06.865043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58130ab4-8291-4bcc-ace2-43aa27953949 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:06.865933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58130ab4-8291-4bcc-ace2-43aa27953949 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:06.866900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58130ab4-8291-4bcc-ace2-43aa27953949 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:06.868896 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58130ab4-8291-4bcc-ace2-43aa27953949 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:06.870086 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:06.886553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 378/753] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:06.888067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58130ab4-8291-4bcc-ace2-43aa27953949 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:06.966785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9719803-d019-4e6f-8595-caeda247a80b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:07.009234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae439b1d-97ef-42f6-a1ca-ff6574a05fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:07.009916 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae439b1d-97ef-42f6-a1ca-ff6574a05fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:07.010198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae439b1d-97ef-42f6-a1ca-ff6574a05fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:07.010471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae439b1d-97ef-42f6-a1ca-ff6574a05fc4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:07.020367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae439b1d-97ef-42f6-a1ca-ff6574a05fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:07.021842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae439b1d-97ef-42f6-a1ca-ff6574a05fc4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:07.022200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58130ab4-8291-4bcc-ace2-43aa27953949 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ae439b1d-97ef-42f6-a1ca-ff6574a05fc4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:07.033773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:07.034788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:07.035908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:07.035908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:07.035908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:07.035908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:07.035908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:07.035908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:07.035908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:07.035908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:07.035908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 19:05:07.035908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:07.035908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 376/754] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 19:05:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:07.036508 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:07.036578 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae439b1d-97ef-42f6-a1ca-ff6574a05fc4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:07.064260 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ab7bd-6e47-4527-9586-bd79174532a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:07.064915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ab7bd-6e47-4527-9586-bd79174532a4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:07.065197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ab7bd-6e47-4527-9586-bd79174532a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:07.065469 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574ab7bd-6e47-4527-9586-bd79174532a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:07.066337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ab7bd-6e47-4527-9586-bd79174532a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:07.066931 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ab7bd-6e47-4527-9586-bd79174532a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:07.068488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574ab7bd-6e47-4527-9586-bd79174532a4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:07.086706 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 379/755] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:07.087788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ab7bd-6e47-4527-9586-bd79174532a4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:07.110496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:07.142934 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae439b1d-97ef-42f6-a1ca-ff6574a05fc4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:07.177437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44207fa-eed4-40c6-b03f-4724ace205e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:07.178210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44207fa-eed4-40c6-b03f-4724ace205e5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:07.178684 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44207fa-eed4-40c6-b03f-4724ace205e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:07.178919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44207fa-eed4-40c6-b03f-4724ace205e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:07.186128 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44207fa-eed4-40c6-b03f-4724ace205e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:07.187694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44207fa-eed4-40c6-b03f-4724ace205e5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c44207fa-eed4-40c6-b03f-4724ace205e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:07.199745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:07.200893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:07.202062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:07.202062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:07.202062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:07.202062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:07.202062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:07.202062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:07.202062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:07.202062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:07.202905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 377/756] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:07.203733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44207fa-eed4-40c6-b03f-4724ace205e5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:07.204871 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574ab7bd-6e47-4527-9586-bd79174532a4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:07.243979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b54cf-bf65-43c5-9fe6-b5ddd5de735e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:07.244950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b54cf-bf65-43c5-9fe6-b5ddd5de735e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:07.245409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b54cf-bf65-43c5-9fe6-b5ddd5de735e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:07.245903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe9b54cf-bf65-43c5-9fe6-b5ddd5de735e None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:07.246823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b54cf-bf65-43c5-9fe6-b5ddd5de735e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:07.247306 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b54cf-bf65-43c5-9fe6-b5ddd5de735e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:07.249083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe9b54cf-bf65-43c5-9fe6-b5ddd5de735e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:07.269907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 380/757] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 15 19:05:07 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:07.271600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b54cf-bf65-43c5-9fe6-b5ddd5de735e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:07.302723 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:07.313876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44207fa-eed4-40c6-b03f-4724ace205e5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:07.342752 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:07.348817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136fd6b-9d92-4a75-9701-df9da62368a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:07.349628 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136fd6b-9d92-4a75-9701-df9da62368a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:07.349954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136fd6b-9d92-4a75-9701-df9da62368a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:07.350236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5136fd6b-9d92-4a75-9701-df9da62368a5 None admin] PATH_INFO: `/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/38b19e4add2a4321a2fbfeb9a3a1b61d/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:07.352306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136fd6b-9d92-4a75-9701-df9da62368a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=2958a115e7974fc4b5c74a633fc4322c, user_id=38b19e4add2a4321a2fbfeb9a3a1b61d, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:07.353710 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5136fd6b-9d92-4a75-9701-df9da62368a5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:07.377811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 378/758] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:05:07 2022] PUT /identity/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/38b19e4add2a4321a2fbfeb9a3a1b61d/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:05:07.377811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136fd6b-9d92-4a75-9701-df9da62368a5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:07.401011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe9b54cf-bf65-43c5-9fe6-b5ddd5de735e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:07.476546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1763e8-1461-4395-8098-c17bec508830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:07.477496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1763e8-1461-4395-8098-c17bec508830 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:07.477989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1763e8-1461-4395-8098-c17bec508830 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:07.478443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1763e8-1461-4395-8098-c17bec508830 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:07.479328 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1763e8-1461-4395-8098-c17bec508830 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:07.479837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1763e8-1461-4395-8098-c17bec508830 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:07.481563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1763e8-1461-4395-8098-c17bec508830 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:07.495221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 381/759] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:07.505864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5136fd6b-9d92-4a75-9701-df9da62368a5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:07.506093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1763e8-1461-4395-8098-c17bec508830 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:07.545507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ccc5b-b5ae-41e5-9f0b-f8a5eee06c9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:07.546257 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ccc5b-b5ae-41e5-9f0b-f8a5eee06c9a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:07.546650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ccc5b-b5ae-41e5-9f0b-f8a5eee06c9a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:07.546983 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ccc5b-b5ae-41e5-9f0b-f8a5eee06c9a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:07.641707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ccc5b-b5ae-41e5-9f0b-f8a5eee06c9a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:07.643973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91ccc5b-b5ae-41e5-9f0b-f8a5eee06c9a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:07.658300 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:07.660610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:07.679487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1763e8-1461-4395-8098-c17bec508830 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:07.730974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49e9ce0-d52b-4e61-8455-39683769491a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:07.732123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9ce0-d52b-4e61-8455-39683769491a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:07.732648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9ce0-d52b-4e61-8455-39683769491a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:07.733109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49e9ce0-d52b-4e61-8455-39683769491a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:07.734690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e9ce0-d52b-4e61-8455-39683769491a None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=3940f3578cc44d4d8ebe074216a65f2e) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:07.735451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e9ce0-d52b-4e61-8455-39683769491a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:07.737405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49e9ce0-d52b-4e61-8455-39683769491a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:07.749627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 382/760] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:05:07 2022] GET /identity/v3/role_assignments?user.id=3940f3578cc44d4d8ebe074216a65f2e&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 259 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:07.752676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea25746-11f0-4de4-ba3c-cc7e35648b9e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:07.753264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea25746-11f0-4de4-ba3c-cc7e35648b9e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:07.753735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea25746-11f0-4de4-ba3c-cc7e35648b9e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:07.755781 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 383/761] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:07.765756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a88b5d-1370-4005-bb8f-139da02da981 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:07.766509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a88b5d-1370-4005-bb8f-139da02da981 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:07.766979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a88b5d-1370-4005-bb8f-139da02da981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:07.790233 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a0a88b5d-1370-4005-bb8f-139da02da981 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:07.792114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a0a88b5d-1370-4005-bb8f-139da02da981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:07.810228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 379/762] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:05:07 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:05:07.818951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ccc5b-b5ae-41e5-9f0b-f8a5eee06c9a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:07.893180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 384/763] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:07 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:07.984227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:07.997579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91ccc5b-b5ae-41e5-9f0b-f8a5eee06c9a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:08.041922 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8498e-fd0c-429a-88d8-16201ad55bbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:08.043407 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8498e-fd0c-429a-88d8-16201ad55bbb None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:08.043964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8498e-fd0c-429a-88d8-16201ad55bbb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:08.044427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8498e-fd0c-429a-88d8-16201ad55bbb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:08.057698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8498e-fd0c-429a-88d8-16201ad55bbb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:08.059659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8498e-fd0c-429a-88d8-16201ad55bbb None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-92b8498e-fd0c-429a-88d8-16201ad55bbb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:08.079044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:08.080035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:08.081377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:08.081377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:08.081377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:08.084091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 380/764] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:08.091009 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a88b5d-1370-4005-bb8f-139da02da981 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:08.213078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:08.235100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a88b5d-1370-4005-bb8f-139da02da981 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:08.283416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b5275-ab52-4d5b-9502-f66125b2e4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:08.284820 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8498e-fd0c-429a-88d8-16201ad55bbb None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:08.286366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b5275-ab52-4d5b-9502-f66125b2e4b7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:08.286644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b5275-ab52-4d5b-9502-f66125b2e4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:08.286902 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6b5275-ab52-4d5b-9502-f66125b2e4b7 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:08.287572 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b5275-ab52-4d5b-9502-f66125b2e4b7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:08.287874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b5275-ab52-4d5b-9502-f66125b2e4b7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:08.289343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6b5275-ab52-4d5b-9502-f66125b2e4b7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:08.320694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 385/765] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:08.326405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b5275-ab52-4d5b-9502-f66125b2e4b7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:08.417950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8498e-fd0c-429a-88d8-16201ad55bbb None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:08.457372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e3d1d-4a1e-4168-a4c2-85dfb5c840cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:08.458143 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3d1d-4a1e-4168-a4c2-85dfb5c840cf None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:08.458489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3d1d-4a1e-4168-a4c2-85dfb5c840cf None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:08.458832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f6e3d1d-4a1e-4168-a4c2-85dfb5c840cf None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:08.459629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e3d1d-4a1e-4168-a4c2-85dfb5c840cf None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:08.461138 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f6e3d1d-4a1e-4168-a4c2-85dfb5c840cf None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-0f6e3d1d-4a1e-4168-a4c2-85dfb5c840cf None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:08.476458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:08.477669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:08.478921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 381/766] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Sep 15 19:05:08 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:08.484101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e3d1d-4a1e-4168-a4c2-85dfb5c840cf None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:08.493810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:08.513559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6b5275-ab52-4d5b-9502-f66125b2e4b7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:08.558613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4d16a-5bd2-4db8-aab5-f790e9d22a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:08.559679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d16a-5bd2-4db8-aab5-f790e9d22a6d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:08.560148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d16a-5bd2-4db8-aab5-f790e9d22a6d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:08.560638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de4d16a-5bd2-4db8-aab5-f790e9d22a6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:08.574536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4d16a-5bd2-4db8-aab5-f790e9d22a6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:08.580724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de4d16a-5bd2-4db8-aab5-f790e9d22a6d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-7de4d16a-5bd2-4db8-aab5-f790e9d22a6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:08.597987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:08.599127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:08.600001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:08.600001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:08.600001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:08.600001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:08.600001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:08.600001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:08.600001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:08.600001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:08.602840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 386/767] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:08.609684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4d16a-5bd2-4db8-aab5-f790e9d22a6d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:08.614907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:08.716151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f6e3d1d-4a1e-4168-a4c2-85dfb5c840cf None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:08.748405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de4d16a-5bd2-4db8-aab5-f790e9d22a6d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:08.792953 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f656f0-8824-4af6-ac13-51c4b157a38f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:08.794488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f656f0-8824-4af6-ac13-51c4b157a38f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:08.795012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f656f0-8824-4af6-ac13-51c4b157a38f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:08.795476 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f656f0-8824-4af6-ac13-51c4b157a38f None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:08.796375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f656f0-8824-4af6-ac13-51c4b157a38f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:08.796890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f656f0-8824-4af6-ac13-51c4b157a38f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:08.798846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f656f0-8824-4af6-ac13-51c4b157a38f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:08.813651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 387/768] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:08.823074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771e721-e186-45e1-94aa-745b6ae32412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:08.823724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771e721-e186-45e1-94aa-745b6ae32412 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:08.824007 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771e721-e186-45e1-94aa-745b6ae32412 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:08.824253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f656f0-8824-4af6-ac13-51c4b157a38f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:08.824382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771e721-e186-45e1-94aa-745b6ae32412 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:08.824924 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771e721-e186-45e1-94aa-745b6ae32412 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:08.825216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771e721-e186-45e1-94aa-745b6ae32412 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:08.826692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7771e721-e186-45e1-94aa-745b6ae32412 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:08.836850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 382/769] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 15 19:05:08 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:08.841206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771e721-e186-45e1-94aa-745b6ae32412 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:08.952998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:08.997551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f656f0-8824-4af6-ac13-51c4b157a38f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:08.999936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:09.040447 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b544d9-acdb-4d7b-bd6c-1d5fac49c4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:09.041502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b544d9-acdb-4d7b-bd6c-1d5fac49c4c7 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:09.042423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b544d9-acdb-4d7b-bd6c-1d5fac49c4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:09.042962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b544d9-acdb-4d7b-bd6c-1d5fac49c4c7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:09.043973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b544d9-acdb-4d7b-bd6c-1d5fac49c4c7 None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=cd3b9f8c819d4ac1b6ded6ea1a91e68f) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:09.044506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b544d9-acdb-4d7b-bd6c-1d5fac49c4c7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:09.055993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b544d9-acdb-4d7b-bd6c-1d5fac49c4c7 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:09.063977 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 388/770] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:05:08 2022] GET /identity/v3/role_assignments?user.id=cd3b9f8c819d4ac1b6ded6ea1a91e68f&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:09.082385 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771e721-e186-45e1-94aa-745b6ae32412 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:09.129568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3edcdd5-5b3d-45a5-87af-7e08b5648b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:09.130228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edcdd5-5b3d-45a5-87af-7e08b5648b11 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:09.130502 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edcdd5-5b3d-45a5-87af-7e08b5648b11 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:09.130765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3edcdd5-5b3d-45a5-87af-7e08b5648b11 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:09.131402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edcdd5-5b3d-45a5-87af-7e08b5648b11 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:09.131703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edcdd5-5b3d-45a5-87af-7e08b5648b11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:09.133084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3edcdd5-5b3d-45a5-87af-7e08b5648b11 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:09.140714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 383/771] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 15 19:05:08 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:09.146764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b544d9-acdb-4d7b-bd6c-1d5fac49c4c7 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:09.210615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6870b-856f-4052-bc58-7d571256bec0 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:09.210960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6870b-856f-4052-bc58-7d571256bec0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:09.211177 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d6870b-856f-4052-bc58-7d571256bec0 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:09.212765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 384/772] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:09.218524 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42796c04-011d-4f2b-bef4-33033d18bf12 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:09.218810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42796c04-011d-4f2b-bef4-33033d18bf12 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:09.219063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42796c04-011d-4f2b-bef4-33033d18bf12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:09.238890 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-42796c04-011d-4f2b-bef4-33033d18bf12 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:09.240117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-42796c04-011d-4f2b-bef4-33033d18bf12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:09.334872 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b544d9-acdb-4d7b-bd6c-1d5fac49c4c7 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:09.339969 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 385/773] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:09 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:05:09.366849 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:09.385053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60876a-a920-4901-8847-6ba2033fedb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:09.395294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60876a-a920-4901-8847-6ba2033fedb4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:09.395845 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60876a-a920-4901-8847-6ba2033fedb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:09.396279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd60876a-a920-4901-8847-6ba2033fedb4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:09.397160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60876a-a920-4901-8847-6ba2033fedb4 None admin] RBAC: Adding query filter params (interface=public, service_id=8d0a2c14566f46a1affb266aae742b5d, region_id=RegionOne) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:09.397613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60876a-a920-4901-8847-6ba2033fedb4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:09.399233 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd60876a-a920-4901-8847-6ba2033fedb4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:09.413623 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 389/774] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 19:05:09 2022] GET /identity/v3/endpoints?service_id=8d0a2c14566f46a1affb266aae742b5d&interface=public®ion_id=RegionOne => generated 194 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:09.420860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42796c04-011d-4f2b-bef4-33033d18bf12 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:09.529705 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:09.578350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42796c04-011d-4f2b-bef4-33033d18bf12 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:09.625533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96654049-6687-49b0-bda0-31644b74ef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:09.626184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96654049-6687-49b0-bda0-31644b74ef57 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:09.626457 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96654049-6687-49b0-bda0-31644b74ef57 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:09.626724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96654049-6687-49b0-bda0-31644b74ef57 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:09.627331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96654049-6687-49b0-bda0-31644b74ef57 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:09.628698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96654049-6687-49b0-bda0-31644b74ef57 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:09.634869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 386/775] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 19:05:09 2022] GET /identity/v3/services => generated 772 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:09.689326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60876a-a920-4901-8847-6ba2033fedb4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:09.843810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd60876a-a920-4901-8847-6ba2033fedb4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:09.885724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b690a-bf69-4e6a-ae39-855bd07b8efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:09.886450 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b690a-bf69-4e6a-ae39-855bd07b8efc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:09.886730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b690a-bf69-4e6a-ae39-855bd07b8efc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:09.887004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89b690a-bf69-4e6a-ae39-855bd07b8efc None admin] PATH_INFO: `/v3/services/network` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:09.887606 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b690a-bf69-4e6a-ae39-855bd07b8efc None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:09.888997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89b690a-bf69-4e6a-ae39-855bd07b8efc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d89b690a-bf69-4e6a-ae39-855bd07b8efc None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:09.898736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:09.899803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:09.901092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 390/776] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:09 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:09.907057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96654049-6687-49b0-bda0-31644b74ef57 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:10.021316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96654049-6687-49b0-bda0-31644b74ef57 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:10.054343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:10.063577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8483a6-e652-457e-8f31-726e05746680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:10.064633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8483a6-e652-457e-8f31-726e05746680 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:10.065306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8483a6-e652-457e-8f31-726e05746680 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:10.065576 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8483a6-e652-457e-8f31-726e05746680 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:10.066250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8483a6-e652-457e-8f31-726e05746680 None admin] RBAC: Adding query filter params (name=network) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:10.066591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8483a6-e652-457e-8f31-726e05746680 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:10.068677 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a8483a6-e652-457e-8f31-726e05746680 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:10.074356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 387/777] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 19:05:09 2022] GET /identity/v3/services?name=network => generated 124 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:10.080309 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b690a-bf69-4e6a-ae39-855bd07b8efc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:10.168444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:10.217843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89b690a-bf69-4e6a-ae39-855bd07b8efc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:10.244315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e034da6-685c-4560-adc9-7bf776b16cba None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:10.244643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e034da6-685c-4560-adc9-7bf776b16cba None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:10.244864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e034da6-685c-4560-adc9-7bf776b16cba None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:10.246590 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 388/778] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:10.254409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e98cde-f33e-452e-8cd2-1cbddaedc0e6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:10.254724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e98cde-f33e-452e-8cd2-1cbddaedc0e6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:10.254969 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e98cde-f33e-452e-8cd2-1cbddaedc0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:10.282061 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b7c9e-5158-41c5-b005-7a0de32d493c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:10.282757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7c9e-5158-41c5-b005-7a0de32d493c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:10.283040 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7c9e-5158-41c5-b005-7a0de32d493c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:10.283310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879b7c9e-5158-41c5-b005-7a0de32d493c None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:10.283956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b7c9e-5158-41c5-b005-7a0de32d493c None admin] RBAC: Adding query filter params (type=network) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:10.284260 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b7c9e-5158-41c5-b005-7a0de32d493c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:10.286461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879b7c9e-5158-41c5-b005-7a0de32d493c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:10.289555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-51e98cde-f33e-452e-8cd2-1cbddaedc0e6 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:10.290942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-51e98cde-f33e-452e-8cd2-1cbddaedc0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:10.294398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 391/779] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 19:05:10 2022] GET /identity/v3/services?type=network => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:10.301569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b7c9e-5158-41c5-b005-7a0de32d493c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:10.459938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879b7c9e-5158-41c5-b005-7a0de32d493c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:10.481885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 389/780] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:10.498899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:10.526613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f37ad11f-f8a3-41c5-b4b5-c8ddcc83d4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:10.527600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ad11f-f8a3-41c5-b4b5-c8ddcc83d4d0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:10.528096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ad11f-f8a3-41c5-b4b5-c8ddcc83d4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:10.528555 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f37ad11f-f8a3-41c5-b4b5-c8ddcc83d4d0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:10.529445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ad11f-f8a3-41c5-b4b5-c8ddcc83d4d0 None admin] RBAC: Adding query filter params (interface=public, service_id=f30e4d3b1cba48d391c24fbc98904864, region_id=RegionOne) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:10.529989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ad11f-f8a3-41c5-b4b5-c8ddcc83d4d0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:10.531550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f37ad11f-f8a3-41c5-b4b5-c8ddcc83d4d0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:10.542342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 392/781] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 19:05:10 2022] GET /identity/v3/endpoints?service_id=f30e4d3b1cba48d391c24fbc98904864&interface=public®ion_id=RegionOne => generated 194 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:10.548360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e98cde-f33e-452e-8cd2-1cbddaedc0e6 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:10.578373 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b566a-57b9-4597-84c0-0fe3629bda3e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:10.579006 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b566a-57b9-4597-84c0-0fe3629bda3e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:10.579471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5b566a-57b9-4597-84c0-0fe3629bda3e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:10.581025 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 393/782] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:05:10.593493 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2689dc-7b53-4030-bcc6-975f1d29c64d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:10.594112 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2689dc-7b53-4030-bcc6-975f1d29c64d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:10.594578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2689dc-7b53-4030-bcc6-975f1d29c64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:10.623136 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8f2689dc-7b53-4030-bcc6-975f1d29c64d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:10.624691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8f2689dc-7b53-4030-bcc6-975f1d29c64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:10.730986 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e98cde-f33e-452e-8cd2-1cbddaedc0e6 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:10.762596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 394/783] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:10 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:05:10.773389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:10.786949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502a718-2d2c-4a19-808f-647cebc58bdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:10.787887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502a718-2d2c-4a19-808f-647cebc58bdf None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:10.788382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502a718-2d2c-4a19-808f-647cebc58bdf None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:10.788840 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a502a718-2d2c-4a19-808f-647cebc58bdf None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:10.789636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502a718-2d2c-4a19-808f-647cebc58bdf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:10.791219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a502a718-2d2c-4a19-808f-647cebc58bdf None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:10.797119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 390/784] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 19:05:10 2022] GET /identity/v3/services => generated 772 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:10.798508 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2689dc-7b53-4030-bcc6-975f1d29c64d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:10.912118 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2689dc-7b53-4030-bcc6-975f1d29c64d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:10.927508 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:10.953810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd60c6-129d-4049-87bd-688314d58e50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:10.955152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd60c6-129d-4049-87bd-688314d58e50 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:10.955668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd60c6-129d-4049-87bd-688314d58e50 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:10.956144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd60c6-129d-4049-87bd-688314d58e50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:10.968979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd60c6-129d-4049-87bd-688314d58e50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-20bd60c6-129d-4049-87bd-688314d58e50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:10.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:10.976281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:10.977098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:10.977098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:10.977098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:10.977098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:10.977098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:10.977098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:10.977098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:10.977098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:10.977098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:10.977098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:10.977098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:10.977098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:10.979904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 395/785] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:05:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:10.985566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502a718-2d2c-4a19-808f-647cebc58bdf None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:11.127958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a502a718-2d2c-4a19-808f-647cebc58bdf None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:11.134407 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd60c6-129d-4049-87bd-688314d58e50 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:11.174839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09a22e-652f-4afc-b22d-e4c55558f628 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:11.175475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09a22e-652f-4afc-b22d-e4c55558f628 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:11.176081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09a22e-652f-4afc-b22d-e4c55558f628 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:11.176081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09a22e-652f-4afc-b22d-e4c55558f628 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:11.181810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09a22e-652f-4afc-b22d-e4c55558f628 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:11.181810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09a22e-652f-4afc-b22d-e4c55558f628 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:11.181810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09a22e-652f-4afc-b22d-e4c55558f628 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:11.188353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 391/786] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:05:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:11.198871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09a22e-652f-4afc-b22d-e4c55558f628 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:11.269058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd60c6-129d-4049-87bd-688314d58e50 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:11.298614 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:11.316770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb74286-36ab-418b-a6f9-b2f8c89ca2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:11.317615 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb74286-36ab-418b-a6f9-b2f8c89ca2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:11.317925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb74286-36ab-418b-a6f9-b2f8c89ca2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:11.318199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb74286-36ab-418b-a6f9-b2f8c89ca2c3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:11.329488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb74286-36ab-418b-a6f9-b2f8c89ca2c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-7bb74286-36ab-418b-a6f9-b2f8c89ca2c3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:11.335329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:11.336275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:11.337111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:11.337111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:11.337111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:11.337111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:11.337111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:11.337111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:11.337111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:11.337111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:11.337111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:11.337111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:11.337111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:11.337111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:11.337111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 396/787] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:05:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:11.347292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb74286-36ab-418b-a6f9-b2f8c89ca2c3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:11.404869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09a22e-652f-4afc-b22d-e4c55558f628 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:11.409902 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:11.476498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b3117-8891-45a9-80dc-6d44e12bca1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:11.477157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b3117-8891-45a9-80dc-6d44e12bca1a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:11.477439 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b3117-8891-45a9-80dc-6d44e12bca1a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:11.477709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b3117-8891-45a9-80dc-6d44e12bca1a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:11.498879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b3117-8891-45a9-80dc-6d44e12bca1a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:11.500340 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b3117-8891-45a9-80dc-6d44e12bca1a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-773b3117-8891-45a9-80dc-6d44e12bca1a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:11.526815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:11.527787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:11.528658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:11.528658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:11.528658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:11.534346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 392/788] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:11.540593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b3117-8891-45a9-80dc-6d44e12bca1a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:11.542905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb74286-36ab-418b-a6f9-b2f8c89ca2c3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:11.581173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56e75e-65ab-4a6e-b094-b613b1145008 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:11.581850 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56e75e-65ab-4a6e-b094-b613b1145008 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:11.582265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56e75e-65ab-4a6e-b094-b613b1145008 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:11.582616 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a56e75e-65ab-4a6e-b094-b613b1145008 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:11.583409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56e75e-65ab-4a6e-b094-b613b1145008 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:11.583715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56e75e-65ab-4a6e-b094-b613b1145008 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:11.589815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a56e75e-65ab-4a6e-b094-b613b1145008 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:11.597812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 397/789] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:05:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:11.602889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56e75e-65ab-4a6e-b094-b613b1145008 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:11.717754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b3117-8891-45a9-80dc-6d44e12bca1a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:11.721983 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:11.765633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:11.775952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a56e75e-65ab-4a6e-b094-b613b1145008 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:11.777412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c38f931-d34c-4755-9d11-6a78a89bfe55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:11.778663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38f931-d34c-4755-9d11-6a78a89bfe55 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:11.779143 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38f931-d34c-4755-9d11-6a78a89bfe55 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:11.779614 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c38f931-d34c-4755-9d11-6a78a89bfe55 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:11.780461 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38f931-d34c-4755-9d11-6a78a89bfe55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:11.780981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38f931-d34c-4755-9d11-6a78a89bfe55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:11.782666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c38f931-d34c-4755-9d11-6a78a89bfe55 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:11.797483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 393/790] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:11.799322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6e0be-9518-42af-84a0-ca697c0b3430 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:11.799968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6e0be-9518-42af-84a0-ca697c0b3430 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:11.800444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba6e0be-9518-42af-84a0-ca697c0b3430 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:11.806364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 394/791] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:11.807650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6e0be-9518-42af-84a0-ca697c0b3430 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:11.818651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df436202-10a1-41f9-9beb-3f92b2b46a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:11.819304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df436202-10a1-41f9-9beb-3f92b2b46a48 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:11.819577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df436202-10a1-41f9-9beb-3f92b2b46a48 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:11.819844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df436202-10a1-41f9-9beb-3f92b2b46a48 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:11.831502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df436202-10a1-41f9-9beb-3f92b2b46a48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:11.833158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df436202-10a1-41f9-9beb-3f92b2b46a48 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-df436202-10a1-41f9-9beb-3f92b2b46a48 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:11.849742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:11.850786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:11.852319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:11.852319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:11.852319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:11.852319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 398/792] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:11.852668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008230f-2932-4665-9f2f-26c12e7b377d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:11.852952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008230f-2932-4665-9f2f-26c12e7b377d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:11.853218 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e008230f-2932-4665-9f2f-26c12e7b377d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:11.872577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e008230f-2932-4665-9f2f-26c12e7b377d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:11.873765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e008230f-2932-4665-9f2f-26c12e7b377d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:11.931942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba6e0be-9518-42af-84a0-ca697c0b3430 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:11.958827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 399/793] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:11.961840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008230f-2932-4665-9f2f-26c12e7b377d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:11.995103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305672a-5528-4168-b453-32c5b867c301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:11.996339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305672a-5528-4168-b453-32c5b867c301 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:11.996339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305672a-5528-4168-b453-32c5b867c301 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:11.998193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d305672a-5528-4168-b453-32c5b867c301 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:12.015002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305672a-5528-4168-b453-32c5b867c301 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:12.017247 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d305672a-5528-4168-b453-32c5b867c301 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-d305672a-5528-4168-b453-32c5b867c301 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:12.040981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:12.042013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:12.042961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:12.042961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:12.042961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:12.042961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:12.042961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:12.042961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:12.042961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:12.042961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:12.042961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:05:12.042961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:12.052274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 395/794] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 19:05:11 2022] GET /identity/v3/users/nova => generated 82 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:12.058541 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305672a-5528-4168-b453-32c5b867c301 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:12.073085 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:12.098662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e008230f-2932-4665-9f2f-26c12e7b377d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:12.107313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:12.135037 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b3394-d9dd-4564-8ae8-97efb411de99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:12.135697 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b3394-d9dd-4564-8ae8-97efb411de99 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:12.135984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b3394-d9dd-4564-8ae8-97efb411de99 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:12.136253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3b3394-d9dd-4564-8ae8-97efb411de99 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:12.136904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b3394-d9dd-4564-8ae8-97efb411de99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:12.137207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b3394-d9dd-4564-8ae8-97efb411de99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:12.138808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3b3394-d9dd-4564-8ae8-97efb411de99 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:12.151073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 400/795] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:12.162304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b3394-d9dd-4564-8ae8-97efb411de99 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:12.272420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3b3394-d9dd-4564-8ae8-97efb411de99 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:12.302185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d305672a-5528-4168-b453-32c5b867c301 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:12.313594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698e9eb-0204-45ae-acf7-c6747291f9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:12.313594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698e9eb-0204-45ae-acf7-c6747291f9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:12.313594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698e9eb-0204-45ae-acf7-c6747291f9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:12.313594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7698e9eb-0204-45ae-acf7-c6747291f9f1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:12.315438 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:12.324068 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698e9eb-0204-45ae-acf7-c6747291f9f1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:12.324068 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7698e9eb-0204-45ae-acf7-c6747291f9f1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-7698e9eb-0204-45ae-acf7-c6747291f9f1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:12.336980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:12.338232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:12.339424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:12.339424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:12.339424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:12.339424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:12.339424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:12.339424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:12.339424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:12.339424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:12.339424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 19:05:12.339424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:12.341159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 401/796] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:05:12 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:12.349809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698e9eb-0204-45ae-acf7-c6747291f9f1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:12.371102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f194f-f36d-45b2-9109-ab824a6193a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:12.371971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f194f-f36d-45b2-9109-ab824a6193a8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:12.372393 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f194f-f36d-45b2-9109-ab824a6193a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:12.372805 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f194f-f36d-45b2-9109-ab824a6193a8 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:12.373888 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f194f-f36d-45b2-9109-ab824a6193a8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:12.374335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f194f-f36d-45b2-9109-ab824a6193a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:12.375918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f194f-f36d-45b2-9109-ab824a6193a8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:12.396645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 396/797] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 19:05:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:12.397930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f194f-f36d-45b2-9109-ab824a6193a8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:12.470691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7698e9eb-0204-45ae-acf7-c6747291f9f1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:12.502302 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:12.513627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe61db-2f35-46a6-adc0-e47ebe2c1a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:12.514658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe61db-2f35-46a6-adc0-e47ebe2c1a73 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:12.515132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe61db-2f35-46a6-adc0-e47ebe2c1a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:12.515674 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe61db-2f35-46a6-adc0-e47ebe2c1a73 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:12.516796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe61db-2f35-46a6-adc0-e47ebe2c1a73 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:12.517300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe61db-2f35-46a6-adc0-e47ebe2c1a73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:12.519154 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe61db-2f35-46a6-adc0-e47ebe2c1a73 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:12.525441 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f194f-f36d-45b2-9109-ab824a6193a8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:12.540336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 402/798] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 15 19:05:12 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:12.541623 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe61db-2f35-46a6-adc0-e47ebe2c1a73 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:12.567629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392e748-34b8-43d3-99ff-b94027f5ae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:12.567629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392e748-34b8-43d3-99ff-b94027f5ae77 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:12.567629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392e748-34b8-43d3-99ff-b94027f5ae77 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:12.567962 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392e748-34b8-43d3-99ff-b94027f5ae77 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:12.579327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392e748-34b8-43d3-99ff-b94027f5ae77 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-2392e748-34b8-43d3-99ff-b94027f5ae77 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:12.584310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:12.585258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 397/799] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:05:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:12.586221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392e748-34b8-43d3-99ff-b94027f5ae77 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:12.610229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:12.657877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe61db-2f35-46a6-adc0-e47ebe2c1a73 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:12.693299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392e748-34b8-43d3-99ff-b94027f5ae77 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:12.693680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0999c-8210-4c26-8707-c52f527ff83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:12.694375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0999c-8210-4c26-8707-c52f527ff83a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:12.694645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0999c-8210-4c26-8707-c52f527ff83a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:12.694924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0999c-8210-4c26-8707-c52f527ff83a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:12.731778 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a4e76cc-68db-41e3-928f-1e8424882dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:12.732445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e76cc-68db-41e3-928f-1e8424882dcf None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:12.732725 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e76cc-68db-41e3-928f-1e8424882dcf None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:12.732998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4e76cc-68db-41e3-928f-1e8424882dcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:12.740305 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:12.745059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e76cc-68db-41e3-928f-1e8424882dcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:12.746630 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a4e76cc-68db-41e3-928f-1e8424882dcf None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-5a4e76cc-68db-41e3-928f-1e8424882dcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:12.763520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:12.764736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:12.765759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:12.765759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:12.765759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:12.765759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 398/800] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:12.767238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a72c90-49b3-4598-a6b4-e5a6233f6982 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:12.768538 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a72c90-49b3-4598-a6b4-e5a6233f6982 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:12.768874 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a72c90-49b3-4598-a6b4-e5a6233f6982 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:12.770769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 399/801] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:12.772479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a72c90-49b3-4598-a6b4-e5a6233f6982 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:12.773301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0999c-8210-4c26-8707-c52f527ff83a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:12.774964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0999c-8210-4c26-8707-c52f527ff83a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:12.837322 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:12.891179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 403/802] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:05:12 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:05:12.891179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0999c-8210-4c26-8707-c52f527ff83a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:12.906533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a72c90-49b3-4598-a6b4-e5a6233f6982 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:12.943100 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86af455-9e9a-4fc6-bbeb-558a9457f60e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:12.943708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86af455-9e9a-4fc6-bbeb-558a9457f60e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:12.943979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86af455-9e9a-4fc6-bbeb-558a9457f60e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:12.944241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86af455-9e9a-4fc6-bbeb-558a9457f60e None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:12.944896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86af455-9e9a-4fc6-bbeb-558a9457f60e None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:12.945209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86af455-9e9a-4fc6-bbeb-558a9457f60e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:12.946680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86af455-9e9a-4fc6-bbeb-558a9457f60e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:12.956111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 400/803] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:05:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:12.962283 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b8e2-03a3-4564-8641-cfdc76c0e68a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:12.962508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b8e2-03a3-4564-8641-cfdc76c0e68a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:12.962780 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0031b8e2-03a3-4564-8641-cfdc76c0e68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:12.982008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0031b8e2-03a3-4564-8641-cfdc76c0e68a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:12.984085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0031b8e2-03a3-4564-8641-cfdc76c0e68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:13.005245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0999c-8210-4c26-8707-c52f527ff83a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:13.043305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936055f1-a50f-4eb0-bca0-103529b8585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:13.044068 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936055f1-a50f-4eb0-bca0-103529b8585d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:13.044449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936055f1-a50f-4eb0-bca0-103529b8585d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:13.044782 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936055f1-a50f-4eb0-bca0-103529b8585d None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:13.045557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936055f1-a50f-4eb0-bca0-103529b8585d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:13.045995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936055f1-a50f-4eb0-bca0-103529b8585d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:13.047459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936055f1-a50f-4eb0-bca0-103529b8585d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:13.047590 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:13.064281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 404/804] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:13.064281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936055f1-a50f-4eb0-bca0-103529b8585d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:13.074179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 401/805] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:13.075374 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031b8e2-03a3-4564-8641-cfdc76c0e68a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:13.195557 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0031b8e2-03a3-4564-8641-cfdc76c0e68a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:13.218176 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:13.235371 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c925-e4c2-4e93-bdc1-29745bf21a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:13.236072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c925-e4c2-4e93-bdc1-29745bf21a91 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:13.236351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c925-e4c2-4e93-bdc1-29745bf21a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:13.236734 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0c925-e4c2-4e93-bdc1-29745bf21a91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:13.247711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0c925-e4c2-4e93-bdc1-29745bf21a91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:13.249168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0c925-e4c2-4e93-bdc1-29745bf21a91 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-91a0c925-e4c2-4e93-bdc1-29745bf21a91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:13.265195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:13.266506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:13.267646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:13.267646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:13.267646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:13.267646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 402/806] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:13.267646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c925-e4c2-4e93-bdc1-29745bf21a91 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:13.309415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:13.318552 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936055f1-a50f-4eb0-bca0-103529b8585d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:13.357229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56af2e-f215-425d-9e9e-53ea8033adac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:13.358054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56af2e-f215-425d-9e9e-53ea8033adac None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:13.358332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56af2e-f215-425d-9e9e-53ea8033adac None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:13.358602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b56af2e-f215-425d-9e9e-53ea8033adac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:13.368763 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56af2e-f215-425d-9e9e-53ea8033adac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:13.370312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b56af2e-f215-425d-9e9e-53ea8033adac None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:13.373694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0c925-e4c2-4e93-bdc1-29745bf21a91 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-3b56af2e-f215-425d-9e9e-53ea8033adac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:13.384767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:13.389987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:13.391160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:13.391160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:13.391160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:13.391160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 405/807] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:13.391160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56af2e-f215-425d-9e9e-53ea8033adac None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:13.408505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae8f022-40ff-4ce9-b2f1-72ffd380cc82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:13.409138 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8f022-40ff-4ce9-b2f1-72ffd380cc82 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:13.409418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8f022-40ff-4ce9-b2f1-72ffd380cc82 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:13.409696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae8f022-40ff-4ce9-b2f1-72ffd380cc82 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:13.417198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8f022-40ff-4ce9-b2f1-72ffd380cc82 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:13.418679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae8f022-40ff-4ce9-b2f1-72ffd380cc82 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-4ae8f022-40ff-4ce9-b2f1-72ffd380cc82 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:13.431097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:13.432089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:13.438008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:13.438008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:13.438008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:13.438008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:13.438008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:13.438008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:13.438008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:13.438008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:13.438008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 403/808] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:13.438008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256d676-f662-4698-b407-dd3492455819 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:13.438008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256d676-f662-4698-b407-dd3492455819 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:13.438876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256d676-f662-4698-b407-dd3492455819 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:13.438876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 404/809] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:13 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:13.438876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256d676-f662-4698-b407-dd3492455819 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:13.460130 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:13.494822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b56af2e-f215-425d-9e9e-53ea8033adac None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:13.531253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba35449-7407-4f81-8a4d-1d9cea997f88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:13.531881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba35449-7407-4f81-8a4d-1d9cea997f88 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:13.532155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba35449-7407-4f81-8a4d-1d9cea997f88 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:13.532426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba35449-7407-4f81-8a4d-1d9cea997f88 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:13.533082 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba35449-7407-4f81-8a4d-1d9cea997f88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:13.533385 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba35449-7407-4f81-8a4d-1d9cea997f88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:13.534243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:13.534810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba35449-7407-4f81-8a4d-1d9cea997f88 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:13.542970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256d676-f662-4698-b407-dd3492455819 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:13.546932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 406/810] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:13.547596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba35449-7407-4f81-8a4d-1d9cea997f88 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:13.587712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6c522-64cb-4fcf-a4f4-e7e3a9053043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:13.588349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c522-64cb-4fcf-a4f4-e7e3a9053043 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:13.588626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c522-64cb-4fcf-a4f4-e7e3a9053043 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:13.588897 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e6c522-64cb-4fcf-a4f4-e7e3a9053043 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:13.589485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6c522-64cb-4fcf-a4f4-e7e3a9053043 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:13.590954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e6c522-64cb-4fcf-a4f4-e7e3a9053043 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-54e6c522-64cb-4fcf-a4f4-e7e3a9053043 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:13.602037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:13.603068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:13.603895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 405/811] 10.222.0.25 () {56 vars in 1129 bytes} [Thu Sep 15 19:05:13 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:13.605283 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6c522-64cb-4fcf-a4f4-e7e3a9053043 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:13.650721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba35449-7407-4f81-8a4d-1d9cea997f88 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:13.676847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:13.685824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e934673-b9ca-4de6-bc16-18a74437414f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:13.686473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e934673-b9ca-4de6-bc16-18a74437414f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:13.686735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e934673-b9ca-4de6-bc16-18a74437414f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:13.687006 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e934673-b9ca-4de6-bc16-18a74437414f None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:13.687655 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e934673-b9ca-4de6-bc16-18a74437414f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:13.687960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e934673-b9ca-4de6-bc16-18a74437414f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:13.689326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e934673-b9ca-4de6-bc16-18a74437414f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:13.701167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 407/812] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:13.702597 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf65320-49a1-4721-afc6-fc33154bf9fc None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:13.702879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf65320-49a1-4721-afc6-fc33154bf9fc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:13.703147 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf65320-49a1-4721-afc6-fc33154bf9fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:13.704922 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e6c522-64cb-4fcf-a4f4-e7e3a9053043 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:13.720638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-eaf65320-49a1-4721-afc6-fc33154bf9fc None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:13.722124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-eaf65320-49a1-4721-afc6-fc33154bf9fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:13.741948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c85eb2-c511-4327-bb82-d56a6ae9eb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:13.742534 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c85eb2-c511-4327-bb82-d56a6ae9eb6a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:13.742813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c85eb2-c511-4327-bb82-d56a6ae9eb6a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:13.743084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c85eb2-c511-4327-bb82-d56a6ae9eb6a None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:13.743786 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c85eb2-c511-4327-bb82-d56a6ae9eb6a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:13.744093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c85eb2-c511-4327-bb82-d56a6ae9eb6a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:13.745522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c85eb2-c511-4327-bb82-d56a6ae9eb6a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:13.757092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 406/813] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:13.757940 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c85eb2-c511-4327-bb82-d56a6ae9eb6a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:13.776484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:13.794446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 408/814] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:13.795326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf65320-49a1-4721-afc6-fc33154bf9fc None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:13.875917 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c85eb2-c511-4327-bb82-d56a6ae9eb6a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:13.918631 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf65320-49a1-4721-afc6-fc33154bf9fc None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:13.926286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a326eaf-e8bc-489d-b8ff-0c0a434bf93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:13.926935 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a326eaf-e8bc-489d-b8ff-0c0a434bf93f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:13.927213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a326eaf-e8bc-489d-b8ff-0c0a434bf93f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:13.927487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a326eaf-e8bc-489d-b8ff-0c0a434bf93f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:13.935550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a326eaf-e8bc-489d-b8ff-0c0a434bf93f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:13.937002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a326eaf-e8bc-489d-b8ff-0c0a434bf93f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:13.938338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-3a326eaf-e8bc-489d-b8ff-0c0a434bf93f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:13.948965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:13.950024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:13.950994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:13.950994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:13.950994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:13.950994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:13.950994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:13.950994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:13.950994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:13.950994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:13.950994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 19:05:13.950994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:13.950994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 407/815] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 19:05:13 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:13.950994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a326eaf-e8bc-489d-b8ff-0c0a434bf93f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:13.964817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b0ee-0266-4fa8-9def-7c676ece8586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:13.965771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b0ee-0266-4fa8-9def-7c676ece8586 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:13.966224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b0ee-0266-4fa8-9def-7c676ece8586 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:13.966621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f6b0ee-0266-4fa8-9def-7c676ece8586 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:13.967267 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6b0ee-0266-4fa8-9def-7c676ece8586 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:13.967568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6b0ee-0266-4fa8-9def-7c676ece8586 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:13.968910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f6b0ee-0266-4fa8-9def-7c676ece8586 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:13.974576 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 409/816] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 15 19:05:13 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:13.975293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b0ee-0266-4fa8-9def-7c676ece8586 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:14.039353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:14.062170 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a326eaf-e8bc-489d-b8ff-0c0a434bf93f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:14.082502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f6b0ee-0266-4fa8-9def-7c676ece8586 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:14.096890 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713710d6-9dc1-4dde-877f-fb54f12dab90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:14.097638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713710d6-9dc1-4dde-877f-fb54f12dab90 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:14.097977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713710d6-9dc1-4dde-877f-fb54f12dab90 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:14.098255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713710d6-9dc1-4dde-877f-fb54f12dab90 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:14.107076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713710d6-9dc1-4dde-877f-fb54f12dab90 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:14.108497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713710d6-9dc1-4dde-877f-fb54f12dab90 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:14.116514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840e531-3521-43c1-8d47-c895af7a27c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:14.117213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840e531-3521-43c1-8d47-c895af7a27c3 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:14.117484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840e531-3521-43c1-8d47-c895af7a27c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:14.117756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c840e531-3521-43c1-8d47-c895af7a27c3 None admin] PATH_INFO: `/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/3940f3578cc44d4d8ebe074216a65f2e/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:14.119637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840e531-3521-43c1-8d47-c895af7a27c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=2958a115e7974fc4b5c74a633fc4322c, user_id=3940f3578cc44d4d8ebe074216a65f2e, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-713710d6-9dc1-4dde-877f-fb54f12dab90 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:14.120063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:14.120961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:14.122337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:14.122337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:14.122337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:14.122337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:14.122337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:14.122337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:14.122337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:14.122337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:14.122763 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c840e531-3521-43c1-8d47-c895af7a27c3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:14.122842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 408/817] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:14.122842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713710d6-9dc1-4dde-877f-fb54f12dab90 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:14.136723 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 410/818] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:05:13 2022] PUT /identity/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/3940f3578cc44d4d8ebe074216a65f2e/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:05:14.137560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840e531-3521-43c1-8d47-c895af7a27c3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:14.201278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:14.250540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713710d6-9dc1-4dde-877f-fb54f12dab90 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:14.273747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c840e531-3521-43c1-8d47-c895af7a27c3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:14.293317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fd64c-551b-4b2b-ae46-4b4aa466e1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:14.294546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fd64c-551b-4b2b-ae46-4b4aa466e1c1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:14.294833 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fd64c-551b-4b2b-ae46-4b4aa466e1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:14.295191 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91fd64c-551b-4b2b-ae46-4b4aa466e1c1 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:14.296072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fd64c-551b-4b2b-ae46-4b4aa466e1c1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:14.296512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fd64c-551b-4b2b-ae46-4b4aa466e1c1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:14.298216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91fd64c-551b-4b2b-ae46-4b4aa466e1c1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:14.311512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:14.324017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 409/819] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 15 19:05:14 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:14.325406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fd64c-551b-4b2b-ae46-4b4aa466e1c1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:14.339827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44691dae-ec46-41e5-8aa9-c73c7ed85e09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:14.340450 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691dae-ec46-41e5-8aa9-c73c7ed85e09 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:14.340725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691dae-ec46-41e5-8aa9-c73c7ed85e09 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:14.340995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44691dae-ec46-41e5-8aa9-c73c7ed85e09 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:14.341635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44691dae-ec46-41e5-8aa9-c73c7ed85e09 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:14.342007 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44691dae-ec46-41e5-8aa9-c73c7ed85e09 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:14.343382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44691dae-ec46-41e5-8aa9-c73c7ed85e09 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:14.350345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 411/820] 10.222.0.25 () {56 vars in 1124 bytes} [Thu Sep 15 19:05:14 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:14.351257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44691dae-ec46-41e5-8aa9-c73c7ed85e09 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:14.443030 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91fd64c-551b-4b2b-ae46-4b4aa466e1c1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:14.459508 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44691dae-ec46-41e5-8aa9-c73c7ed85e09 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:14.462309 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:14.478253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd785e-7939-4889-a393-7d28353c9058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:14.478900 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd785e-7939-4889-a393-7d28353c9058 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:14.479176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd785e-7939-4889-a393-7d28353c9058 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:14.479445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afd785e-7939-4889-a393-7d28353c9058 None admin] PATH_INFO: `/v3/services/network` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:14.480030 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd785e-7939-4889-a393-7d28353c9058 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:14.481444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afd785e-7939-4889-a393-7d28353c9058 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-3afd785e-7939-4889-a393-7d28353c9058 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:14.490815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:14.492148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:14.493080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 410/821] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:14 2022] GET /identity/v3/services/network => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:14.494309 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd785e-7939-4889-a393-7d28353c9058 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:14.508244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f66fa8-13fa-4108-bb3e-1b6b9337fe86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:14.508772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66fa8-13fa-4108-bb3e-1b6b9337fe86 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:14.509099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66fa8-13fa-4108-bb3e-1b6b9337fe86 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:14.509303 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f66fa8-13fa-4108-bb3e-1b6b9337fe86 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:14.510033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f66fa8-13fa-4108-bb3e-1b6b9337fe86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:14.510341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f66fa8-13fa-4108-bb3e-1b6b9337fe86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:14.511775 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f66fa8-13fa-4108-bb3e-1b6b9337fe86 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:14.528750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 412/822] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:14.528750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f66fa8-13fa-4108-bb3e-1b6b9337fe86 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:14.562864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:14.606330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afd785e-7939-4889-a393-7d28353c9058 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:14.640783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f66fa8-13fa-4108-bb3e-1b6b9337fe86 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:14.641879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509dc6e8-c01e-439e-bdc9-24da4842944d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:14.642505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dc6e8-c01e-439e-bdc9-24da4842944d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:14.642785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dc6e8-c01e-439e-bdc9-24da4842944d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:14.643059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509dc6e8-c01e-439e-bdc9-24da4842944d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:14.653947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509dc6e8-c01e-439e-bdc9-24da4842944d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:14.655484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509dc6e8-c01e-439e-bdc9-24da4842944d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-509dc6e8-c01e-439e-bdc9-24da4842944d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:14.672433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:14.673449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:14.674382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:14.674382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:14.674382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:14.674382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 411/823] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:14.674382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509dc6e8-c01e-439e-bdc9-24da4842944d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:14.684522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bebed-3617-41a5-aba5-a31045d74926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:14.685151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bebed-3617-41a5-aba5-a31045d74926 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:14.685406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bebed-3617-41a5-aba5-a31045d74926 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:14.685695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4bebed-3617-41a5-aba5-a31045d74926 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:14.686403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bebed-3617-41a5-aba5-a31045d74926 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:14.688205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4bebed-3617-41a5-aba5-a31045d74926 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:14.714271 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 413/824] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:05:14 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:05:14.715163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bebed-3617-41a5-aba5-a31045d74926 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:14.744975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:14.828505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509dc6e8-c01e-439e-bdc9-24da4842944d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:14.847493 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:14.862113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4bebed-3617-41a5-aba5-a31045d74926 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:14.872602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd6398-0080-4540-ab0f-a995ae04813d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:14.873420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd6398-0080-4540-ab0f-a995ae04813d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:14.874406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd6398-0080-4540-ab0f-a995ae04813d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:14.874406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd6398-0080-4540-ab0f-a995ae04813d None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:14.875071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd6398-0080-4540-ab0f-a995ae04813d None admin] RBAC: Adding query filter params (name=network) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:14.875471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd6398-0080-4540-ab0f-a995ae04813d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:14.876970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd6398-0080-4540-ab0f-a995ae04813d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:14.887553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 412/825] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 19:05:14 2022] GET /identity/v3/services?name=network => generated 124 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:14.887553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd6398-0080-4540-ab0f-a995ae04813d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:14.916743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca38f49-c7f7-43f6-b6b3-e829749d87d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:14.917585 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca38f49-c7f7-43f6-b6b3-e829749d87d6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:14.918002 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca38f49-c7f7-43f6-b6b3-e829749d87d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:14.918372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca38f49-c7f7-43f6-b6b3-e829749d87d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:14.919204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca38f49-c7f7-43f6-b6b3-e829749d87d6 None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=38b19e4add2a4321a2fbfeb9a3a1b61d) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:14.919800 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca38f49-c7f7-43f6-b6b3-e829749d87d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:14.925826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca38f49-c7f7-43f6-b6b3-e829749d87d6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:14.931626 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 414/826] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:05:14 2022] GET /identity/v3/role_assignments?user.id=38b19e4add2a4321a2fbfeb9a3a1b61d&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:14.932642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca38f49-c7f7-43f6-b6b3-e829749d87d6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:15.025944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd6398-0080-4540-ab0f-a995ae04813d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:15.037458 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:15.066003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca38f49-c7f7-43f6-b6b3-e829749d87d6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:15.072813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466142-b46a-4506-849a-5accc375f923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:15.073543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466142-b46a-4506-849a-5accc375f923 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:15.073943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466142-b46a-4506-849a-5accc375f923 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:15.074274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe466142-b46a-4506-849a-5accc375f923 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:15.074997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe466142-b46a-4506-849a-5accc375f923 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:15.075373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe466142-b46a-4506-849a-5accc375f923 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:15.077104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe466142-b46a-4506-849a-5accc375f923 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:15.092525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 413/827] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:15.098715 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466142-b46a-4506-849a-5accc375f923 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:15.142950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de587c-a998-4a7b-8f97-715829179a0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:15.143733 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de587c-a998-4a7b-8f97-715829179a0b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:15.145126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de587c-a998-4a7b-8f97-715829179a0b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:15.145472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62de587c-a998-4a7b-8f97-715829179a0b None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:15.146495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de587c-a998-4a7b-8f97-715829179a0b None admin] RBAC: Adding query filter params (type=network) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:15.148153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de587c-a998-4a7b-8f97-715829179a0b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:15.149561 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62de587c-a998-4a7b-8f97-715829179a0b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:15.160970 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 415/828] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 19:05:14 2022] GET /identity/v3/services?type=network => generated 350 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:15.166462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de587c-a998-4a7b-8f97-715829179a0b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:15.296576 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:15.318676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62de587c-a998-4a7b-8f97-715829179a0b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:15.365717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966016ca-306b-4c0a-a30e-d06407d47b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:15.367293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966016ca-306b-4c0a-a30e-d06407d47b8f None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:15.367815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966016ca-306b-4c0a-a30e-d06407d47b8f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:15.368452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966016ca-306b-4c0a-a30e-d06407d47b8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:15.369534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966016ca-306b-4c0a-a30e-d06407d47b8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:15.372030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966016ca-306b-4c0a-a30e-d06407d47b8f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:15.380342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe466142-b46a-4506-849a-5accc375f923 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:15.400978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:15.407650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 416/829] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:05:15 2022] POST /identity/v3/endpoints => generated 337 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:05:15.435022 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe759c9e-e435-4761-9ee6-8cb10c764a06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:15.435686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe759c9e-e435-4761-9ee6-8cb10c764a06 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:15.435958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe759c9e-e435-4761-9ee6-8cb10c764a06 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:15.436223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe759c9e-e435-4761-9ee6-8cb10c764a06 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:15.445390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe759c9e-e435-4761-9ee6-8cb10c764a06 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:15.446993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe759c9e-e435-4761-9ee6-8cb10c764a06 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-fe759c9e-e435-4761-9ee6-8cb10c764a06 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:15.459927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:15.460912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:15.461855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:15.461855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:15.461855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:15.461855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:15.461855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:15.461855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:15.461855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:15.461855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:15.461855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 414/830] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 363 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:15.467416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966016ca-306b-4c0a-a30e-d06407d47b8f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:15.582765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966016ca-306b-4c0a-a30e-d06407d47b8f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:15.634579 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e0655a-11e2-41c3-8c3c-ce7458b445de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:15.635482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0655a-11e2-41c3-8c3c-ce7458b445de None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:15.635976 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0655a-11e2-41c3-8c3c-ce7458b445de None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:15.636449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e0655a-11e2-41c3-8c3c-ce7458b445de None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:15.637347 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0655a-11e2-41c3-8c3c-ce7458b445de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:15.637830 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0655a-11e2-41c3-8c3c-ce7458b445de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:15.639440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e0655a-11e2-41c3-8c3c-ce7458b445de None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:15.660778 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 417/831] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:15.666915 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe759c9e-e435-4761-9ee6-8cb10c764a06 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:15.800170 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:15.811954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe759c9e-e435-4761-9ee6-8cb10c764a06 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:15.849613 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eba92d9-4781-4e2e-9cac-27c97e86cd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:15.850312 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba92d9-4781-4e2e-9cac-27c97e86cd65 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:15.850587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba92d9-4781-4e2e-9cac-27c97e86cd65 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:15.850852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eba92d9-4781-4e2e-9cac-27c97e86cd65 None admin] PATH_INFO: `/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/cd3b9f8c819d4ac1b6ded6ea1a91e68f/roles/4f6a1ac8e24d4fbbb77c428a26d085ac` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:15.866743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba92d9-4781-4e2e-9cac-27c97e86cd65 None admin] RBAC: Authorizing `identity:create_grant(project_id=2958a115e7974fc4b5c74a633fc4322c, user_id=cd3b9f8c819d4ac1b6ded6ea1a91e68f, role_id=4f6a1ac8e24d4fbbb77c428a26d085ac)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:15.868259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eba92d9-4781-4e2e-9cac-27c97e86cd65 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:15.891331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 415/832] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:05:15 2022] PUT /identity/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/cd3b9f8c819d4ac1b6ded6ea1a91e68f/roles/4f6a1ac8e24d4fbbb77c428a26d085ac => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:05:16.404110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3d29c-6f6f-4304-8e2c-e9ca5a7faa2b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:16.404642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3d29c-6f6f-4304-8e2c-e9ca5a7faa2b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:16.404642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab3d29c-6f6f-4304-8e2c-e9ca5a7faa2b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:16.406350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 418/833] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:16.411959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabb5a8-bcf4-4a8a-8e3f-cf9e53f3f10b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:16.412399 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabb5a8-bcf4-4a8a-8e3f-cf9e53f3f10b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:16.412485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeabb5a8-bcf4-4a8a-8e3f-cf9e53f3f10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:16.431092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-eeabb5a8-bcf4-4a8a-8e3f-cf9e53f3f10b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:16.432387 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-eeabb5a8-bcf4-4a8a-8e3f-cf9e53f3f10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:16.504029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 416/834] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:16 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:16.768860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3d29c-6f6f-4304-8e2c-e9ca5a7faa2b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:16.832905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:16.876201 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab3d29c-6f6f-4304-8e2c-e9ca5a7faa2b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:16.912190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e53f7-b298-4558-87cb-3cec98feba7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:16.912837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e53f7-b298-4558-87cb-3cec98feba7f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:16.913114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e53f7-b298-4558-87cb-3cec98feba7f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:16.913382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e53f7-b298-4558-87cb-3cec98feba7f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:16.923860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e53f7-b298-4558-87cb-3cec98feba7f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-2c7e53f7-b298-4558-87cb-3cec98feba7f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:16.929695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:16.930656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:16.931514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:16.931514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:16.931514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:16.931514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:16.931514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:16.931514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:16.931514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:16.931514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:16.931514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:16.931514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:16.931514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:16.931514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:16.931514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 419/835] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:05:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:16.937109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabb5a8-bcf4-4a8a-8e3f-cf9e53f3f10b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:17.007883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:17.040428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeabb5a8-bcf4-4a8a-8e3f-cf9e53f3f10b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:17.075179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd47c-6e81-40bb-9b7d-52585cc1db4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:17.075802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd47c-6e81-40bb-9b7d-52585cc1db4b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:17.076080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd47c-6e81-40bb-9b7d-52585cc1db4b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:17.076350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d3bd47c-6e81-40bb-9b7d-52585cc1db4b None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:17.077015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd47c-6e81-40bb-9b7d-52585cc1db4b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:17.077379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd47c-6e81-40bb-9b7d-52585cc1db4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:17.078803 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d3bd47c-6e81-40bb-9b7d-52585cc1db4b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:17.087727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 417/836] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:05:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:17.093556 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e53f7-b298-4558-87cb-3cec98feba7f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:17.197015 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e53f7-b298-4558-87cb-3cec98feba7f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:17.219883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:17.238026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5eaf0-a8df-478a-b672-109080de3160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:17.239021 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5eaf0-a8df-478a-b672-109080de3160 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:17.239021 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5eaf0-a8df-478a-b672-109080de3160 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:17.239309 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5eaf0-a8df-478a-b672-109080de3160 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:17.251384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5eaf0-a8df-478a-b672-109080de3160 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:17.252867 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5eaf0-a8df-478a-b672-109080de3160 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-a0f5eaf0-a8df-478a-b672-109080de3160 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:17.269741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:17.270960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:17.271842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:17.271842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:17.271842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:17.271842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 420/837] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:17.277001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd47c-6e81-40bb-9b7d-52585cc1db4b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:17.355692 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23fc46-1a23-43a3-b2e3-137c80bafb1c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:17.356037 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23fc46-1a23-43a3-b2e3-137c80bafb1c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:17.356217 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c23fc46-1a23-43a3-b2e3-137c80bafb1c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:17.359127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 421/838] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:05:17.363434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727de19e-d4b9-44bb-8b8e-3954600a4c6d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:17.363712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727de19e-d4b9-44bb-8b8e-3954600a4c6d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:17.363981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727de19e-d4b9-44bb-8b8e-3954600a4c6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:17.382902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d3bd47c-6e81-40bb-9b7d-52585cc1db4b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:17.384433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-727de19e-d4b9-44bb-8b8e-3954600a4c6d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:17.386710 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-727de19e-d4b9-44bb-8b8e-3954600a4c6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:17.431921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbf261-4493-4004-9fac-a3589304dfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:17.432549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbf261-4493-4004-9fac-a3589304dfb2 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:17.432801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbf261-4493-4004-9fac-a3589304dfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:17.433064 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dbf261-4493-4004-9fac-a3589304dfb2 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:17.434159 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbf261-4493-4004-9fac-a3589304dfb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:17.435436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbf261-4493-4004-9fac-a3589304dfb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:17.436820 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dbf261-4493-4004-9fac-a3589304dfb2 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:17.438437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:17.454583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 418/839] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:17.460193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbf261-4493-4004-9fac-a3589304dfb2 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:17.474003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 422/840] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:17.567347 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dbf261-4493-4004-9fac-a3589304dfb2 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:17.603723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d6bd50-c126-42c1-9152-fc62ebb16609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:17.604812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6bd50-c126-42c1-9152-fc62ebb16609 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:17.605282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6bd50-c126-42c1-9152-fc62ebb16609 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:17.605775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d6bd50-c126-42c1-9152-fc62ebb16609 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:17.614772 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6bd50-c126-42c1-9152-fc62ebb16609 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:17.616638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d6bd50-c126-42c1-9152-fc62ebb16609 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-d1d6bd50-c126-42c1-9152-fc62ebb16609 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:17.630469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:17.631564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:17.632644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:17.632644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:17.632644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:17.632644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:17.632644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:17.632644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:17.632644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:17.632644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:17.632644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 15 19:05:17.632644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:17.635402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 419/841] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:05:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:17.641405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727de19e-d4b9-44bb-8b8e-3954600a4c6d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:17.733695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4fe1e-3926-4cd1-b0ca-9fea7d0c5025 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:17.734050 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4fe1e-3926-4cd1-b0ca-9fea7d0c5025 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:17.734316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a4fe1e-3926-4cd1-b0ca-9fea7d0c5025 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:17.736290 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 420/842] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:17.742670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd888646-b4fa-42e9-b0cc-336b7dde77c3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:17.742943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd888646-b4fa-42e9-b0cc-336b7dde77c3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:17.743290 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd888646-b4fa-42e9-b0cc-336b7dde77c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:17.750200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727de19e-d4b9-44bb-8b8e-3954600a4c6d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:17.751989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:17.766839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-dd888646-b4fa-42e9-b0cc-336b7dde77c3 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:17.768495 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dd888646-b4fa-42e9-b0cc-336b7dde77c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:17.788663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7fc9d-ba6d-4de8-b034-abdfedc92cee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:17.789285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7fc9d-ba6d-4de8-b034-abdfedc92cee None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:17.789563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7fc9d-ba6d-4de8-b034-abdfedc92cee None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:17.789860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf7fc9d-ba6d-4de8-b034-abdfedc92cee None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:17.790607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7fc9d-ba6d-4de8-b034-abdfedc92cee None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:17.790906 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7fc9d-ba6d-4de8-b034-abdfedc92cee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:17.792376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf7fc9d-ba6d-4de8-b034-abdfedc92cee None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:17.810766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 423/843] 10.222.0.25 () {56 vars in 1135 bytes} [Thu Sep 15 19:05:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:17.811619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7fc9d-ba6d-4de8-b034-abdfedc92cee None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:17.835267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:17.860414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 421/844] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:17 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:05:17.865486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd888646-b4fa-42e9-b0cc-336b7dde77c3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:17.935903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf7fc9d-ba6d-4de8-b034-abdfedc92cee None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:17.981956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bae133-528c-407d-917d-7bde65f4718a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:17.983729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae133-528c-407d-917d-7bde65f4718a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:17.984206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae133-528c-407d-917d-7bde65f4718a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:17.984948 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bae133-528c-407d-917d-7bde65f4718a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:17.985996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bae133-528c-407d-917d-7bde65f4718a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:17.988371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bae133-528c-407d-917d-7bde65f4718a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:17.995311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd888646-b4fa-42e9-b0cc-336b7dde77c3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-07bae133-528c-407d-917d-7bde65f4718a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:18.004475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:18.005489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 19:05:18.006394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:18.013966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 424/845] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:05:17 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:18.015583 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bae133-528c-407d-917d-7bde65f4718a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:18.047181 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02071cf7-4d45-4bb2-a1f7-4c6eae29e9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:18.047886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02071cf7-4d45-4bb2-a1f7-4c6eae29e9ff None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:18.048084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02071cf7-4d45-4bb2-a1f7-4c6eae29e9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:18.048330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02071cf7-4d45-4bb2-a1f7-4c6eae29e9ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:18.060530 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:18.116727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:18.135657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02071cf7-4d45-4bb2-a1f7-4c6eae29e9ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:18.137116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02071cf7-4d45-4bb2-a1f7-4c6eae29e9ff None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:18.167181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bae133-528c-407d-917d-7bde65f4718a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:18.202684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b925ea-34fe-4965-8d45-5c365b689757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:18.203314 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b925ea-34fe-4965-8d45-5c365b689757 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:18.203754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b925ea-34fe-4965-8d45-5c365b689757 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:18.204036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b925ea-34fe-4965-8d45-5c365b689757 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:18.204966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b925ea-34fe-4965-8d45-5c365b689757 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:18.205287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b925ea-34fe-4965-8d45-5c365b689757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:18.206772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b925ea-34fe-4965-8d45-5c365b689757 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:18.211461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 425/846] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:05:18 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:18.212258 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b925ea-34fe-4965-8d45-5c365b689757 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:18.247477 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 422/847] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:05:17 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:05:18.248784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531c6d1-bd22-4b70-a375-cee8acf10aa7 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:18.249069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531c6d1-bd22-4b70-a375-cee8acf10aa7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:18.249400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0531c6d1-bd22-4b70-a375-cee8acf10aa7 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:18.253828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 423/848] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:18.253828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531c6d1-bd22-4b70-a375-cee8acf10aa7 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:18.301197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:18.312449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b925ea-34fe-4965-8d45-5c365b689757 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:18.343643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:18.348218 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc112e-909f-484c-9d06-f9672cc34f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:18.348821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc112e-909f-484c-9d06-f9672cc34f5a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:18.349097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc112e-909f-484c-9d06-f9672cc34f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:18.349370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cc112e-909f-484c-9d06-f9672cc34f5a None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:18.349995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc112e-909f-484c-9d06-f9672cc34f5a None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:18.351374 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74cc112e-909f-484c-9d06-f9672cc34f5a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-74cc112e-909f-484c-9d06-f9672cc34f5a None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:18.360180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:18.361286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 19:05:18.362227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:18.363039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0531c6d1-bd22-4b70-a375-cee8acf10aa7 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:18.363124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 426/849] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Sep 15 19:05:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:18.363124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc112e-909f-484c-9d06-f9672cc34f5a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:18.401378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88136bd-2f00-4a87-be42-cd7db094e142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:18.401966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88136bd-2f00-4a87-be42-cd7db094e142 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:18.402246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88136bd-2f00-4a87-be42-cd7db094e142 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:18.402516 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88136bd-2f00-4a87-be42-cd7db094e142 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:18.403208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88136bd-2f00-4a87-be42-cd7db094e142 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:18.403514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88136bd-2f00-4a87-be42-cd7db094e142 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:18.404908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88136bd-2f00-4a87-be42-cd7db094e142 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:18.421844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 424/850] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:05:18 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:18.421844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc9a71-3e4c-410e-8b5c-8df039db53d1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:18.421844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc9a71-3e4c-410e-8b5c-8df039db53d1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:18.421844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2dc9a71-3e4c-410e-8b5c-8df039db53d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:18.430859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f2dc9a71-3e4c-410e-8b5c-8df039db53d1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:18.432062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f2dc9a71-3e4c-410e-8b5c-8df039db53d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:18.489171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74cc112e-909f-484c-9d06-f9672cc34f5a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:18.514465 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 425/851] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:18.516071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc9a71-3e4c-410e-8b5c-8df039db53d1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:18.528871 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2e5e1-704d-4037-855c-785f4de31f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:18.529462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e5e1-704d-4037-855c-785f4de31f32 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:18.529823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e5e1-704d-4037-855c-785f4de31f32 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:18.530198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b2e5e1-704d-4037-855c-785f4de31f32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:18.542846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2e5e1-704d-4037-855c-785f4de31f32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:18.544568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b2e5e1-704d-4037-855c-785f4de31f32 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b9b2e5e1-704d-4037-855c-785f4de31f32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:18.563409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:18.564651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:18.565902 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:18.565902 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:18.565902 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:18.567509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 427/852] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:18.572645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2e5e1-704d-4037-855c-785f4de31f32 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:18.592746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:18.628799 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:18.663288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2dc9a71-3e4c-410e-8b5c-8df039db53d1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:18.698179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b2e5e1-704d-4037-855c-785f4de31f32 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:18.705701 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195492dd-f79f-4402-b502-ecc4e9585e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:18.706859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195492dd-f79f-4402-b502-ecc4e9585e28 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:18.707201 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195492dd-f79f-4402-b502-ecc4e9585e28 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:18.707477 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195492dd-f79f-4402-b502-ecc4e9585e28 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:18.708121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195492dd-f79f-4402-b502-ecc4e9585e28 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:18.708420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195492dd-f79f-4402-b502-ecc4e9585e28 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:18.710505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195492dd-f79f-4402-b502-ecc4e9585e28 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:18.716642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 426/853] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 19:05:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:18.723201 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195492dd-f79f-4402-b502-ecc4e9585e28 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:18.743241 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec27ec-f6b1-47c9-a8da-bbabef1095d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:18.743860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec27ec-f6b1-47c9-a8da-bbabef1095d9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:18.744133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec27ec-f6b1-47c9-a8da-bbabef1095d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:18.744396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec27ec-f6b1-47c9-a8da-bbabef1095d9 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:18.745295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec27ec-f6b1-47c9-a8da-bbabef1095d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:18.745592 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec27ec-f6b1-47c9-a8da-bbabef1095d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:18.747356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec27ec-f6b1-47c9-a8da-bbabef1095d9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:18.762355 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 428/854] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:18.770928 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec27ec-f6b1-47c9-a8da-bbabef1095d9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:18.834150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195492dd-f79f-4402-b502-ecc4e9585e28 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:18.840353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:18.871069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7746683-dd90-4e32-8f97-454dc5ff93f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:18.871687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7746683-dd90-4e32-8f97-454dc5ff93f5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:18.871960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7746683-dd90-4e32-8f97-454dc5ff93f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:18.872442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7746683-dd90-4e32-8f97-454dc5ff93f5 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:18.872832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7746683-dd90-4e32-8f97-454dc5ff93f5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:18.873130 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7746683-dd90-4e32-8f97-454dc5ff93f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:18.874528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7746683-dd90-4e32-8f97-454dc5ff93f5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:18.880267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 427/855] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 19:05:18 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:18.880267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7746683-dd90-4e32-8f97-454dc5ff93f5 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:18.890160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:18.895469 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec27ec-f6b1-47c9-a8da-bbabef1095d9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:18.953975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb02e7-a28d-43f8-b489-deab33dfb120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:18.955629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb02e7-a28d-43f8-b489-deab33dfb120 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:18.956241 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb02e7-a28d-43f8-b489-deab33dfb120 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:18.957440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fb02e7-a28d-43f8-b489-deab33dfb120 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:18.969318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb02e7-a28d-43f8-b489-deab33dfb120 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:18.972441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fb02e7-a28d-43f8-b489-deab33dfb120 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c0fb02e7-a28d-43f8-b489-deab33dfb120 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:18.991126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:18.992098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:18.993026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:18.993026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:18.993026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:18.993026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:18.993026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:18.993026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:18.993026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:18.993026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:18.996076 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 429/856] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:19.002364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb02e7-a28d-43f8-b489-deab33dfb120 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:19.004274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7746683-dd90-4e32-8f97-454dc5ff93f5 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:19.044005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f7a79-3ccb-4e2f-8f0e-bdc856556286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:19.044879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7a79-3ccb-4e2f-8f0e-bdc856556286 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:19.045246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7a79-3ccb-4e2f-8f0e-bdc856556286 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:19.045605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536f7a79-3ccb-4e2f-8f0e-bdc856556286 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:19.059902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536f7a79-3ccb-4e2f-8f0e-bdc856556286 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-536f7a79-3ccb-4e2f-8f0e-bdc856556286 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:19.067344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:19.068568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:19.069445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:19.069445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:19.069445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:19.069445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:19.069445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:19.069445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:19.069445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:19.069445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:19.069445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:19.069445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:19.069445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:05:19.069445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:19.076744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 428/857] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:05:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:19.080776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f7a79-3ccb-4e2f-8f0e-bdc856556286 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:19.146229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fb02e7-a28d-43f8-b489-deab33dfb120 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:19.169614 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:19.176055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:19.190068 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4f2a2-9449-4e3f-a1a6-4625bea3816e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:19.191011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4f2a2-9449-4e3f-a1a6-4625bea3816e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:19.192047 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4f2a2-9449-4e3f-a1a6-4625bea3816e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:19.192554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf4f2a2-9449-4e3f-a1a6-4625bea3816e None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:19.193870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4f2a2-9449-4e3f-a1a6-4625bea3816e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:19.194627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4f2a2-9449-4e3f-a1a6-4625bea3816e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:19.196276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf4f2a2-9449-4e3f-a1a6-4625bea3816e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:19.211806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 430/858] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:19.216021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536f7a79-3ccb-4e2f-8f0e-bdc856556286 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:19.218608 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4f2a2-9449-4e3f-a1a6-4625bea3816e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:19.257172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbe368-9c50-4ab5-94f0-3b49d0e972a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:19.257977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe368-9c50-4ab5-94f0-3b49d0e972a0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:19.258350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe368-9c50-4ab5-94f0-3b49d0e972a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:19.258717 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0acbe368-9c50-4ab5-94f0-3b49d0e972a0 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:19.259483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbe368-9c50-4ab5-94f0-3b49d0e972a0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:19.259882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbe368-9c50-4ab5-94f0-3b49d0e972a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:19.261433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0acbe368-9c50-4ab5-94f0-3b49d0e972a0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:19.271440 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 429/859] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:05:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:19.276793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbe368-9c50-4ab5-94f0-3b49d0e972a0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:19.354750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf4f2a2-9449-4e3f-a1a6-4625bea3816e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:19.396281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa2096-3cc0-4807-a9e2-b92e72020ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:19.397329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa2096-3cc0-4807-a9e2-b92e72020ede None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:19.397848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa2096-3cc0-4807-a9e2-b92e72020ede None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:19.398319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfa2096-3cc0-4807-a9e2-b92e72020ede None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:19.399250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa2096-3cc0-4807-a9e2-b92e72020ede None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=3940f3578cc44d4d8ebe074216a65f2e) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:19.399830 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa2096-3cc0-4807-a9e2-b92e72020ede None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:19.401484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfa2096-3cc0-4807-a9e2-b92e72020ede None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:19.409365 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 431/860] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:05:19 2022] GET /identity/v3/role_assignments?user.id=3940f3578cc44d4d8ebe074216a65f2e&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:19.419445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0acbe368-9c50-4ab5-94f0-3b49d0e972a0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:19.456883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:19.461559 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2b261-538f-4d2a-8cb7-9564689691f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:19.462351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2b261-538f-4d2a-8cb7-9564689691f0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:19.462581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2b261-538f-4d2a-8cb7-9564689691f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:19.462851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2b261-538f-4d2a-8cb7-9564689691f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:19.478377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2b261-538f-4d2a-8cb7-9564689691f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:19.479875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2b261-538f-4d2a-8cb7-9564689691f0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-6ee2b261-538f-4d2a-8cb7-9564689691f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:19.497663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:19.498691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:19.499582 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:19.499582 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:19.499582 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:19.499582 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 430/861] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:19.505283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa2096-3cc0-4807-a9e2-b92e72020ede None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:19.564834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:19.628588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfa2096-3cc0-4807-a9e2-b92e72020ede None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:19.666312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ececd-7ef1-45c4-957c-62585f6a5ca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:19.667297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ececd-7ef1-45c4-957c-62585f6a5ca0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:19.667801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ececd-7ef1-45c4-957c-62585f6a5ca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:19.668279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0ececd-7ef1-45c4-957c-62585f6a5ca0 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:19.669113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ececd-7ef1-45c4-957c-62585f6a5ca0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:19.669420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ececd-7ef1-45c4-957c-62585f6a5ca0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:19.670840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0ececd-7ef1-45c4-957c-62585f6a5ca0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:19.685082 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 432/862] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:19.691130 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2b261-538f-4d2a-8cb7-9564689691f0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:19.798157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2b261-538f-4d2a-8cb7-9564689691f0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:19.834589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6185df-9627-453d-9f9e-9a239c372994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:19.835254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6185df-9627-453d-9f9e-9a239c372994 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:19.835527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6185df-9627-453d-9f9e-9a239c372994 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:19.835792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6185df-9627-453d-9f9e-9a239c372994 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:19.844810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6185df-9627-453d-9f9e-9a239c372994 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:19.846878 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6185df-9627-453d-9f9e-9a239c372994 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-7d6185df-9627-453d-9f9e-9a239c372994 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:19.859860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:19.860859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:19.861832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:19.861832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:19.861832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:19.861832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:19.861832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:19.861832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:19.861832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:19.861832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:19.861832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 19:05:19.861832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:19.861832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 431/863] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 19:05:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:19.868256 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ececd-7ef1-45c4-957c-62585f6a5ca0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:19.978401 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0ececd-7ef1-45c4-957c-62585f6a5ca0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:19.989150 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:20.017136 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc5b29-544b-4381-95e4-e70dc73b241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:20.017813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc5b29-544b-4381-95e4-e70dc73b241f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:20.018101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc5b29-544b-4381-95e4-e70dc73b241f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:20.018372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbc5b29-544b-4381-95e4-e70dc73b241f None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:20.019218 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc5b29-544b-4381-95e4-e70dc73b241f None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:20.020032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc5b29-544b-4381-95e4-e70dc73b241f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:20.021473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbc5b29-544b-4381-95e4-e70dc73b241f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:20.039976 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 433/864] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 15 19:05:19 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:20.045671 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6185df-9627-453d-9f9e-9a239c372994 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:20.092234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:20.155806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6185df-9627-453d-9f9e-9a239c372994 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:20.193769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd7c0a-4ed2-457e-a32b-9fe7e846cea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:20.194462 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd7c0a-4ed2-457e-a32b-9fe7e846cea9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:20.194740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd7c0a-4ed2-457e-a32b-9fe7e846cea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:20.195009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bd7c0a-4ed2-457e-a32b-9fe7e846cea9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:20.273034 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd7c0a-4ed2-457e-a32b-9fe7e846cea9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:20.274531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bd7c0a-4ed2-457e-a32b-9fe7e846cea9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:20.324842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:20.391528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 432/865] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:05:20 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:05:20.397811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc5b29-544b-4381-95e4-e70dc73b241f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:20.509544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbc5b29-544b-4381-95e4-e70dc73b241f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:20.546033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148a28b-4f5e-42da-93bd-9e4771f55802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:20.547104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148a28b-4f5e-42da-93bd-9e4771f55802 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:20.547600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148a28b-4f5e-42da-93bd-9e4771f55802 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:20.548074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148a28b-4f5e-42da-93bd-9e4771f55802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:20.561350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148a28b-4f5e-42da-93bd-9e4771f55802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:20.563314 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148a28b-4f5e-42da-93bd-9e4771f55802 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-5148a28b-4f5e-42da-93bd-9e4771f55802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:20.580471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:20.581502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:20.582545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:20.582545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:20.582545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:20.584856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 434/866] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:20.590277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd7c0a-4ed2-457e-a32b-9fe7e846cea9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:20.671397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d941f5-60f8-46fe-8354-6945454c722d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:20.671574 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d941f5-60f8-46fe-8354-6945454c722d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:20.671837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d941f5-60f8-46fe-8354-6945454c722d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:20.673480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 435/867] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:05:20.679305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a217-2618-44ed-8d5a-f7872a18bd48 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:20.679604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a217-2618-44ed-8d5a-f7872a18bd48 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:20.679849 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b10a217-2618-44ed-8d5a-f7872a18bd48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:20.698474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0b10a217-2618-44ed-8d5a-f7872a18bd48 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:20.699708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0b10a217-2618-44ed-8d5a-f7872a18bd48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:20.701413 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bd7c0a-4ed2-457e-a32b-9fe7e846cea9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:20.726218 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:20.741909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e35b43-50f0-46ac-bb75-8eab713b611b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:20.742587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e35b43-50f0-46ac-bb75-8eab713b611b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:20.742864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e35b43-50f0-46ac-bb75-8eab713b611b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:20.743133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e35b43-50f0-46ac-bb75-8eab713b611b None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:20.743788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e35b43-50f0-46ac-bb75-8eab713b611b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:20.744091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e35b43-50f0-46ac-bb75-8eab713b611b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:20.745629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e35b43-50f0-46ac-bb75-8eab713b611b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:20.755673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:20.761280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 433/868] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:20.766980 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e35b43-50f0-46ac-bb75-8eab713b611b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:20.780570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 436/869] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:20 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:05:20.882883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e35b43-50f0-46ac-bb75-8eab713b611b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:20.921951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85734d43-279c-42df-8635-4010fd00a7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:20.922508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85734d43-279c-42df-8635-4010fd00a7fd None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:20.922784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85734d43-279c-42df-8635-4010fd00a7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:20.923052 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85734d43-279c-42df-8635-4010fd00a7fd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:20.930665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85734d43-279c-42df-8635-4010fd00a7fd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:20.932173 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85734d43-279c-42df-8635-4010fd00a7fd None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-85734d43-279c-42df-8635-4010fd00a7fd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:20.944041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:20.944997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:20.945933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:20.945933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:20.945933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:20.945933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:20.945933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:20.945933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:20.945933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:20.945933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:20.945933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 434/870] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:20.952698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10a217-2618-44ed-8d5a-f7872a18bd48 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:21.058377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85734d43-279c-42df-8635-4010fd00a7fd None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:21.061517 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b10a217-2618-44ed-8d5a-f7872a18bd48 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:21.101985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5114-cca7-415f-b3f0-f7e70f14c274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:21.102614 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5114-cca7-415f-b3f0-f7e70f14c274 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:21.102888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5114-cca7-415f-b3f0-f7e70f14c274 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:21.103152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b5114-cca7-415f-b3f0-f7e70f14c274 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:21.103850 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b5114-cca7-415f-b3f0-f7e70f14c274 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:21.104147 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b5114-cca7-415f-b3f0-f7e70f14c274 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:21.105582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b5114-cca7-415f-b3f0-f7e70f14c274 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:21.118459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 437/871] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:21.124301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5114-cca7-415f-b3f0-f7e70f14c274 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:21.127148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:21.141176 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:21.174949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85734d43-279c-42df-8635-4010fd00a7fd None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:21.218110 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a695eb51-6599-41a2-8808-1d3c262aecd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:21.219119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695eb51-6599-41a2-8808-1d3c262aecd5 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:21.219395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695eb51-6599-41a2-8808-1d3c262aecd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:21.219662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a695eb51-6599-41a2-8808-1d3c262aecd5 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:21.220350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695eb51-6599-41a2-8808-1d3c262aecd5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:21.222495 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a695eb51-6599-41a2-8808-1d3c262aecd5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:21.239368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 435/872] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:05:21 2022] POST /identity/v3/services => generated 251 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:05:21.243341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b5114-cca7-415f-b3f0-f7e70f14c274 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:21.248651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac06a-886c-487e-884c-990e0cf60ffe None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:21.249363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac06a-886c-487e-884c-990e0cf60ffe None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:21.249889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374ac06a-886c-487e-884c-990e0cf60ffe None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:21.251983 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 436/873] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:21 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:21.257853 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e692c1-e0f7-4ae0-b50d-b2f5bc788136 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:21.258548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e692c1-e0f7-4ae0-b50d-b2f5bc788136 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:21.259031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e692c1-e0f7-4ae0-b50d-b2f5bc788136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:21.288420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-85e692c1-e0f7-4ae0-b50d-b2f5bc788136 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:21.290177 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-85e692c1-e0f7-4ae0-b50d-b2f5bc788136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:21.306989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252ffa3-e408-4ebc-86c3-d399ed79c00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:21.307647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252ffa3-e408-4ebc-86c3-d399ed79c00b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:21.307923 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252ffa3-e408-4ebc-86c3-d399ed79c00b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:21.308191 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4252ffa3-e408-4ebc-86c3-d399ed79c00b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:21.308967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252ffa3-e408-4ebc-86c3-d399ed79c00b None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=cd3b9f8c819d4ac1b6ded6ea1a91e68f) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:21.309284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252ffa3-e408-4ebc-86c3-d399ed79c00b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:21.313125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4252ffa3-e408-4ebc-86c3-d399ed79c00b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:21.326339 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 438/874] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:05:21 2022] GET /identity/v3/role_assignments?user.id=cd3b9f8c819d4ac1b6ded6ea1a91e68f&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:21.397137 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 437/875] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:21 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:21.667140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252ffa3-e408-4ebc-86c3-d399ed79c00b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:21.747046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:21.787286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4252ffa3-e408-4ebc-86c3-d399ed79c00b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:21.812124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b4659-ac37-432b-b497-aec31aa9e2e5 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:21.812699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b4659-ac37-432b-b497-aec31aa9e2e5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:21.812699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b4659-ac37-432b-b497-aec31aa9e2e5 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:21.815561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 438/876] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:21.820534 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cc1f8-79f1-4dc0-8d13-03508432b89a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:21.820812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cc1f8-79f1-4dc0-8d13-03508432b89a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:21.821079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0cc1f8-79f1-4dc0-8d13-03508432b89a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:21.827704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e036ff0-fc00-4259-99c6-0083ca247a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:21.829469 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e036ff0-fc00-4259-99c6-0083ca247a71 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:21.829922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e036ff0-fc00-4259-99c6-0083ca247a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:21.830337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e036ff0-fc00-4259-99c6-0083ca247a71 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:21.831222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e036ff0-fc00-4259-99c6-0083ca247a71 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:21.833284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e036ff0-fc00-4259-99c6-0083ca247a71 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:21.839835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0a0cc1f8-79f1-4dc0-8d13-03508432b89a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:21.841151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0a0cc1f8-79f1-4dc0-8d13-03508432b89a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:21.859007 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 439/877] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:05:21 2022] POST /identity/v3/services => generated 269 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:05:21.903889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:21.940719 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 439/878] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:21 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:05:22.204497 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e036ff0-fc00-4259-99c6-0083ca247a71 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:22.309812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e036ff0-fc00-4259-99c6-0083ca247a71 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:22.342206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:22.345856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90008636-e1d0-4fe4-bb87-237a73ebfbb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:22.346865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90008636-e1d0-4fe4-bb87-237a73ebfbb0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:22.347271 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90008636-e1d0-4fe4-bb87-237a73ebfbb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:22.347753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90008636-e1d0-4fe4-bb87-237a73ebfbb0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:22.348575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90008636-e1d0-4fe4-bb87-237a73ebfbb0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:22.350305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90008636-e1d0-4fe4-bb87-237a73ebfbb0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-90008636-e1d0-4fe4-bb87-237a73ebfbb0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:22.360443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:22.361514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:22.362432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:22.365935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 440/879] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 19:05:22 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:22.368829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cc1f8-79f1-4dc0-8d13-03508432b89a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:22.475059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0cc1f8-79f1-4dc0-8d13-03508432b89a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:22.516197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9777d8cd-c322-47bd-bb1d-c0b755d97093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:22.516827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d8cd-c322-47bd-bb1d-c0b755d97093 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:22.517108 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d8cd-c322-47bd-bb1d-c0b755d97093 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:22.517381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9777d8cd-c322-47bd-bb1d-c0b755d97093 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:22.518046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777d8cd-c322-47bd-bb1d-c0b755d97093 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:22.518352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777d8cd-c322-47bd-bb1d-c0b755d97093 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:22.520075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9777d8cd-c322-47bd-bb1d-c0b755d97093 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:22.525597 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 440/880] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 19:05:22 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:22.531250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90008636-e1d0-4fe4-bb87-237a73ebfbb0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:22.636401 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90008636-e1d0-4fe4-bb87-237a73ebfbb0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:22.671650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d859bd-f9e9-49b5-9a96-6561c0923509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:22.672448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d859bd-f9e9-49b5-9a96-6561c0923509 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:22.672622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d859bd-f9e9-49b5-9a96-6561c0923509 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:22.672779 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d859bd-f9e9-49b5-9a96-6561c0923509 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:22.673403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d859bd-f9e9-49b5-9a96-6561c0923509 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:22.673703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d859bd-f9e9-49b5-9a96-6561c0923509 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:22.675127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d859bd-f9e9-49b5-9a96-6561c0923509 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:22.685953 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 441/881] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 19:05:22 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:23.484809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d97c1-dd2b-46ad-865d-bba31b71ece4 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:23.485332 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d97c1-dd2b-46ad-865d-bba31b71ece4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:23.485332 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d97c1-dd2b-46ad-865d-bba31b71ece4 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:23.486988 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 441/882] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:23.492475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf2cbb-3b1d-45fe-9137-f12a0a01a938 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:23.492754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf2cbb-3b1d-45fe-9137-f12a0a01a938 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:23.493015 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf2cbb-3b1d-45fe-9137-f12a0a01a938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:23.512817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ecbf2cbb-3b1d-45fe-9137-f12a0a01a938 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:23.514044 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ecbf2cbb-3b1d-45fe-9137-f12a0a01a938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:23.567642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:23.587382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 442/883] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:23.688307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dbb64-3e07-4b1f-a6b6-e3449fdfb835 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:23.688581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dbb64-3e07-4b1f-a6b6-e3449fdfb835 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:23.689011 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0dbb64-3e07-4b1f-a6b6-e3449fdfb835 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:23.690737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 442/884] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:23.696429 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bc68c-1398-4c63-95a7-df29c777a85b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:23.696930 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bc68c-1398-4c63-95a7-df29c777a85b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:23.697008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587bc68c-1398-4c63-95a7-df29c777a85b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:23.717359 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-587bc68c-1398-4c63-95a7-df29c777a85b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:23.718603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-587bc68c-1398-4c63-95a7-df29c777a85b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:23.787991 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 443/885] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:23 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:23.857818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dbb64-3e07-4b1f-a6b6-e3449fdfb835 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:23.904497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:23.966338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0dbb64-3e07-4b1f-a6b6-e3449fdfb835 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:24.002477 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc03fb8-fe71-4583-8cf0-e70f412c5d20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:24.003162 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc03fb8-fe71-4583-8cf0-e70f412c5d20 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:24.003509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc03fb8-fe71-4583-8cf0-e70f412c5d20 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:24.003778 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc03fb8-fe71-4583-8cf0-e70f412c5d20 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:24.004364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc03fb8-fe71-4583-8cf0-e70f412c5d20 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:24.005794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc03fb8-fe71-4583-8cf0-e70f412c5d20 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-5dc03fb8-fe71-4583-8cf0-e70f412c5d20 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:24.014733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:24.015742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:24.016589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 443/886] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:05:23 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:24.022944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bc68c-1398-4c63-95a7-df29c777a85b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:24.060293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc03fb8-fe71-4583-8cf0-e70f412c5d20 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:24.141157 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587bc68c-1398-4c63-95a7-df29c777a85b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:24.160667 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:24.185347 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5780773-2780-47f4-90f9-2fa1e5b7964e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:24.185993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5780773-2780-47f4-90f9-2fa1e5b7964e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:24.186268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5780773-2780-47f4-90f9-2fa1e5b7964e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:24.186532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5780773-2780-47f4-90f9-2fa1e5b7964e None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:24.187190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5780773-2780-47f4-90f9-2fa1e5b7964e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:24.187486 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5780773-2780-47f4-90f9-2fa1e5b7964e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:24.187595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc03fb8-fe71-4583-8cf0-e70f412c5d20 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:24.188878 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5780773-2780-47f4-90f9-2fa1e5b7964e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:24.190123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:24.195042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 444/887] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:05:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:24.197832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8846fd8-8360-4bd2-b418-e96fdfba6251 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:24.197832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8846fd8-8360-4bd2-b418-e96fdfba6251 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:24.197832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8846fd8-8360-4bd2-b418-e96fdfba6251 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:24.198823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 445/888] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:24.203911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7644c-1ec8-44e7-983b-5a40cf2fcdd5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:24.204045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7644c-1ec8-44e7-983b-5a40cf2fcdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:24.204291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e7644c-1ec8-44e7-983b-5a40cf2fcdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:24.222661 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-90e7644c-1ec8-44e7-983b-5a40cf2fcdd5 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:24.223841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-90e7644c-1ec8-44e7-983b-5a40cf2fcdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:24.230736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125debbe-30dc-4210-b203-c4f097e71219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:24.231638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125debbe-30dc-4210-b203-c4f097e71219 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:24.232017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125debbe-30dc-4210-b203-c4f097e71219 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:24.232293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125debbe-30dc-4210-b203-c4f097e71219 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:24.244046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-125debbe-30dc-4210-b203-c4f097e71219 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-125debbe-30dc-4210-b203-c4f097e71219 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:24.251650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:24.252551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:24.253426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:24.253426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:24.253426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:24.253426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:24.253426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:24.253426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:24.253426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:24.253426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:24.253426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:24.253426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:24.253426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 19:05:24.253426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:24.253426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 444/889] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 15 19:05:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:24.259719 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125debbe-30dc-4210-b203-c4f097e71219 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:24.304132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 446/890] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:05:24.305163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7644c-1ec8-44e7-983b-5a40cf2fcdd5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:24.391975 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-125debbe-30dc-4210-b203-c4f097e71219 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:24.408788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e7644c-1ec8-44e7-983b-5a40cf2fcdd5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:24.430204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:24.437360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a8476-d598-482a-ab0a-a1831e363b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:24.439243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a8476-d598-482a-ab0a-a1831e363b78 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:24.439627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a8476-d598-482a-ab0a-a1831e363b78 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:24.440586 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d8a8476-d598-482a-ab0a-a1831e363b78 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:24.441369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a8476-d598-482a-ab0a-a1831e363b78 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:24.442008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a8476-d598-482a-ab0a-a1831e363b78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:24.444173 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d8a8476-d598-482a-ab0a-a1831e363b78 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:24.448016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8e22b-127b-4007-9fd9-49d14eb1637f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:24.448813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8e22b-127b-4007-9fd9-49d14eb1637f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:24.449229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8e22b-127b-4007-9fd9-49d14eb1637f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:24.449660 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee8e22b-127b-4007-9fd9-49d14eb1637f None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:24.450502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8e22b-127b-4007-9fd9-49d14eb1637f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:24.451016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8e22b-127b-4007-9fd9-49d14eb1637f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:24.452593 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee8e22b-127b-4007-9fd9-49d14eb1637f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:24.455173 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 445/891] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:05:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:24.456652 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a8476-d598-482a-ab0a-a1831e363b78 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:24.469765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 447/892] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 19:05:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:24.471030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8e22b-127b-4007-9fd9-49d14eb1637f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:24.491866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:24.578537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d8a8476-d598-482a-ab0a-a1831e363b78 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:24.607027 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee8e22b-127b-4007-9fd9-49d14eb1637f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:24.616788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec38f31-721f-4636-bbc8-53da01ced6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:24.617413 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38f31-721f-4636-bbc8-53da01ced6fc None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:24.617693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38f31-721f-4636-bbc8-53da01ced6fc None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:24.617994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec38f31-721f-4636-bbc8-53da01ced6fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:24.619071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec38f31-721f-4636-bbc8-53da01ced6fc None admin] RBAC: Adding query filter params (interface=public, service_id=ec44eddad6104fcf8d480b1e04ff511b, region_id=RegionOne) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:24.619386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec38f31-721f-4636-bbc8-53da01ced6fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:24.621210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec38f31-721f-4636-bbc8-53da01ced6fc None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:24.630087 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 446/893] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 19:05:24 2022] GET /identity/v3/endpoints?service_id=ec44eddad6104fcf8d480b1e04ff511b&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:24.631215 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec38f31-721f-4636-bbc8-53da01ced6fc None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:24.655057 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2905ee-9ce8-42b2-b2b4-a485c5ccc359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:24.656100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2905ee-9ce8-42b2-b2b4-a485c5ccc359 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:24.656550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2905ee-9ce8-42b2-b2b4-a485c5ccc359 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:24.656982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2905ee-9ce8-42b2-b2b4-a485c5ccc359 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:24.672004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2905ee-9ce8-42b2-b2b4-a485c5ccc359 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:24.673890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2905ee-9ce8-42b2-b2b4-a485c5ccc359 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-3e2905ee-9ce8-42b2-b2b4-a485c5ccc359 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:24.691520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:24.692507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:24.693625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:24.693625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:24.693625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:24.700060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 448/894] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:24.700060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2905ee-9ce8-42b2-b2b4-a485c5ccc359 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:24.723258 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:24.731858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:24.742028 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec38f31-721f-4636-bbc8-53da01ced6fc None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:24.776714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f4728-e6f8-4cf2-95b9-2db3739d499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:24.777354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f4728-e6f8-4cf2-95b9-2db3739d499c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:24.777634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f4728-e6f8-4cf2-95b9-2db3739d499c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:24.777955 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f4728-e6f8-4cf2-95b9-2db3739d499c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:24.778567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f4728-e6f8-4cf2-95b9-2db3739d499c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:24.779911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182f4728-e6f8-4cf2-95b9-2db3739d499c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-182f4728-e6f8-4cf2-95b9-2db3739d499c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:24.788903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:24.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:24.795606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 447/895] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Sep 15 19:05:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:24.796507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f4728-e6f8-4cf2-95b9-2db3739d499c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:24.812321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2905ee-9ce8-42b2-b2b4-a485c5ccc359 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:24.856550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5c818-79d7-4e62-9d82-c1a223088e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:24.857146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5c818-79d7-4e62-9d82-c1a223088e15 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:24.857423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5c818-79d7-4e62-9d82-c1a223088e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:24.857717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f5c818-79d7-4e62-9d82-c1a223088e15 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:24.858375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5c818-79d7-4e62-9d82-c1a223088e15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:24.859749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f5c818-79d7-4e62-9d82-c1a223088e15 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:24.865638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 449/896] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 19:05:24 2022] GET /identity/v3/services => generated 1268 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:05:24.866484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5c818-79d7-4e62-9d82-c1a223088e15 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:24.922559 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f4728-e6f8-4cf2-95b9-2db3739d499c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:24.971919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19f4c8-89d0-42da-82f1-70d44f09a16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:24.972616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19f4c8-89d0-42da-82f1-70d44f09a16c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:24.972961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19f4c8-89d0-42da-82f1-70d44f09a16c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:24.973520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19f4c8-89d0-42da-82f1-70d44f09a16c None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:24.974717 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19f4c8-89d0-42da-82f1-70d44f09a16c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:24.974717 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19f4c8-89d0-42da-82f1-70d44f09a16c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:24.976025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19f4c8-89d0-42da-82f1-70d44f09a16c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:24.981895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:24.990629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 448/897] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:24.992253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe74c-ced3-44f4-8520-e63408bb4c30 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:24.992536 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe74c-ced3-44f4-8520-e63408bb4c30 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:24.992833 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efe74c-ced3-44f4-8520-e63408bb4c30 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:24.994353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 449/898] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:24.999264 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe74c-ced3-44f4-8520-e63408bb4c30 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:25.002511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f5c818-79d7-4e62-9d82-c1a223088e15 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:25.020899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:25.042981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b9e85-4325-4e0f-84be-9f73ef2f1588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:25.044384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b9e85-4325-4e0f-84be-9f73ef2f1588 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:25.044384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b9e85-4325-4e0f-84be-9f73ef2f1588 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:25.044384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b9e85-4325-4e0f-84be-9f73ef2f1588 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:25.044764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b9e85-4325-4e0f-84be-9f73ef2f1588 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:25.045066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b9e85-4325-4e0f-84be-9f73ef2f1588 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:25.046482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b9e85-4325-4e0f-84be-9f73ef2f1588 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:25.056768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 450/899] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 19:05:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:25.056768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450517c-24f6-4542-a90e-d4f0f2490635 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:25.056768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450517c-24f6-4542-a90e-d4f0f2490635 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:25.056768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e450517c-24f6-4542-a90e-d4f0f2490635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:25.076820 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e450517c-24f6-4542-a90e-d4f0f2490635 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:25.077260 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e450517c-24f6-4542-a90e-d4f0f2490635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:25.118741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efe74c-ced3-44f4-8520-e63408bb4c30 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:25.156698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 451/900] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:25 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:25.158142 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450517c-24f6-4542-a90e-d4f0f2490635 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:25.166419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b3974-c23b-4fed-acfb-2c9f154c720a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:25.167374 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b3974-c23b-4fed-acfb-2c9f154c720a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:25.167840 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b3974-c23b-4fed-acfb-2c9f154c720a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:25.168349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25b3974-c23b-4fed-acfb-2c9f154c720a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:25.181811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b3974-c23b-4fed-acfb-2c9f154c720a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:25.183616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25b3974-c23b-4fed-acfb-2c9f154c720a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-e25b3974-c23b-4fed-acfb-2c9f154c720a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:25.199660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:25.200651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:25.201610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:25.201610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:25.201610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:25.201610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:25.201610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:25.201610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:25.201610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:25.201610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:25.201610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 19:05:25.201610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:25.201610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 450/901] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 19:05:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:25.206643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b3974-c23b-4fed-acfb-2c9f154c720a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:25.254330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:25.274891 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e450517c-24f6-4542-a90e-d4f0f2490635 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:25.299926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:25.323129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f2ce5-b4bf-4090-b128-95d2b2985709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:25.323751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f2ce5-b4bf-4090-b128-95d2b2985709 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:25.324029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f2ce5-b4bf-4090-b128-95d2b2985709 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:25.324301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978f2ce5-b4bf-4090-b128-95d2b2985709 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:25.324943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f2ce5-b4bf-4090-b128-95d2b2985709 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:25.325246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f2ce5-b4bf-4090-b128-95d2b2985709 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:25.327191 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978f2ce5-b4bf-4090-b128-95d2b2985709 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:25.337264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 452/902] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 19:05:25 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:25.337463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25b3974-c23b-4fed-acfb-2c9f154c720a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:25.338914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f2ce5-b4bf-4090-b128-95d2b2985709 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:25.372699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f031fc-99f6-4ec4-8a47-ef13c39eb853 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:25.373324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f031fc-99f6-4ec4-8a47-ef13c39eb853 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:25.373603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f031fc-99f6-4ec4-8a47-ef13c39eb853 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:25.373906 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f031fc-99f6-4ec4-8a47-ef13c39eb853 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:25.374668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f031fc-99f6-4ec4-8a47-ef13c39eb853 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:25.374946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f031fc-99f6-4ec4-8a47-ef13c39eb853 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:25.376398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f031fc-99f6-4ec4-8a47-ef13c39eb853 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:25.395142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 451/903] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 15 19:05:25 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:25.402811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f031fc-99f6-4ec4-8a47-ef13c39eb853 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:25.458750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978f2ce5-b4bf-4090-b128-95d2b2985709 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:25.496584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98f6dd-a2dd-429b-ba11-6318a32ebcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:25.497512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98f6dd-a2dd-429b-ba11-6318a32ebcb5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:25.497512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98f6dd-a2dd-429b-ba11-6318a32ebcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:25.497726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef98f6dd-a2dd-429b-ba11-6318a32ebcb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:25.498468 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98f6dd-a2dd-429b-ba11-6318a32ebcb5 None admin] RBAC: Adding query filter params (interface=public, service_id=60f841606135424fb001a053d525ecc0, region_id=RegionOne) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:25.498777 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98f6dd-a2dd-429b-ba11-6318a32ebcb5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:25.500158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef98f6dd-a2dd-429b-ba11-6318a32ebcb5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:25.505515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 453/904] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 19:05:25 2022] GET /identity/v3/endpoints?service_id=60f841606135424fb001a053d525ecc0&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:25.506118 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98f6dd-a2dd-429b-ba11-6318a32ebcb5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:25.518026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:25.522405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f031fc-99f6-4ec4-8a47-ef13c39eb853 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:25.559756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72504e67-599f-46d1-8e5e-9dda28f9f9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:25.560379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72504e67-599f-46d1-8e5e-9dda28f9f9cb None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:25.560658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72504e67-599f-46d1-8e5e-9dda28f9f9cb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:25.560934 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72504e67-599f-46d1-8e5e-9dda28f9f9cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:25.564235 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:25.619177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef98f6dd-a2dd-429b-ba11-6318a32ebcb5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:25.638128 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72504e67-599f-46d1-8e5e-9dda28f9f9cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:25.639597 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72504e67-599f-46d1-8e5e-9dda28f9f9cb None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:25.657174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ed507-3f81-4012-a6bc-60b081d6ba0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:25.658188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ed507-3f81-4012-a6bc-60b081d6ba0a None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:25.658635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ed507-3f81-4012-a6bc-60b081d6ba0a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:25.659090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ed507-3f81-4012-a6bc-60b081d6ba0a None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:25.660425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ed507-3f81-4012-a6bc-60b081d6ba0a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:25.662016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ed507-3f81-4012-a6bc-60b081d6ba0a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:25.682480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 454/905] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:05:25 2022] POST /identity/v3/services => generated 241 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:05:25.682480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ed507-3f81-4012-a6bc-60b081d6ba0a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:25.770406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 452/906] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:05:25 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:05:25.772281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72504e67-599f-46d1-8e5e-9dda28f9f9cb None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:25.778568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:25.818441 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:25.830663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ed507-3f81-4012-a6bc-60b081d6ba0a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:25.873403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8258c1c-1212-4d40-9c7d-ef0efecd4477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:25.874224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8258c1c-1212-4d40-9c7d-ef0efecd4477 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:25.874612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8258c1c-1212-4d40-9c7d-ef0efecd4477 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:25.875073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8258c1c-1212-4d40-9c7d-ef0efecd4477 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:25.875684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8258c1c-1212-4d40-9c7d-ef0efecd4477 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:25.877146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8258c1c-1212-4d40-9c7d-ef0efecd4477 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:25.890692 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 455/907] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 19:05:25 2022] GET /identity/v3/services => generated 1497 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:05:25.905893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72504e67-599f-46d1-8e5e-9dda28f9f9cb None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:25.951736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93114c-0499-432f-b478-3e1bc2f2bf82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:25.952400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93114c-0499-432f-b478-3e1bc2f2bf82 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:25.952672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93114c-0499-432f-b478-3e1bc2f2bf82 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:25.952936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf93114c-0499-432f-b478-3e1bc2f2bf82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:25.964925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93114c-0499-432f-b478-3e1bc2f2bf82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:25.966486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf93114c-0499-432f-b478-3e1bc2f2bf82 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-cf93114c-0499-432f-b478-3e1bc2f2bf82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:25.983996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:25.985115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:25.986400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:25.986400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:25.986400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:25.986400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 453/908] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:25.993431 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8258c1c-1212-4d40-9c7d-ef0efecd4477 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:26.105470 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8258c1c-1212-4d40-9c7d-ef0efecd4477 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:26.136162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:26.142648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c7e9d-5085-426c-878d-88f28f987591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:26.143727 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c7e9d-5085-426c-878d-88f28f987591 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:26.144532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c7e9d-5085-426c-878d-88f28f987591 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:26.145256 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c7e9d-5085-426c-878d-88f28f987591 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:26.145974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c7e9d-5085-426c-878d-88f28f987591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:26.146278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c7e9d-5085-426c-878d-88f28f987591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:26.147672 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c7e9d-5085-426c-878d-88f28f987591 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:26.161666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 456/909] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:26.167087 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93114c-0499-432f-b478-3e1bc2f2bf82 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:26.259391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:26.276602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf93114c-0499-432f-b478-3e1bc2f2bf82 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:26.313693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a7d01-35c3-470c-848c-5ba236a0501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:26.314552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a7d01-35c3-470c-848c-5ba236a0501b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:26.314834 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a7d01-35c3-470c-848c-5ba236a0501b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:26.315111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350a7d01-35c3-470c-848c-5ba236a0501b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:26.322481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a7d01-35c3-470c-848c-5ba236a0501b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:26.323944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350a7d01-35c3-470c-848c-5ba236a0501b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-350a7d01-35c3-470c-848c-5ba236a0501b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:26.335894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:26.336818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:26.337851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:26.337851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:26.337851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:26.337851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:26.337851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:26.337851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:26.337851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:26.337851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:26.341887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 454/910] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:26.347324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c7e9d-5085-426c-878d-88f28f987591 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:26.458585 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c7e9d-5085-426c-878d-88f28f987591 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:26.494647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b22f750-ea6f-4b89-9cde-072a3fbb37f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:26.495276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22f750-ea6f-4b89-9cde-072a3fbb37f3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:26.495604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22f750-ea6f-4b89-9cde-072a3fbb37f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:26.495913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b22f750-ea6f-4b89-9cde-072a3fbb37f3 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:26.496590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22f750-ea6f-4b89-9cde-072a3fbb37f3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:26.496895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22f750-ea6f-4b89-9cde-072a3fbb37f3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:26.498367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b22f750-ea6f-4b89-9cde-072a3fbb37f3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:26.511275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 457/911] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:26.517503 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a7d01-35c3-470c-848c-5ba236a0501b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:26.632869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350a7d01-35c3-470c-848c-5ba236a0501b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:26.669607 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1466a5-6dc3-4951-8925-abd3f14e7704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:26.670529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1466a5-6dc3-4951-8925-abd3f14e7704 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:26.670959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1466a5-6dc3-4951-8925-abd3f14e7704 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:26.671375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1466a5-6dc3-4951-8925-abd3f14e7704 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:26.672268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1466a5-6dc3-4951-8925-abd3f14e7704 None admin] RBAC: Adding query filter params (role.id=88cd6fa74eaa4bf48cec363a02236cf4, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=cd3b9f8c819d4ac1b6ded6ea1a91e68f) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:26.672738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1466a5-6dc3-4951-8925-abd3f14e7704 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:26.674358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1466a5-6dc3-4951-8925-abd3f14e7704 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:26.685536 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 455/912] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:05:26 2022] GET /identity/v3/role_assignments?user.id=cd3b9f8c819d4ac1b6ded6ea1a91e68f&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=88cd6fa74eaa4bf48cec363a02236cf4 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:27.139856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e73b1a-41ae-430d-a9dc-5a693dbf5a8d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:27.140416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e73b1a-41ae-430d-a9dc-5a693dbf5a8d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:27.140416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e73b1a-41ae-430d-a9dc-5a693dbf5a8d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:27.141911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 458/913] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:27.147740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b628f-df51-430f-83d8-e51a358569a0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:27.148050 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b628f-df51-430f-83d8-e51a358569a0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:27.148298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097b628f-df51-430f-83d8-e51a358569a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:27.168759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-097b628f-df51-430f-83d8-e51a358569a0 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:27.170217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-097b628f-df51-430f-83d8-e51a358569a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:27.174773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:27.272774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 456/914] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:27.559399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e73b1a-41ae-430d-a9dc-5a693dbf5a8d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:27.642178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:27.720737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e73b1a-41ae-430d-a9dc-5a693dbf5a8d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:27.766183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a92a0-b074-40cf-805c-19440e5f5e66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:27.766835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a92a0-b074-40cf-805c-19440e5f5e66 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:27.767116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a92a0-b074-40cf-805c-19440e5f5e66 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:27.767389 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3a92a0-b074-40cf-805c-19440e5f5e66 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:27.767994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a92a0-b074-40cf-805c-19440e5f5e66 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:27.769600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e3a92a0-b074-40cf-805c-19440e5f5e66 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9e3a92a0-b074-40cf-805c-19440e5f5e66 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:27.779398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:27.780483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:27.781324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 459/915] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:05:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:27.788013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b628f-df51-430f-83d8-e51a358569a0 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:27.896297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097b628f-df51-430f-83d8-e51a358569a0 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:27.939160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31a226a-1f04-4324-a4fe-a9e7e8ebfdc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:27.939807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a226a-1f04-4324-a4fe-a9e7e8ebfdc0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:27.940085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a226a-1f04-4324-a4fe-a9e7e8ebfdc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:27.940355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31a226a-1f04-4324-a4fe-a9e7e8ebfdc0 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:27.941092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a226a-1f04-4324-a4fe-a9e7e8ebfdc0 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:27.941459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a226a-1f04-4324-a4fe-a9e7e8ebfdc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:27.942940 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31a226a-1f04-4324-a4fe-a9e7e8ebfdc0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:27.953471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 457/916] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:05:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:27.954893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a92a0-b074-40cf-805c-19440e5f5e66 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:28.043946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1317f0-1a06-4dca-8ef5-441ac4a1158e None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:28.044304 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1317f0-1a06-4dca-8ef5-441ac4a1158e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:28.044496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1317f0-1a06-4dca-8ef5-441ac4a1158e None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:28.046268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 458/917] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:05:28.052506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be938-05ef-4304-b829-b869d0802d8c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:28.052799 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be938-05ef-4304-b829-b869d0802d8c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:28.053034 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3be938-05ef-4304-b829-b869d0802d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:28.060673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:28.066741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3a92a0-b074-40cf-805c-19440e5f5e66 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:28.074735 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5f3be938-05ef-4304-b829-b869d0802d8c None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:28.075929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5f3be938-05ef-4304-b829-b869d0802d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:28.086229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:28.113051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cba922-f872-4cd2-98d3-aee00d664595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:28.113853 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cba922-f872-4cd2-98d3-aee00d664595 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:28.114478 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cba922-f872-4cd2-98d3-aee00d664595 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:28.114766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cba922-f872-4cd2-98d3-aee00d664595 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:28.115752 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cba922-f872-4cd2-98d3-aee00d664595 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:28.116113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cba922-f872-4cd2-98d3-aee00d664595 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:28.118186 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cba922-f872-4cd2-98d3-aee00d664595 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:28.131108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 460/918] 10.222.0.25 () {56 vars in 1114 bytes} [Thu Sep 15 19:05:27 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:28.132479 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cba922-f872-4cd2-98d3-aee00d664595 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:28.174061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 459/919] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:05:28.248427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cba922-f872-4cd2-98d3-aee00d664595 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:28.291053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab121b7f-14fa-4012-b804-1bc25db0aed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:28.291742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab121b7f-14fa-4012-b804-1bc25db0aed2 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:28.292023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab121b7f-14fa-4012-b804-1bc25db0aed2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:28.292296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab121b7f-14fa-4012-b804-1bc25db0aed2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:28.293032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab121b7f-14fa-4012-b804-1bc25db0aed2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:28.294470 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab121b7f-14fa-4012-b804-1bc25db0aed2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:28.325951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 461/920] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:05:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:05:28.378658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bbe8f-26bb-49e1-bd86-878f17300361 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:28.379317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bbe8f-26bb-49e1-bd86-878f17300361 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:28.379317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17bbe8f-26bb-49e1-bd86-878f17300361 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:28.380990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 460/921] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:28.386939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025683ca-bb31-44ad-b026-d3657838ac00 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:28.387303 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025683ca-bb31-44ad-b026-d3657838ac00 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:28.387689 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025683ca-bb31-44ad-b026-d3657838ac00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:28.407873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-025683ca-bb31-44ad-b026-d3657838ac00 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:28.409107 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-025683ca-bb31-44ad-b026-d3657838ac00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:28.442470 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:28.459213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bbe8f-26bb-49e1-bd86-878f17300361 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:28.515405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 462/922] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:28.593517 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17bbe8f-26bb-49e1-bd86-878f17300361 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:28.639110 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215ae49-1825-4b83-b630-435704a3d757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:28.639762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215ae49-1825-4b83-b630-435704a3d757 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:28.640016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215ae49-1825-4b83-b630-435704a3d757 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:28.640308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5215ae49-1825-4b83-b630-435704a3d757 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:28.640898 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215ae49-1825-4b83-b630-435704a3d757 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:28.642306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5215ae49-1825-4b83-b630-435704a3d757 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:28.644413 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-5215ae49-1825-4b83-b630-435704a3d757 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:28.654866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:28.655946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:28.656791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 461/923] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 19:05:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:28.665376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025683ca-bb31-44ad-b026-d3657838ac00 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:28.779473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025683ca-bb31-44ad-b026-d3657838ac00 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:28.780031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215ae49-1825-4b83-b630-435704a3d757 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:28.818758 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e4638-1377-4413-b87f-45f24dae687d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:28.819437 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e4638-1377-4413-b87f-45f24dae687d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:28.819724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e4638-1377-4413-b87f-45f24dae687d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:28.819991 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e4638-1377-4413-b87f-45f24dae687d None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:28.820633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e4638-1377-4413-b87f-45f24dae687d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:28.820935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e4638-1377-4413-b87f-45f24dae687d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:28.822355 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41e4638-1377-4413-b87f-45f24dae687d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:28.828074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 463/924] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 19:05:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:28.835566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e4638-1377-4413-b87f-45f24dae687d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:28.866954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:28.917392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5215ae49-1825-4b83-b630-435704a3d757 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:28.955046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41e4638-1377-4413-b87f-45f24dae687d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:28.955423 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099152ad-4e39-4421-917a-8aed0a038d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:28.956035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099152ad-4e39-4421-917a-8aed0a038d45 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:28.956408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099152ad-4e39-4421-917a-8aed0a038d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:28.956792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099152ad-4e39-4421-917a-8aed0a038d45 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:28.957892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099152ad-4e39-4421-917a-8aed0a038d45 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:28.959377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099152ad-4e39-4421-917a-8aed0a038d45 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-099152ad-4e39-4421-917a-8aed0a038d45 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:28.969963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:28.971378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:28.972331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 462/925] 10.222.0.25 () {56 vars in 1132 bytes} [Thu Sep 15 19:05:28 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:28.977984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099152ad-4e39-4421-917a-8aed0a038d45 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:29.007164 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7aa8e-7fa8-40b2-a199-97f6169d746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:29.007911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7aa8e-7fa8-40b2-a199-97f6169d746c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:29.008192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7aa8e-7fa8-40b2-a199-97f6169d746c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:29.008487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7aa8e-7fa8-40b2-a199-97f6169d746c None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:29.009207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7aa8e-7fa8-40b2-a199-97f6169d746c None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:29.009516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7aa8e-7fa8-40b2-a199-97f6169d746c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:29.011169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e7aa8e-7fa8-40b2-a199-97f6169d746c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:29.021962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 464/926] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 19:05:28 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:29.023868 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7aa8e-7fa8-40b2-a199-97f6169d746c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:29.055754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:29.104316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099152ad-4e39-4421-917a-8aed0a038d45 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:29.130644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:29.142444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2937b9c-21fe-47d9-9913-31f2caa6a491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:29.143323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2937b9c-21fe-47d9-9913-31f2caa6a491 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:29.143480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e7aa8e-7fa8-40b2-a199-97f6169d746c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:29.143952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2937b9c-21fe-47d9-9913-31f2caa6a491 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:29.144438 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2937b9c-21fe-47d9-9913-31f2caa6a491 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:29.145409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2937b9c-21fe-47d9-9913-31f2caa6a491 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:29.146015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2937b9c-21fe-47d9-9913-31f2caa6a491 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:29.147409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2937b9c-21fe-47d9-9913-31f2caa6a491 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:29.156947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 463/927] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 19:05:28 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:29.158292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f60c4c-4236-445d-8763-d2b549e61685 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:29.158580 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f60c4c-4236-445d-8763-d2b549e61685 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:29.158822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f60c4c-4236-445d-8763-d2b549e61685 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:29.160319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 464/928] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:29.161125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f60c4c-4236-445d-8763-d2b549e61685 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:29.185229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40427d73-f8d5-4eac-a806-13b2b5a6d99b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:29.185881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427d73-f8d5-4eac-a806-13b2b5a6d99b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:29.186163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427d73-f8d5-4eac-a806-13b2b5a6d99b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:29.186436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40427d73-f8d5-4eac-a806-13b2b5a6d99b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:29.187146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40427d73-f8d5-4eac-a806-13b2b5a6d99b None admin] RBAC: Adding query filter params (interface=public, service_id=676556df24d3420aab0a442f7014d87b, region_id=RegionOne) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:29.187456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40427d73-f8d5-4eac-a806-13b2b5a6d99b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:29.188822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40427d73-f8d5-4eac-a806-13b2b5a6d99b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:29.199107 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 465/929] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 19:05:29 2022] GET /identity/v3/endpoints?service_id=676556df24d3420aab0a442f7014d87b&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:29.200458 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508503cd-2564-4f59-8fbe-34091eae5931 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:29.200747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508503cd-2564-4f59-8fbe-34091eae5931 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:29.201031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508503cd-2564-4f59-8fbe-34091eae5931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:29.220207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-508503cd-2564-4f59-8fbe-34091eae5931 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:29.221754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-508503cd-2564-4f59-8fbe-34091eae5931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:29.267249 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f60c4c-4236-445d-8763-d2b549e61685 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:29.297532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:29.310018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 466/930] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:29.311808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508503cd-2564-4f59-8fbe-34091eae5931 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:29.317142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90991ec1-2098-45cd-9dbc-88d77199aeae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:29.317772 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90991ec1-2098-45cd-9dbc-88d77199aeae None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:29.318085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90991ec1-2098-45cd-9dbc-88d77199aeae None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:29.318363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90991ec1-2098-45cd-9dbc-88d77199aeae None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:29.319010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90991ec1-2098-45cd-9dbc-88d77199aeae None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:29.319315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90991ec1-2098-45cd-9dbc-88d77199aeae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:29.320709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90991ec1-2098-45cd-9dbc-88d77199aeae None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:29.326989 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 465/931] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 19:05:29 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:29.332694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90991ec1-2098-45cd-9dbc-88d77199aeae None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:29.412831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:29.438451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508503cd-2564-4f59-8fbe-34091eae5931 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:29.459290 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90991ec1-2098-45cd-9dbc-88d77199aeae None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:29.485012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b0f0-b717-4f15-a6ba-0a50aef4762f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:29.486062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b0f0-b717-4f15-a6ba-0a50aef4762f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:29.486544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b0f0-b717-4f15-a6ba-0a50aef4762f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:29.487014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa8b0f0-b717-4f15-a6ba-0a50aef4762f None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:29.488544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b0f0-b717-4f15-a6ba-0a50aef4762f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:29.490541 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa8b0f0-b717-4f15-a6ba-0a50aef4762f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:29.497169 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e3d3a-d329-4ccd-8a09-0feb0186baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:29.497930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e3d3a-d329-4ccd-8a09-0feb0186baea None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:29.498148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 467/932] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 19:05:29 2022] GET /identity/v3/services => generated 1497 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:05:29.498263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e3d3a-d329-4ccd-8a09-0feb0186baea None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:29.498595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e3d3a-d329-4ccd-8a09-0feb0186baea None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:29.499323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e3d3a-d329-4ccd-8a09-0feb0186baea None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:29.500813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e3d3a-d329-4ccd-8a09-0feb0186baea None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:29.539375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 466/933] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:05:29 2022] POST /identity/v3/endpoints => generated 347 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:05:29.585121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b0f0-b717-4f15-a6ba-0a50aef4762f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:29.717207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa8b0f0-b717-4f15-a6ba-0a50aef4762f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:29.763566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ea87e-c493-4b79-bdd7-66762ee8e79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:29.764571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ea87e-c493-4b79-bdd7-66762ee8e79f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:29.765029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ea87e-c493-4b79-bdd7-66762ee8e79f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:29.765486 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3ea87e-c493-4b79-bdd7-66762ee8e79f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:29.779808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3ea87e-c493-4b79-bdd7-66762ee8e79f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ce3ea87e-c493-4b79-bdd7-66762ee8e79f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:29.785353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:29.786577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:29.787464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:29.787464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:29.787464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:29.787464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:29.787464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:29.787464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:29.787464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:29.787464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:29.787464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:29.787464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:29.787464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 19:05:29.787464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:29.788766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 468/934] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 15 19:05:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:29.793635 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e3d3a-d329-4ccd-8a09-0feb0186baea None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:29.843338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:29.908996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e3d3a-d329-4ccd-8a09-0feb0186baea None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:29.946920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30639828-f800-4a10-9396-ee9081f41195 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:29.947553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30639828-f800-4a10-9396-ee9081f41195 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:29.947812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30639828-f800-4a10-9396-ee9081f41195 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:29.948087 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30639828-f800-4a10-9396-ee9081f41195 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:29.948816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30639828-f800-4a10-9396-ee9081f41195 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:29.949121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30639828-f800-4a10-9396-ee9081f41195 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:29.950549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30639828-f800-4a10-9396-ee9081f41195 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:29.960529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 467/935] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 19:05:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:29.966261 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ea87e-c493-4b79-bdd7-66762ee8e79f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:29.970183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:30.089487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3ea87e-c493-4b79-bdd7-66762ee8e79f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:30.128252 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33710007-122b-4501-87b0-ca2d372082ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:30.128807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33710007-122b-4501-87b0-ca2d372082ef None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:30.129156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33710007-122b-4501-87b0-ca2d372082ef None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:30.129423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33710007-122b-4501-87b0-ca2d372082ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:30.141093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33710007-122b-4501-87b0-ca2d372082ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:30.142591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33710007-122b-4501-87b0-ca2d372082ef None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-33710007-122b-4501-87b0-ca2d372082ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:30.159184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:30.160749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:30.162174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:30.162174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:30.162174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:30.162174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 469/936] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:30.169959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30639828-f800-4a10-9396-ee9081f41195 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:30.279995 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30639828-f800-4a10-9396-ee9081f41195 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:30.290854 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:30.319355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145098e-7c01-4084-b52b-dc64241f7c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:30.319992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145098e-7c01-4084-b52b-dc64241f7c2f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:30.320272 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145098e-7c01-4084-b52b-dc64241f7c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:30.320545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6145098e-7c01-4084-b52b-dc64241f7c2f None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:30.321203 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145098e-7c01-4084-b52b-dc64241f7c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:30.321509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145098e-7c01-4084-b52b-dc64241f7c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:30.322945 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6145098e-7c01-4084-b52b-dc64241f7c2f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:30.336944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 468/937] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:30.342264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33710007-122b-4501-87b0-ca2d372082ef None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:30.402544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:30.457426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33710007-122b-4501-87b0-ca2d372082ef None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:30.497917 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241344a-0466-4d06-a158-6c111c93ef0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:30.498610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241344a-0466-4d06-a158-6c111c93ef0d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:30.498881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241344a-0466-4d06-a158-6c111c93ef0d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:30.499181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d241344a-0466-4d06-a158-6c111c93ef0d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:30.508064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241344a-0466-4d06-a158-6c111c93ef0d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:30.509519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d241344a-0466-4d06-a158-6c111c93ef0d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d241344a-0466-4d06-a158-6c111c93ef0d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:30.521726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:30.522729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:30.523682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:30.523682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:30.523682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:30.523682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:30.523682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:30.523682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:30.523682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:30.523682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:30.523682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 19:05:30.523682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:30.523682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 470/938] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 19:05:30 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:30.529092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145098e-7c01-4084-b52b-dc64241f7c2f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:30.644746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6145098e-7c01-4084-b52b-dc64241f7c2f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:30.680878 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f654e97d-2d98-4891-aabf-cc3910bf69d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:30.681424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654e97d-2d98-4891-aabf-cc3910bf69d8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:30.681705 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654e97d-2d98-4891-aabf-cc3910bf69d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:30.682008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f654e97d-2d98-4891-aabf-cc3910bf69d8 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:30.682746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654e97d-2d98-4891-aabf-cc3910bf69d8 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:30.683053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654e97d-2d98-4891-aabf-cc3910bf69d8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:30.684503 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f654e97d-2d98-4891-aabf-cc3910bf69d8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:30.703637 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 469/939] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 15 19:05:30 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:30.710938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241344a-0466-4d06-a158-6c111c93ef0d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:30.824915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d241344a-0466-4d06-a158-6c111c93ef0d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:30.840291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:30.864040 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae46f4a-42c3-4cdf-aa3f-85d77594375d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:30.864688 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae46f4a-42c3-4cdf-aa3f-85d77594375d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:30.864965 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae46f4a-42c3-4cdf-aa3f-85d77594375d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:30.865232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae46f4a-42c3-4cdf-aa3f-85d77594375d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:30.876857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae46f4a-42c3-4cdf-aa3f-85d77594375d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:30.878495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae46f4a-42c3-4cdf-aa3f-85d77594375d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:30.884225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f821f01-1de5-4346-a7e7-14152a21cacc None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:30.884512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f821f01-1de5-4346-a7e7-14152a21cacc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:30.884783 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f821f01-1de5-4346-a7e7-14152a21cacc None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:30.886508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 470/940] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:05:30.892740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887bea3-cac8-483a-8cec-05f19499606a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:30.892740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887bea3-cac8-483a-8cec-05f19499606a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:30.892740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d887bea3-cac8-483a-8cec-05f19499606a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8ae46f4a-42c3-4cdf-aa3f-85d77594375d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:30.895865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:30.896990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:30.897912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:30.897912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:30.897912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:30.897912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 471/941] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:30.902963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae46f4a-42c3-4cdf-aa3f-85d77594375d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:30.920295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d887bea3-cac8-483a-8cec-05f19499606a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:30.921851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d887bea3-cac8-483a-8cec-05f19499606a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:30.949184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:31.014164 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 471/942] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:05:31.019411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae46f4a-42c3-4cdf-aa3f-85d77594375d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:31.053870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e3be3-3871-44c1-a83a-44ab6a25df61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:31.054772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e3be3-3871-44c1-a83a-44ab6a25df61 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:31.055205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e3be3-3871-44c1-a83a-44ab6a25df61 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:31.055628 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403e3be3-3871-44c1-a83a-44ab6a25df61 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:31.056402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e3be3-3871-44c1-a83a-44ab6a25df61 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:31.056852 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e3be3-3871-44c1-a83a-44ab6a25df61 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:31.058391 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403e3be3-3871-44c1-a83a-44ab6a25df61 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:31.070888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 472/943] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:31.076843 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887bea3-cac8-483a-8cec-05f19499606a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:31.183816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d887bea3-cac8-483a-8cec-05f19499606a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:31.218573 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29e0a7-ea94-46a7-896a-ed8936258d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:31.219131 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29e0a7-ea94-46a7-896a-ed8936258d9a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:31.219404 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29e0a7-ea94-46a7-896a-ed8936258d9a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:31.219667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29e0a7-ea94-46a7-896a-ed8936258d9a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:31.227055 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29e0a7-ea94-46a7-896a-ed8936258d9a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:31.228574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29e0a7-ea94-46a7-896a-ed8936258d9a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-de29e0a7-ea94-46a7-896a-ed8936258d9a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:31.241084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:31.242046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:31.242968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:31.242968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:31.242968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:31.242968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:31.242968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:31.242968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:31.242968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:31.242968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:31.242968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 472/944] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:31.249807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e3be3-3871-44c1-a83a-44ab6a25df61 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:31.278850 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:31.301818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29e0a7-ea94-46a7-896a-ed8936258d9a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:31.323433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:31.364321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403e3be3-3871-44c1-a83a-44ab6a25df61 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:31.401863 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0fa88-b8f7-4891-806c-065efd806d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:31.402521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0fa88-b8f7-4891-806c-065efd806d53 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:31.402799 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0fa88-b8f7-4891-806c-065efd806d53 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:31.403067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f0fa88-b8f7-4891-806c-065efd806d53 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:31.403768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0fa88-b8f7-4891-806c-065efd806d53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:31.404072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0fa88-b8f7-4891-806c-065efd806d53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:31.405770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f0fa88-b8f7-4891-806c-065efd806d53 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:31.420914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 473/945] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:31.427249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0fa88-b8f7-4891-806c-065efd806d53 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:31.437259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29e0a7-ea94-46a7-896a-ed8936258d9a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:31.478820 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f02c11-08e7-4b17-8faf-10c42d783e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:31.479376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f02c11-08e7-4b17-8faf-10c42d783e93 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:31.479651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f02c11-08e7-4b17-8faf-10c42d783e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:31.479914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f02c11-08e7-4b17-8faf-10c42d783e93 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:31.480571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f02c11-08e7-4b17-8faf-10c42d783e93 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:31.482041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f02c11-08e7-4b17-8faf-10c42d783e93 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:31.484657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: WARNING keystone.server.flask.common [None req-d4f02c11-08e7-4b17-8faf-10c42d783e93 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 15 19:05:31.504706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.sql.core [None req-d4f02c11-08e7-4b17-8faf-10c42d783e93 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 19:05:31.504706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 19:05:31.504706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [parameters: {'id': 'c2361d28cb474e07aa35dbe8b460587c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 19:05:31.504706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81625) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 19:05:31.528964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-d4f02c11-08e7-4b17-8faf-10c42d783e93 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c2361d28cb474e07aa35dbe8b460587c.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c2361d28cb474e07aa35dbe8b460587c. Sep 15 19:05:31.528964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:31.528964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 19:05:31.528964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 19:05:31.528964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 19:05:31.528964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 19:05:31.528964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 19:05:31.528964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 19:05:31.528964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 19:05:31.528964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application conn.query(q) Sep 15 19:05:31.528964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 19:05:31.528964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 19:05:31.528964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result.read() Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 15 19:05:31.529990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application next(self.gen) Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application yield resource Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application next(self.gen) Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise self.value Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application session.commit() Sep 15 19:05:31.530990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.session.flush() Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application compat.raise_( Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 19:05:31.531879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 19:05:31.532769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application conn.query(q) Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result.read() Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 19:05:31.533566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [parameters: {'id': 'c2361d28cb474e07aa35dbe8b460587c', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:31.537017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:31.538973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:31.542487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:31.542487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 15 19:05:31.542487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 15 19:05:31.542487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:31.542487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:31.542487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 15 19:05:31.542487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 15 19:05:31.542487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id c2361d28cb474e07aa35dbe8b460587c. Sep 15 19:05:31.542487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:31.542487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 473/946] 10.222.0.25 () {60 vars in 1140 bytes} [Thu Sep 15 19:05:31 2022] POST /identity/v3/projects => generated 262 bytes in 230 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:31.542487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f02c11-08e7-4b17-8faf-10c42d783e93 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:31.555027 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:31.579445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f0fa88-b8f7-4891-806c-065efd806d53 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:31.635160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5c10f-43d7-418e-855a-56e8976b2972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:31.637153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5c10f-43d7-418e-855a-56e8976b2972 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:31.637678 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5c10f-43d7-418e-855a-56e8976b2972 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:31.638483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b5c10f-43d7-418e-855a-56e8976b2972 None admin] PATH_INFO: `/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/cd3b9f8c819d4ac1b6ded6ea1a91e68f/roles/88cd6fa74eaa4bf48cec363a02236cf4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:31.640703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:31.644009 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5c10f-43d7-418e-855a-56e8976b2972 None admin] RBAC: Authorizing `identity:create_grant(project_id=2958a115e7974fc4b5c74a633fc4322c, user_id=cd3b9f8c819d4ac1b6ded6ea1a91e68f, role_id=88cd6fa74eaa4bf48cec363a02236cf4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:31.647610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b5c10f-43d7-418e-855a-56e8976b2972 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:31.679401 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 474/947] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:05:31 2022] PUT /identity/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/cd3b9f8c819d4ac1b6ded6ea1a91e68f/roles/88cd6fa74eaa4bf48cec363a02236cf4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:05:31.705716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f02c11-08e7-4b17-8faf-10c42d783e93 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:31.752306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6923fdf-2999-4f96-88fc-59e2b4e3213d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:31.752857 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6923fdf-2999-4f96-88fc-59e2b4e3213d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:31.753217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6923fdf-2999-4f96-88fc-59e2b4e3213d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:31.753431 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6923fdf-2999-4f96-88fc-59e2b4e3213d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:31.761606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6923fdf-2999-4f96-88fc-59e2b4e3213d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:31.763391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6923fdf-2999-4f96-88fc-59e2b4e3213d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-f6923fdf-2999-4f96-88fc-59e2b4e3213d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:31.778361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:31.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:31.780267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:31.780267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:31.780267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:31.780267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:31.780267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:31.780267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:31.780267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:31.780267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:31.780707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 474/948] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:31.786652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5c10f-43d7-418e-855a-56e8976b2972 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:31.795781 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca69851-d4f0-408c-85e5-c4ea74ebe2b9 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:31.796110 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca69851-d4f0-408c-85e5-c4ea74ebe2b9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:31.796327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca69851-d4f0-408c-85e5-c4ea74ebe2b9 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:31.801272 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 475/949] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:31.807077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28382246-59d3-48ab-8c96-ad96e5e1a0f6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:31.807355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28382246-59d3-48ab-8c96-ad96e5e1a0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:31.807648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28382246-59d3-48ab-8c96-ad96e5e1a0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:31.828651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-28382246-59d3-48ab-8c96-ad96e5e1a0f6 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:31.830306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-28382246-59d3-48ab-8c96-ad96e5e1a0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:31.918968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 476/950] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:05:31.930318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b5c10f-43d7-418e-855a-56e8976b2972 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:31.968506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e21cb6-0817-4302-854a-8efc51bbc23d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:31.969128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e21cb6-0817-4302-854a-8efc51bbc23d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:31.969405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e21cb6-0817-4302-854a-8efc51bbc23d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:31.969671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e21cb6-0817-4302-854a-8efc51bbc23d None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:31.970375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e21cb6-0817-4302-854a-8efc51bbc23d None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:31.970671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e21cb6-0817-4302-854a-8efc51bbc23d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:31.972648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e21cb6-0817-4302-854a-8efc51bbc23d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:31.980817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059dacd-7010-4183-be40-c4d4816540af None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:31.981322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059dacd-7010-4183-be40-c4d4816540af None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:31.981408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7059dacd-7010-4183-be40-c4d4816540af None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:31.985963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 477/951] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:05:31.988784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66960b5-5bf6-4557-93e5-9d60870e769b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:31.989069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66960b5-5bf6-4557-93e5-9d60870e769b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:31.989346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66960b5-5bf6-4557-93e5-9d60870e769b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:31.992719 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 475/952] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 19:05:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:32.009495 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a66960b5-5bf6-4557-93e5-9d60870e769b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:32.010694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a66960b5-5bf6-4557-93e5-9d60870e769b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:32.081641 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:32.101920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 478/953] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:32.188404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e21cb6-0817-4302-854a-8efc51bbc23d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:32.198132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:32.300609 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e21cb6-0817-4302-854a-8efc51bbc23d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:32.337563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f844f-d0c9-4bb7-a563-d3cd544282ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:32.338295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f844f-d0c9-4bb7-a563-d3cd544282ca None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:32.338507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f844f-d0c9-4bb7-a563-d3cd544282ca None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:32.338775 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f844f-d0c9-4bb7-a563-d3cd544282ca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:32.339365 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f844f-d0c9-4bb7-a563-d3cd544282ca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:32.340740 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f844f-d0c9-4bb7-a563-d3cd544282ca None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-fa1f844f-d0c9-4bb7-a563-d3cd544282ca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:32.351399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:32.352588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:32.353488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 476/954] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 19:05:32 2022] GET /identity/v3/services/object-store => generated 93 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:32.359892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66960b5-5bf6-4557-93e5-9d60870e769b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:32.368584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f844f-d0c9-4bb7-a563-d3cd544282ca None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:32.455295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:32.483074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66960b5-5bf6-4557-93e5-9d60870e769b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:32.495150 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f844f-d0c9-4bb7-a563-d3cd544282ca None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:32.531206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae1543-9259-49a2-a7d2-66cb9a9f961e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:32.532624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae1543-9259-49a2-a7d2-66cb9a9f961e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:32.533289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae1543-9259-49a2-a7d2-66cb9a9f961e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:32.533721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ae1543-9259-49a2-a7d2-66cb9a9f961e None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:32.535563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae1543-9259-49a2-a7d2-66cb9a9f961e None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:32.536127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae1543-9259-49a2-a7d2-66cb9a9f961e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:32.537813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98ae1543-9259-49a2-a7d2-66cb9a9f961e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:32.538150 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2fabf-f0f8-4047-aa50-d2d993c99b7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:32.538913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2fabf-f0f8-4047-aa50-d2d993c99b7f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:32.539293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2fabf-f0f8-4047-aa50-d2d993c99b7f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:32.539729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e2fabf-f0f8-4047-aa50-d2d993c99b7f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:32.540787 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2fabf-f0f8-4047-aa50-d2d993c99b7f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:32.542960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e2fabf-f0f8-4047-aa50-d2d993c99b7f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:32.550187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 479/955] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 19:05:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:32.551742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae1543-9259-49a2-a7d2-66cb9a9f961e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d4e2fabf-f0f8-4047-aa50-d2d993c99b7f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:32.559278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:32.560310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:32.561184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 477/956] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:32.566926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2fabf-f0f8-4047-aa50-d2d993c99b7f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:32.635248 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:32.691216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ae1543-9259-49a2-a7d2-66cb9a9f961e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:32.698782 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e2fabf-f0f8-4047-aa50-d2d993c99b7f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:32.736764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccadc8-ec02-4dd1-a440-0d9260a2b439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:32.737818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccadc8-ec02-4dd1-a440-0d9260a2b439 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:32.738169 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccadc8-ec02-4dd1-a440-0d9260a2b439 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:32.738458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ccadc8-ec02-4dd1-a440-0d9260a2b439 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:32.739141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccadc8-ec02-4dd1-a440-0d9260a2b439 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:32.739442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccadc8-ec02-4dd1-a440-0d9260a2b439 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:32.739846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a382ace-97c4-46df-91d7-cb9872ed39c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:32.740693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a382ace-97c4-46df-91d7-cb9872ed39c8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:32.740861 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ccadc8-ec02-4dd1-a440-0d9260a2b439 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:32.741310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a382ace-97c4-46df-91d7-cb9872ed39c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:32.741773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a382ace-97c4-46df-91d7-cb9872ed39c8 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:32.742630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a382ace-97c4-46df-91d7-cb9872ed39c8 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:32.743121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a382ace-97c4-46df-91d7-cb9872ed39c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:32.744728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a382ace-97c4-46df-91d7-cb9872ed39c8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:32.746158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:32.750981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 480/957] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 19:05:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:32.753076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccadc8-ec02-4dd1-a440-0d9260a2b439 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:32.757822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 478/958] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 19:05:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:32.763101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a382ace-97c4-46df-91d7-cb9872ed39c8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:32.877134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a382ace-97c4-46df-91d7-cb9872ed39c8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:32.888189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ccadc8-ec02-4dd1-a440-0d9260a2b439 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:32.916782 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:32.924239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b723e47-e551-4e53-96ed-bdbf3382b4e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:32.925989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b723e47-e551-4e53-96ed-bdbf3382b4e5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:32.926488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b723e47-e551-4e53-96ed-bdbf3382b4e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:32.927270 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b723e47-e551-4e53-96ed-bdbf3382b4e5 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:32.928376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b723e47-e551-4e53-96ed-bdbf3382b4e5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:32.928892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b723e47-e551-4e53-96ed-bdbf3382b4e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:32.930516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b723e47-e551-4e53-96ed-bdbf3382b4e5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:32.935475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d0fee4-9cf8-4b67-a53f-aa5d58ee3d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:32.936277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0fee4-9cf8-4b67-a53f-aa5d58ee3d04 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:32.936462 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0fee4-9cf8-4b67-a53f-aa5d58ee3d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:32.936693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d0fee4-9cf8-4b67-a53f-aa5d58ee3d04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:32.936791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 479/959] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 19:05:32 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:32.937355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0fee4-9cf8-4b67-a53f-aa5d58ee3d04 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:32.943062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d0fee4-9cf8-4b67-a53f-aa5d58ee3d04 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:32.968875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 481/960] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:05:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:05:34.014602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0758fb9-dbcd-4b9e-8cf2-55c0c6e1058d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:34.015143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0758fb9-dbcd-4b9e-8cf2-55c0c6e1058d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:34.015143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0758fb9-dbcd-4b9e-8cf2-55c0c6e1058d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:34.016760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 480/961] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:34.022442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f0c4c-3a3c-447d-9bb5-7d96ebcb8cc7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:34.022946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f0c4c-3a3c-447d-9bb5-7d96ebcb8cc7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:34.023024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f0c4c-3a3c-447d-9bb5-7d96ebcb8cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:34.041965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-757f0c4c-3a3c-447d-9bb5-7d96ebcb8cc7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:34.043170 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-757f0c4c-3a3c-447d-9bb5-7d96ebcb8cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:34.116755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 482/962] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:34.394356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0758fb9-dbcd-4b9e-8cf2-55c0c6e1058d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:34.415794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6070d4-73a8-4b24-8bf3-2e5176b9cfb5 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:34.416127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6070d4-73a8-4b24-8bf3-2e5176b9cfb5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:34.416341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6070d4-73a8-4b24-8bf3-2e5176b9cfb5 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:34.417991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 483/963] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:34.425824 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29051b-0562-4c6d-a59c-d99d5947d101 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:34.425824 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29051b-0562-4c6d-a59c-d99d5947d101 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:34.425824 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea29051b-0562-4c6d-a59c-d99d5947d101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:34.442357 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ea29051b-0562-4c6d-a59c-d99d5947d101 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:34.443559 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ea29051b-0562-4c6d-a59c-d99d5947d101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:34.470356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:34.517808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 484/964] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:34.520046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0758fb9-dbcd-4b9e-8cf2-55c0c6e1058d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:34.554207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec81286-c169-4618-b567-875953bbb541 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:34.554764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec81286-c169-4618-b567-875953bbb541 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:34.555049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec81286-c169-4618-b567-875953bbb541 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:34.555337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec81286-c169-4618-b567-875953bbb541 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:34.565746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec81286-c169-4618-b567-875953bbb541 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-3ec81286-c169-4618-b567-875953bbb541 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:34.570635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:34.571569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:34.572409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:34.572409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:34.572409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:34.572409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:34.572409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:34.572409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:34.572409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:34.572409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:34.572409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:34.572409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:34.572409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 19:05:34.572409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:34.572409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 481/965] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 15 19:05:34 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:34.579539 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29051b-0562-4c6d-a59c-d99d5947d101 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:34.614203 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:34.685563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea29051b-0562-4c6d-a59c-d99d5947d101 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:34.723256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62761b-5269-4140-bba1-44c178d098d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:34.724296 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62761b-5269-4140-bba1-44c178d098d7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:34.724778 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62761b-5269-4140-bba1-44c178d098d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:34.725267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e62761b-5269-4140-bba1-44c178d098d7 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:34.726198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62761b-5269-4140-bba1-44c178d098d7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:34.726711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62761b-5269-4140-bba1-44c178d098d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:34.728306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e62761b-5269-4140-bba1-44c178d098d7 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:34.737529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 485/966] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 19:05:34 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:34.743733 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec81286-c169-4618-b567-875953bbb541 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:34.791687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62761b-5269-4140-bba1-44c178d098d7 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:34.855723 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec81286-c169-4618-b567-875953bbb541 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:34.880945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:34.897619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e901d9c-c3bc-44d7-ab66-de33b56a817a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:34.898336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901d9c-c3bc-44d7-ab66-de33b56a817a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:34.898725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901d9c-c3bc-44d7-ab66-de33b56a817a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:34.898998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e901d9c-c3bc-44d7-ab66-de33b56a817a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:34.902707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:34.912131 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e901d9c-c3bc-44d7-ab66-de33b56a817a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:34.912723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e62761b-5269-4140-bba1-44c178d098d7 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:34.913607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e901d9c-c3bc-44d7-ab66-de33b56a817a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-5e901d9c-c3bc-44d7-ab66-de33b56a817a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:34.929874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:34.930883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:34.931776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:34.931776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:34.931776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:34.931776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 482/967] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:34.937243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e901d9c-c3bc-44d7-ab66-de33b56a817a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:34.957061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b595ee-3999-472f-8a0a-487fdebf44d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:34.958517 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b595ee-3999-472f-8a0a-487fdebf44d7 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:34.959330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b595ee-3999-472f-8a0a-487fdebf44d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:34.959989 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b595ee-3999-472f-8a0a-487fdebf44d7 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:34.961338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b595ee-3999-472f-8a0a-487fdebf44d7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:34.963310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b595ee-3999-472f-8a0a-487fdebf44d7 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:34.980745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.sql.core [None req-c4b595ee-3999-472f-8a0a-487fdebf44d7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 19:05:34.980745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 19:05:34.980745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [parameters: {'user_id': 'c24657b366cc454a8208109ebd7dcb34', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 19:05:34.980745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81625) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c4b595ee-3999-472f-8a0a-487fdebf44d7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application conn.query(q) Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result.read() Sep 15 19:05:34.990381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 19:05:34.991327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application next(self.gen) Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application yield resource Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application next(self.gen) Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.session.rollback() Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.force_reraise() Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise self.value Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application session.commit() Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 15 19:05:34.992265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._prepare_impl() Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.session.flush() Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._flush(objects) Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application compat.raise_( Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application flush_context.execute() Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rec.execute(self) Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 15 19:05:34.993176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 15 19:05:34.994311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result = self._query(query) Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application conn.query(q) Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application result.read() Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 15 19:05:34.995183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c24657b366cc454a8208109ebd7dcb34', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:34.996017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 15 19:05:34.998294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 15 19:05:35.000472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 15 19:05:35.000472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 15 19:05:35.000472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 15 19:05:35.000472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 15 19:05:35.000472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 15 19:05:35.000472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:35.003579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 486/968] 10.222.0.25 () {60 vars in 1131 bytes} [Thu Sep 15 19:05:34 2022] POST /identity/v3/users => generated 160 bytes in 212 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:35.010412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b595ee-3999-472f-8a0a-487fdebf44d7 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:35.056362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e901d9c-c3bc-44d7-ab66-de33b56a817a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:35.093459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d953fc-0f87-4397-b6fc-f0d364b1ea88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:35.094017 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d953fc-0f87-4397-b6fc-f0d364b1ea88 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:35.094387 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d953fc-0f87-4397-b6fc-f0d364b1ea88 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:35.094668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d953fc-0f87-4397-b6fc-f0d364b1ea88 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:35.095317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d953fc-0f87-4397-b6fc-f0d364b1ea88 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:35.095646 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d953fc-0f87-4397-b6fc-f0d364b1ea88 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:35.097475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d953fc-0f87-4397-b6fc-f0d364b1ea88 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:35.113172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 483/969] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:35.118092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d953fc-0f87-4397-b6fc-f0d364b1ea88 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:35.155296 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b595ee-3999-472f-8a0a-487fdebf44d7 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:35.175579 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:35.206585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38222-62e5-4909-a876-738daa282bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:35.207697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38222-62e5-4909-a876-738daa282bb0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:35.208159 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38222-62e5-4909-a876-738daa282bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:35.208603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc38222-62e5-4909-a876-738daa282bb0 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:35.217955 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc38222-62e5-4909-a876-738daa282bb0 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:35.220061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc38222-62e5-4909-a876-738daa282bb0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-7dc38222-62e5-4909-a876-738daa282bb0 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:35.233603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:35.234642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:35.235672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:35.235672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:35.235672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:35.235672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:35.235672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:35.235672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:35.235672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:35.235672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:35.235672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 15 19:05:35.235672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:35.243148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 487/970] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:05:35 2022] GET /identity/v3/users/cinder => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:35.244764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38222-62e5-4909-a876-738daa282bb0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:35.250924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d953fc-0f87-4397-b6fc-f0d364b1ea88 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:35.266268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:35.289353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fee842-8ff5-4cb7-9516-6fdd6e9b6f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:35.290283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fee842-8ff5-4cb7-9516-6fdd6e9b6f02 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:35.290774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fee842-8ff5-4cb7-9516-6fdd6e9b6f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:35.291048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fee842-8ff5-4cb7-9516-6fdd6e9b6f02 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:35.302615 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fee842-8ff5-4cb7-9516-6fdd6e9b6f02 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:35.304098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fee842-8ff5-4cb7-9516-6fdd6e9b6f02 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-27fee842-8ff5-4cb7-9516-6fdd6e9b6f02 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:35.317523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:35.318543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:35.319480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:35.319480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:35.319480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:35.319480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:35.319480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:35.319480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:35.319480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:35.319480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:35.319480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 15 19:05:35.319480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:35.319480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 484/971] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 19:05:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:35.320085 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793cd2f-f004-4af9-a549-22b533886c62 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:35.320151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793cd2f-f004-4af9-a549-22b533886c62 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:35.320363 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4793cd2f-f004-4af9-a549-22b533886c62 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:35.321603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 485/972] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:35.322643 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cc800-4e6f-4ebc-a135-ee3bf122c971 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:35.322921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cc800-4e6f-4ebc-a135-ee3bf122c971 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:35.323192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0cc800-4e6f-4ebc-a135-ee3bf122c971 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:35.324365 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 486/973] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:35.325581 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cc800-4e6f-4ebc-a135-ee3bf122c971 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:35.360889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc38222-62e5-4909-a876-738daa282bb0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:35.393603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d017253f-578f-46ab-9754-6ee0241f974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:35.394159 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017253f-578f-46ab-9754-6ee0241f974b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:35.394439 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017253f-578f-46ab-9754-6ee0241f974b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:35.394716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d017253f-578f-46ab-9754-6ee0241f974b None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:35.395413 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017253f-578f-46ab-9754-6ee0241f974b None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:35.395718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017253f-578f-46ab-9754-6ee0241f974b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:35.397151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d017253f-578f-46ab-9754-6ee0241f974b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:35.422780 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:35.431127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0cc800-4e6f-4ebc-a135-ee3bf122c971 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:35.434660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 488/974] 10.222.0.25 () {56 vars in 1101 bytes} [Thu Sep 15 19:05:35 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:35.441006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2bfc5-0f22-4e8b-8bb0-cf42738981a5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:35.441006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2bfc5-0f22-4e8b-8bb0-cf42738981a5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:35.441006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac2bfc5-0f22-4e8b-8bb0-cf42738981a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:35.462736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-eac2bfc5-0f22-4e8b-8bb0-cf42738981a5 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:35.464354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-eac2bfc5-0f22-4e8b-8bb0-cf42738981a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:35.471296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59f72cd-4115-4be0-a904-104057e23110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:35.472312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f72cd-4115-4be0-a904-104057e23110 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:35.472783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f72cd-4115-4be0-a904-104057e23110 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:35.473366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59f72cd-4115-4be0-a904-104057e23110 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:35.474188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f72cd-4115-4be0-a904-104057e23110 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:35.474499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f72cd-4115-4be0-a904-104057e23110 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:35.476133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59f72cd-4115-4be0-a904-104057e23110 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:35.497734 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 487/975] 10.222.0.25 () {56 vars in 1149 bytes} [Thu Sep 15 19:05:35 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:35.499101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59131332-b62d-4999-bff9-e1ef721c7a94 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:35.499375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59131332-b62d-4999-bff9-e1ef721c7a94 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:35.499648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59131332-b62d-4999-bff9-e1ef721c7a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:35.519800 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-59131332-b62d-4999-bff9-e1ef721c7a94 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:35.521094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-59131332-b62d-4999-bff9-e1ef721c7a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:35.545871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 489/976] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:35.545871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2bfc5-0f22-4e8b-8bb0-cf42738981a5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:35.555938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:35.609810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 488/977] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:35.674267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac2bfc5-0f22-4e8b-8bb0-cf42738981a5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:35.710473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c98975-c22d-45fd-ba74-a0470cfce136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:35.711161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c98975-c22d-45fd-ba74-a0470cfce136 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:35.711439 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c98975-c22d-45fd-ba74-a0470cfce136 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:35.711740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c98975-c22d-45fd-ba74-a0470cfce136 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:35.783655 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c98975-c22d-45fd-ba74-a0470cfce136 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:35.785237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c98975-c22d-45fd-ba74-a0470cfce136 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:35.788758 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:35.837582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59131332-b62d-4999-bff9-e1ef721c7a94 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:35.893647 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 490/978] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:05:35 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:05:35.894598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c98975-c22d-45fd-ba74-a0470cfce136 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:35.927463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:35.946842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59131332-b62d-4999-bff9-e1ef721c7a94 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:35.985121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366df88-753a-4219-882d-c02c4f9e9751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:35.985774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366df88-753a-4219-882d-c02c4f9e9751 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:35.986098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366df88-753a-4219-882d-c02c4f9e9751 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:35.986366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9366df88-753a-4219-882d-c02c4f9e9751 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:35.986962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366df88-753a-4219-882d-c02c4f9e9751 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:35.988918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9366df88-753a-4219-882d-c02c4f9e9751 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-9366df88-753a-4219-882d-c02c4f9e9751 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:35.998141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:35.999207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:36.000243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:36.001230 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c98975-c22d-45fd-ba74-a0470cfce136 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:36.001316 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 489/979] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 19:05:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:36.001575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366df88-753a-4219-882d-c02c4f9e9751 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:36.002128 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:36.035574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c39435-54c4-459a-8096-bcac61fcca6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:36.036190 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c39435-54c4-459a-8096-bcac61fcca6c None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:36.036466 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c39435-54c4-459a-8096-bcac61fcca6c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:36.036734 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c39435-54c4-459a-8096-bcac61fcca6c None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:36.037381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c39435-54c4-459a-8096-bcac61fcca6c None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:36.038793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c39435-54c4-459a-8096-bcac61fcca6c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:36.057901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 491/980] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:05:35 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:05:36.057901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c39435-54c4-459a-8096-bcac61fcca6c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:36.118248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9366df88-753a-4219-882d-c02c4f9e9751 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:36.170845 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e79f5-7fcc-440c-aa52-b7bba7bad2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:36.172079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e79f5-7fcc-440c-aa52-b7bba7bad2cf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:36.172355 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e79f5-7fcc-440c-aa52-b7bba7bad2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:36.172781 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e79f5-7fcc-440c-aa52-b7bba7bad2cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:36.184629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e79f5-7fcc-440c-aa52-b7bba7bad2cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:36.185467 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c39435-54c4-459a-8096-bcac61fcca6c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:36.186122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02e79f5-7fcc-440c-aa52-b7bba7bad2cf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:36.189663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-a02e79f5-7fcc-440c-aa52-b7bba7bad2cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:36.208036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:36.209995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:36.211670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:36.211670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:36.211670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:36.214182 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 490/981] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:36.215941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e79f5-7fcc-440c-aa52-b7bba7bad2cf None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:36.225294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295ab3-ab24-42b3-9679-520cdc8739c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:36.225960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295ab3-ab24-42b3-9679-520cdc8739c4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:36.226830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295ab3-ab24-42b3-9679-520cdc8739c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:36.227111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11295ab3-ab24-42b3-9679-520cdc8739c4 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:36.227751 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11295ab3-ab24-42b3-9679-520cdc8739c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:36.228057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11295ab3-ab24-42b3-9679-520cdc8739c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:36.229829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11295ab3-ab24-42b3-9679-520cdc8739c4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:36.240289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 492/982] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 19:05:36 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:36.241434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295ab3-ab24-42b3-9679-520cdc8739c4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:36.275284 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:36.331799 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e79f5-7fcc-440c-aa52-b7bba7bad2cf None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:36.355465 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11295ab3-ab24-42b3-9679-520cdc8739c4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:36.367668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee6197-4c45-4ae0-b583-ebd239e33290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:36.368297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee6197-4c45-4ae0-b583-ebd239e33290 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:36.368576 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee6197-4c45-4ae0-b583-ebd239e33290 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:36.368960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ee6197-4c45-4ae0-b583-ebd239e33290 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:36.369729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee6197-4c45-4ae0-b583-ebd239e33290 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:36.370068 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee6197-4c45-4ae0-b583-ebd239e33290 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:36.371455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ee6197-4c45-4ae0-b583-ebd239e33290 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:36.389567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 491/983] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:36.390710 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee6197-4c45-4ae0-b583-ebd239e33290 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:36.395117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981cb87-26fa-43b0-b7fe-246fa8790e95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:36.395835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981cb87-26fa-43b0-b7fe-246fa8790e95 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:36.396118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981cb87-26fa-43b0-b7fe-246fa8790e95 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:36.396394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b981cb87-26fa-43b0-b7fe-246fa8790e95 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:36.397037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981cb87-26fa-43b0-b7fe-246fa8790e95 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:36.397342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981cb87-26fa-43b0-b7fe-246fa8790e95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:36.398767 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b981cb87-26fa-43b0-b7fe-246fa8790e95 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:36.404122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 493/984] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 19:05:36 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:36.409886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981cb87-26fa-43b0-b7fe-246fa8790e95 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:36.456415 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:36.503239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ee6197-4c45-4ae0-b583-ebd239e33290 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:36.507324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:36.516773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b981cb87-26fa-43b0-b7fe-246fa8790e95 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:36.543490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707748d-68c8-433a-902f-0906e614b214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:36.544134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707748d-68c8-433a-902f-0906e614b214 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:36.544408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707748d-68c8-433a-902f-0906e614b214 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:36.544677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4707748d-68c8-433a-902f-0906e614b214 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:36.551877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707748d-68c8-433a-902f-0906e614b214 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:36.553382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4707748d-68c8-433a-902f-0906e614b214 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:36.554961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825ab4c-8b91-46e8-8ab7-e8669dc97d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:36.555586 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825ab4c-8b91-46e8-8ab7-e8669dc97d7f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:36.555865 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825ab4c-8b91-46e8-8ab7-e8669dc97d7f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:36.556139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9825ab4c-8b91-46e8-8ab7-e8669dc97d7f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:36.556847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825ab4c-8b91-46e8-8ab7-e8669dc97d7f None admin] RBAC: Adding query filter params (interface=admin, service_id=676556df24d3420aab0a442f7014d87b, region_id=RegionOne) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:36.557159 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825ab4c-8b91-46e8-8ab7-e8669dc97d7f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:36.558555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9825ab4c-8b91-46e8-8ab7-e8669dc97d7f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:36.567738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 494/985] 10.222.0.25 () {56 vars in 1249 bytes} [Thu Sep 15 19:05:36 2022] GET /identity/v3/endpoints?service_id=676556df24d3420aab0a442f7014d87b&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-4707748d-68c8-433a-902f-0906e614b214 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:36.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:36.568992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:36.571546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:36.571546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:36.571546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:36.571546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:36.571546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:36.571546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:36.571546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:36.571546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:36.571546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 492/986] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:36.572345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707748d-68c8-433a-902f-0906e614b214 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:36.572505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825ab4c-8b91-46e8-8ab7-e8669dc97d7f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:36.687813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9825ab4c-8b91-46e8-8ab7-e8669dc97d7f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:36.700287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4707748d-68c8-433a-902f-0906e614b214 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:36.716671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:36.726476 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd5199-c654-4177-afa0-df42dc6d8a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:36.727099 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd5199-c654-4177-afa0-df42dc6d8a5b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:36.727418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd5199-c654-4177-afa0-df42dc6d8a5b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:36.727641 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd5199-c654-4177-afa0-df42dc6d8a5b None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:36.728294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd5199-c654-4177-afa0-df42dc6d8a5b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:36.729616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd5199-c654-4177-afa0-df42dc6d8a5b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:36.737350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 495/987] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 19:05:36 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:05:36.741245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81da02-afc0-4d93-a29b-080a00dfb84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:36.741918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81da02-afc0-4d93-a29b-080a00dfb84e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:36.742197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81da02-afc0-4d93-a29b-080a00dfb84e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:36.742463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81da02-afc0-4d93-a29b-080a00dfb84e None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:36.743173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81da02-afc0-4d93-a29b-080a00dfb84e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:36.743482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81da02-afc0-4d93-a29b-080a00dfb84e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:36.744946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81da02-afc0-4d93-a29b-080a00dfb84e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:36.762189 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 493/988] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:36.765670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd5199-c654-4177-afa0-df42dc6d8a5b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:36.791399 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:36.885226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd5199-c654-4177-afa0-df42dc6d8a5b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:36.930634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5feceb-cfda-414c-a7fe-77adc23b6b8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:36.931291 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5feceb-cfda-414c-a7fe-77adc23b6b8e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:36.931564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5feceb-cfda-414c-a7fe-77adc23b6b8e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:36.931828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5feceb-cfda-414c-a7fe-77adc23b6b8e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:36.932563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5feceb-cfda-414c-a7fe-77adc23b6b8e None admin] RBAC: Adding query filter params (role.id=88cd6fa74eaa4bf48cec363a02236cf4, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=cd3b9f8c819d4ac1b6ded6ea1a91e68f) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:36.932870 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5feceb-cfda-414c-a7fe-77adc23b6b8e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:36.934375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5feceb-cfda-414c-a7fe-77adc23b6b8e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:36.941548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 496/989] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:05:36 2022] GET /identity/v3/role_assignments?user.id=cd3b9f8c819d4ac1b6ded6ea1a91e68f&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=88cd6fa74eaa4bf48cec363a02236cf4 => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:38.265720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cef339-a03b-4ff9-8b4c-0171383c7573 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:38.266396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cef339-a03b-4ff9-8b4c-0171383c7573 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:38.266396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cef339-a03b-4ff9-8b4c-0171383c7573 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:38.267592 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 494/990] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:38.273319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5312e9-872d-4b78-923d-ab4c49d7dff1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:38.273893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5312e9-872d-4b78-923d-ab4c49d7dff1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:38.273893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5312e9-872d-4b78-923d-ab4c49d7dff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:38.292931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0d5312e9-872d-4b78-923d-ab4c49d7dff1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:38.297108 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0d5312e9-872d-4b78-923d-ab4c49d7dff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:38.370187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 497/991] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:38.633194 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cef339-a03b-4ff9-8b4c-0171383c7573 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:38.746138 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cef339-a03b-4ff9-8b4c-0171383c7573 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:38.782624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac88650e-9392-44b3-9022-5438251dd5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:38.783261 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88650e-9392-44b3-9022-5438251dd5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:38.783537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88650e-9392-44b3-9022-5438251dd5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:38.783808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac88650e-9392-44b3-9022-5438251dd5b6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:38.785188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88650e-9392-44b3-9022-5438251dd5b6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:38.786607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac88650e-9392-44b3-9022-5438251dd5b6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ac88650e-9392-44b3-9022-5438251dd5b6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:38.795879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:38.796889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:38.798826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 495/992] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:38 2022] GET /identity/v3/services/compute => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:38.803209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5312e9-872d-4b78-923d-ab4c49d7dff1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:38.820486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:38.915775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5312e9-872d-4b78-923d-ab4c49d7dff1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:38.948712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcde1b-6d81-4bb3-8d81-05e5b7310527 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:38.949066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcde1b-6d81-4bb3-8d81-05e5b7310527 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:38.949234 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fcde1b-6d81-4bb3-8d81-05e5b7310527 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:38.950880 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 496/993] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:05:38.952615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90175689-3209-4032-9d4c-100542e36846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:38.953224 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90175689-3209-4032-9d4c-100542e36846 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:38.953496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90175689-3209-4032-9d4c-100542e36846 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:38.953811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90175689-3209-4032-9d4c-100542e36846 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:38.954467 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90175689-3209-4032-9d4c-100542e36846 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:38.954763 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90175689-3209-4032-9d4c-100542e36846 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:38.956324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90175689-3209-4032-9d4c-100542e36846 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:38.957459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df5f94-a714-4912-8808-00d37c9f8f7f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:38.957765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df5f94-a714-4912-8808-00d37c9f8f7f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:38.958063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8df5f94-a714-4912-8808-00d37c9f8f7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:38.966034 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 498/994] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 19:05:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:38.972351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90175689-3209-4032-9d4c-100542e36846 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:38.977051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f8df5f94-a714-4912-8808-00d37c9f8f7f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:38.978293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f8df5f94-a714-4912-8808-00d37c9f8f7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:39.012275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:39.062417 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:39.066194 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 497/995] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:39.088127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90175689-3209-4032-9d4c-100542e36846 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:39.124000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89400a-0013-4c7c-a352-8ea8c6fef2e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:39.124615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89400a-0013-4c7c-a352-8ea8c6fef2e0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:39.124890 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89400a-0013-4c7c-a352-8ea8c6fef2e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:39.125154 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c89400a-0013-4c7c-a352-8ea8c6fef2e0 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:39.125813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89400a-0013-4c7c-a352-8ea8c6fef2e0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:39.126114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89400a-0013-4c7c-a352-8ea8c6fef2e0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:39.127483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c89400a-0013-4c7c-a352-8ea8c6fef2e0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:39.133214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb2b7-c8dc-4258-94d3-0b7275ab6f50 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:39.133468 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 499/996] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 19:05:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:39.133750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb2b7-c8dc-4258-94d3-0b7275ab6f50 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:39.134096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24eeb2b7-c8dc-4258-94d3-0b7275ab6f50 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:39.135721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 498/997] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:05:39.139450 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89400a-0013-4c7c-a352-8ea8c6fef2e0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:39.140475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3edbf1-4dae-4712-9944-527e4d035079 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:39.140752 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3edbf1-4dae-4712-9944-527e4d035079 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:39.141017 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3edbf1-4dae-4712-9944-527e4d035079 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:39.162655 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9a3edbf1-4dae-4712-9944-527e4d035079 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:39.163951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9a3edbf1-4dae-4712-9944-527e4d035079 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:39.242066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 499/998] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:39.249541 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c89400a-0013-4c7c-a352-8ea8c6fef2e0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:39.286291 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68ad6-e38d-436f-9d90-099083042a08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:39.286919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68ad6-e38d-436f-9d90-099083042a08 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:39.287166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68ad6-e38d-436f-9d90-099083042a08 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:39.287436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb68ad6-e38d-436f-9d90-099083042a08 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:39.288143 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb68ad6-e38d-436f-9d90-099083042a08 None admin] RBAC: Adding query filter params (interface=public, service_id=a1f7efb455e84318ba3e13a342998da5, region_id=RegionOne) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:39.288481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb68ad6-e38d-436f-9d90-099083042a08 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:39.289901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bb68ad6-e38d-436f-9d90-099083042a08 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:39.300123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 500/999] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 19:05:39 2022] GET /identity/v3/endpoints?service_id=a1f7efb455e84318ba3e13a342998da5&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:39.301266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3edbf1-4dae-4712-9944-527e4d035079 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:39.332114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68ad6-e38d-436f-9d90-099083042a08 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:39.342935 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:39.407834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:39.413832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3edbf1-4dae-4712-9944-527e4d035079 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:39.438401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb68ad6-e38d-436f-9d90-099083042a08 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:39.453449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ce744-df89-4b7b-9207-98bc4197bea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:39.454431 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ce744-df89-4b7b-9207-98bc4197bea0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:39.454855 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ce744-df89-4b7b-9207-98bc4197bea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:39.455327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ce744-df89-4b7b-9207-98bc4197bea0 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:39.456286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ce744-df89-4b7b-9207-98bc4197bea0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:39.457887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ce744-df89-4b7b-9207-98bc4197bea0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:39.465283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 500/1000] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 19:05:39 2022] GET /identity/v3/services => generated 1727 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:05:39.482957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9f7b1-75e0-40c7-8060-03f99b5cb636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:39.483623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9f7b1-75e0-40c7-8060-03f99b5cb636 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:39.483901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9f7b1-75e0-40c7-8060-03f99b5cb636 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:39.484229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d9f7b1-75e0-40c7-8060-03f99b5cb636 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:39.484836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9f7b1-75e0-40c7-8060-03f99b5cb636 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:39.486291 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d9f7b1-75e0-40c7-8060-03f99b5cb636 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-f7d9f7b1-75e0-40c7-8060-03f99b5cb636 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:39.496561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:39.497633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:39.503074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 501/1001] 10.222.0.25 () {56 vars in 1126 bytes} [Thu Sep 15 19:05:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:39.504366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ce744-df89-4b7b-9207-98bc4197bea0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:39.530768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9f7b1-75e0-40c7-8060-03f99b5cb636 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:39.607237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:39.626211 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ce744-df89-4b7b-9207-98bc4197bea0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:39.641578 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d9f7b1-75e0-40c7-8060-03f99b5cb636 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:39.668415 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c217d-8573-4151-990f-20d70458d8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:39.669166 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c217d-8573-4151-990f-20d70458d8e2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:39.669440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c217d-8573-4151-990f-20d70458d8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:39.669702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45c217d-8573-4151-990f-20d70458d8e2 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:39.670374 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c217d-8573-4151-990f-20d70458d8e2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:39.670674 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c217d-8573-4151-990f-20d70458d8e2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:39.672055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45c217d-8573-4151-990f-20d70458d8e2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:39.678107 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 501/1002] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 19:05:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:39.682551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e12c4-7570-447c-921c-196a48c67f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:39.683199 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e12c4-7570-447c-921c-196a48c67f43 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:39.683479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e12c4-7570-447c-921c-196a48c67f43 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:39.683752 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851e12c4-7570-447c-921c-196a48c67f43 None admin] PATH_INFO: `/v3/services/image` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:39.684345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e12c4-7570-447c-921c-196a48c67f43 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:39.684622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c217d-8573-4151-990f-20d70458d8e2 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:39.685733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851e12c4-7570-447c-921c-196a48c67f43 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-851e12c4-7570-447c-921c-196a48c67f43 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:39.695240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:39.696297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:39.698163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 502/1003] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Sep 15 19:05:39 2022] GET /identity/v3/services/image => generated 86 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:39.704655 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e12c4-7570-447c-921c-196a48c67f43 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:39.716637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:39.799533 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45c217d-8573-4151-990f-20d70458d8e2 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:39.826468 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851e12c4-7570-447c-921c-196a48c67f43 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:39.839168 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44c704-e22c-4c2b-95a1-ee336849fea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:39.839796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44c704-e22c-4c2b-95a1-ee336849fea8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:39.840060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44c704-e22c-4c2b-95a1-ee336849fea8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:39.840332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c44c704-e22c-4c2b-95a1-ee336849fea8 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:39.841381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44c704-e22c-4c2b-95a1-ee336849fea8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:39.841690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44c704-e22c-4c2b-95a1-ee336849fea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:39.843111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c44c704-e22c-4c2b-95a1-ee336849fea8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:39.849825 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 502/1004] 10.222.0.25 () {56 vars in 1122 bytes} [Thu Sep 15 19:05:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:39.855331 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44c704-e22c-4c2b-95a1-ee336849fea8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:39.866639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e73b9-d47b-4208-8304-5a63ba481016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:39.867260 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e73b9-d47b-4208-8304-5a63ba481016 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:39.867538 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e73b9-d47b-4208-8304-5a63ba481016 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:39.867827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0e73b9-d47b-4208-8304-5a63ba481016 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:39.868445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e73b9-d47b-4208-8304-5a63ba481016 None admin] RBAC: Adding query filter params (name=image) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:39.868750 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e73b9-d47b-4208-8304-5a63ba481016 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:39.870168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef0e73b9-d47b-4208-8304-5a63ba481016 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:39.871434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:39.877943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 503/1005] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:39.882514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e73b9-d47b-4208-8304-5a63ba481016 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:39.962295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:39.973493 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c44c704-e22c-4c2b-95a1-ee336849fea8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:39.989121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0e73b9-d47b-4208-8304-5a63ba481016 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:40.010924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e639b8-5ad6-4f34-940a-f53d7ea2070e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:40.011549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e639b8-5ad6-4f34-940a-f53d7ea2070e None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:40.011820 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e639b8-5ad6-4f34-940a-f53d7ea2070e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:40.012085 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e639b8-5ad6-4f34-940a-f53d7ea2070e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:40.012747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e639b8-5ad6-4f34-940a-f53d7ea2070e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:40.014368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e639b8-5ad6-4f34-940a-f53d7ea2070e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:40.025366 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c448c044-26fe-45e0-b40a-827cf8050da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:40.026144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448c044-26fe-45e0-b40a-827cf8050da5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:40.026497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448c044-26fe-45e0-b40a-827cf8050da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:40.026836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448c044-26fe-45e0-b40a-827cf8050da5 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:40.027592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448c044-26fe-45e0-b40a-827cf8050da5 None admin] RBAC: Adding query filter params (type=image) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:40.028037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448c044-26fe-45e0-b40a-827cf8050da5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:40.029678 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c448c044-26fe-45e0-b40a-827cf8050da5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:40.045898 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 504/1006] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:39 2022] GET /identity/v3/services?type=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:40.046147 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 503/1007] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:05:39 2022] POST /identity/v3/endpoints => generated 325 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:05:41.689728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5183c6-1dbb-4a14-ae62-e2df6d15052b None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:41.690851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5183c6-1dbb-4a14-ae62-e2df6d15052b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:41.691306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5183c6-1dbb-4a14-ae62-e2df6d15052b None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:41.692815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 505/1008] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:41.698751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bae8f7-bdab-489d-8e1a-d789a6e10ae1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:41.699612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bae8f7-bdab-489d-8e1a-d789a6e10ae1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:41.700061 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bae8f7-bdab-489d-8e1a-d789a6e10ae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:41.720537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-20bae8f7-bdab-489d-8e1a-d789a6e10ae1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:41.722557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-20bae8f7-bdab-489d-8e1a-d789a6e10ae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:41.805457 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 504/1009] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:41 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:42.070427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5183c6-1dbb-4a14-ae62-e2df6d15052b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:42.146861 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:42.188541 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5183c6-1dbb-4a14-ae62-e2df6d15052b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:42.215538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc21ff9-5e9e-4582-a9c7-af1bf63ba822 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:42.215915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc21ff9-5e9e-4582-a9c7-af1bf63ba822 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:42.216255 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc21ff9-5e9e-4582-a9c7-af1bf63ba822 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:42.217732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 505/1010] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:42.223397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cc61d-e31d-4f35-9e8d-564eb52b688b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:42.223676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cc61d-e31d-4f35-9e8d-564eb52b688b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:42.223948 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413cc61d-e31d-4f35-9e8d-564eb52b688b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:42.232442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a371adc5-8f4b-4bed-83fc-49b9cdb31cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:42.233095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371adc5-8f4b-4bed-83fc-49b9cdb31cdc None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:42.233378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371adc5-8f4b-4bed-83fc-49b9cdb31cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:42.233652 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a371adc5-8f4b-4bed-83fc-49b9cdb31cdc None admin] PATH_INFO: `/v3/services/compute` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:42.234280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371adc5-8f4b-4bed-83fc-49b9cdb31cdc None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:42.235657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a371adc5-8f4b-4bed-83fc-49b9cdb31cdc None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:42.242029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-413cc61d-e31d-4f35-9e8d-564eb52b688b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:42.243228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-413cc61d-e31d-4f35-9e8d-564eb52b688b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-a371adc5-8f4b-4bed-83fc-49b9cdb31cdc None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:42.245038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:42.246259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:42.247568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 506/1011] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:42 2022] GET /identity/v3/services/compute => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:42.248363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2a9a8-d6a3-4714-a85a-ccd3d2ee2688 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:42.248363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2a9a8-d6a3-4714-a85a-ccd3d2ee2688 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:42.248494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af2a9a8-d6a3-4714-a85a-ccd3d2ee2688 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:42.249652 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 507/1012] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:42.252021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2a9a8-d6a3-4714-a85a-ccd3d2ee2688 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:42.322124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 506/1013] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:42.323388 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7b8aa-df98-4f34-bdd3-97300a28f898 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:42.323673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7b8aa-df98-4f34-bdd3-97300a28f898 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:42.323944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7b8aa-df98-4f34-bdd3-97300a28f898 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:42.335867 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:42.342666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fdb7b8aa-df98-4f34-bdd3-97300a28f898 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:42.345133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fdb7b8aa-df98-4f34-bdd3-97300a28f898 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:42.369254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af2a9a8-d6a3-4714-a85a-ccd3d2ee2688 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:42.398722 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:42.407855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6224c9a-17b7-440e-81af-09c5d0d86deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:42.408491 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6224c9a-17b7-440e-81af-09c5d0d86deb None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:42.408888 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6224c9a-17b7-440e-81af-09c5d0d86deb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:42.409261 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6224c9a-17b7-440e-81af-09c5d0d86deb None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:42.410006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6224c9a-17b7-440e-81af-09c5d0d86deb None admin] RBAC: Adding query filter params (name=compute) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:42.410313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6224c9a-17b7-440e-81af-09c5d0d86deb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:42.411678 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6224c9a-17b7-440e-81af-09c5d0d86deb None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:42.416799 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 508/1014] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 19:05:42 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:42.422299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6224c9a-17b7-440e-81af-09c5d0d86deb None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:42.423377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 507/1015] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:42 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:42.525526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6224c9a-17b7-440e-81af-09c5d0d86deb None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:42.560180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67030896-b200-4138-baf7-c40f77e423ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:42.560783 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67030896-b200-4138-baf7-c40f77e423ba None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:42.561053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67030896-b200-4138-baf7-c40f77e423ba None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:42.561316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67030896-b200-4138-baf7-c40f77e423ba None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:42.561968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67030896-b200-4138-baf7-c40f77e423ba None admin] RBAC: Adding query filter params (type=compute) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:42.562266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67030896-b200-4138-baf7-c40f77e423ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:42.563633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67030896-b200-4138-baf7-c40f77e423ba None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:42.569410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 509/1016] 10.222.0.25 () {56 vars in 1112 bytes} [Thu Sep 15 19:05:42 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:42.575083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7b8aa-df98-4f34-bdd3-97300a28f898 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:42.588198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67030896-b200-4138-baf7-c40f77e423ba None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:42.644445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:42.694369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67030896-b200-4138-baf7-c40f77e423ba None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:42.695048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7b8aa-df98-4f34-bdd3-97300a28f898 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:42.730091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec379e0-6f26-479c-9ee2-1f41f5f7641a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:42.730325 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16ed17-78da-4cfd-a096-4e9942119e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:42.730778 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec379e0-6f26-479c-9ee2-1f41f5f7641a None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:42.730927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16ed17-78da-4cfd-a096-4e9942119e05 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:42.731015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec379e0-6f26-479c-9ee2-1f41f5f7641a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:42.731097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16ed17-78da-4cfd-a096-4e9942119e05 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:42.731221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec379e0-6f26-479c-9ee2-1f41f5f7641a None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:42.731378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c16ed17-78da-4cfd-a096-4e9942119e05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:42.731871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec379e0-6f26-479c-9ee2-1f41f5f7641a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:42.732023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16ed17-78da-4cfd-a096-4e9942119e05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:42.733239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec379e0-6f26-479c-9ee2-1f41f5f7641a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:42.733379 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c16ed17-78da-4cfd-a096-4e9942119e05 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:42.739170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:42.751580 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 510/1017] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:05:42 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:05:42.752465 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec379e0-6f26-479c-9ee2-1f41f5f7641a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:42.763294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 508/1018] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:05:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:05:42.900716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec379e0-6f26-479c-9ee2-1f41f5f7641a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:42.914742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:42.954483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd86f3b6-42c0-4802-a1f1-42846cd823e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:42.955143 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86f3b6-42c0-4802-a1f1-42846cd823e5 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:42.955420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86f3b6-42c0-4802-a1f1-42846cd823e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:42.955943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd86f3b6-42c0-4802-a1f1-42846cd823e5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:42.957172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86f3b6-42c0-4802-a1f1-42846cd823e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:42.958670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd86f3b6-42c0-4802-a1f1-42846cd823e5 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:42.960490 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 511/1019] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:42.966463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16ed17-78da-4cfd-a096-4e9942119e05 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:43.075961 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c16ed17-78da-4cfd-a096-4e9942119e05 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:43.113445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a5bb3a-b315-4dcc-8040-75a95dc59bca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:43.114096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5bb3a-b315-4dcc-8040-75a95dc59bca None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:43.114372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5bb3a-b315-4dcc-8040-75a95dc59bca None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:43.114645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a5bb3a-b315-4dcc-8040-75a95dc59bca None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:43.115302 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5bb3a-b315-4dcc-8040-75a95dc59bca None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:43.116742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a5bb3a-b315-4dcc-8040-75a95dc59bca None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:43.147616 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 509/1020] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:05:42 2022] POST /identity/v3/projects => generated 311 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:05:44.947747 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7183d-bef4-4828-8630-57a28c6280d1 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:44.948358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7183d-bef4-4828-8630-57a28c6280d1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:44.948358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b7183d-bef4-4828-8630-57a28c6280d1 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:44.949868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 512/1021] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:44.955896 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6ee5f-4d62-41d9-a509-7f2d209c9cc1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:44.956446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6ee5f-4d62-41d9-a509-7f2d209c9cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:44.956683 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa6ee5f-4d62-41d9-a509-7f2d209c9cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:44.977125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-baa6ee5f-4d62-41d9-a509-7f2d209c9cc1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:44.978418 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-baa6ee5f-4d62-41d9-a509-7f2d209c9cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:45.029197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:45.058187 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 510/1022] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:45.087016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a7689-2d55-495b-bac5-1c3c6e79f2bf None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:45.087252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a7689-2d55-495b-bac5-1c3c6e79f2bf None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:45.087560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826a7689-2d55-495b-bac5-1c3c6e79f2bf None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:45.089078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 513/1023] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:05:45.094300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ce4c1-f2fe-451f-b0ed-6124c0f77786 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:45.094603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ce4c1-f2fe-451f-b0ed-6124c0f77786 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:45.094850 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642ce4c1-f2fe-451f-b0ed-6124c0f77786 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:45.114147 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-642ce4c1-f2fe-451f-b0ed-6124c0f77786 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:45.115310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-642ce4c1-f2fe-451f-b0ed-6124c0f77786 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:45.185828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 511/1024] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:45.324349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a7689-2d55-495b-bac5-1c3c6e79f2bf None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:45.417329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1a42e-c94c-4bcc-a1b9-1426ce2330be None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:45.417689 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1a42e-c94c-4bcc-a1b9-1426ce2330be None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:45.417925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a1a42e-c94c-4bcc-a1b9-1426ce2330be None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:45.419268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 512/1025] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:45.424373 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411f16e-c7bf-41ea-b882-ebe110801939 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:45.425428 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411f16e-c7bf-41ea-b882-ebe110801939 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:45.425713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d411f16e-c7bf-41ea-b882-ebe110801939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:45.439208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826a7689-2d55-495b-bac5-1c3c6e79f2bf None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:45.444604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d411f16e-c7bf-41ea-b882-ebe110801939 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:45.445838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d411f16e-c7bf-41ea-b882-ebe110801939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:45.477552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f738835-0859-4e52-849b-62d5a486878f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:45.478212 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738835-0859-4e52-849b-62d5a486878f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:45.478487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738835-0859-4e52-849b-62d5a486878f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:45.478764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f738835-0859-4e52-849b-62d5a486878f None admin] PATH_INFO: `/v3/services/image` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:45.479357 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f738835-0859-4e52-849b-62d5a486878f None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:45.480736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f738835-0859-4e52-849b-62d5a486878f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-8f738835-0859-4e52-849b-62d5a486878f None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:45.489889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:45.491161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:45.492075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 514/1026] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Sep 15 19:05:45 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:45.492950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f738835-0859-4e52-849b-62d5a486878f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:45.523097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 513/1027] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:05:45.523780 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411f16e-c7bf-41ea-b882-ebe110801939 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:45.539976 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:45.560769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:45.611877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f738835-0859-4e52-849b-62d5a486878f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:45.641521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d411f16e-c7bf-41ea-b882-ebe110801939 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:45.651372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5a8ae-d73f-4216-b0b4-66b7b87e9a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:45.652018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5a8ae-d73f-4216-b0b4-66b7b87e9a4a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:45.652284 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5a8ae-d73f-4216-b0b4-66b7b87e9a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:45.652554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e5a8ae-d73f-4216-b0b4-66b7b87e9a4a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:45.663646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e5a8ae-d73f-4216-b0b4-66b7b87e9a4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-f1e5a8ae-d73f-4216-b0b4-66b7b87e9a4a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:45.669001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:45.670018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:45.670909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:45.670909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:45.670909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:45.670909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:45.670909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:45.670909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:45.670909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:45.670909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:45.670909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:45.670909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:45.670909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 19:05:45.670909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:45.670909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 515/1028] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 15 19:05:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:45.676393 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5a8ae-d73f-4216-b0b4-66b7b87e9a4a None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:45.681810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07c09c-4f24-46f5-95e6-ed1f0f175341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:45.682442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07c09c-4f24-46f5-95e6-ed1f0f175341 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:45.682714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07c09c-4f24-46f5-95e6-ed1f0f175341 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:45.682978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07c09c-4f24-46f5-95e6-ed1f0f175341 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:45.683609 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07c09c-4f24-46f5-95e6-ed1f0f175341 None admin] RBAC: Adding query filter params (name=image) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:45.683906 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07c09c-4f24-46f5-95e6-ed1f0f175341 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:45.685707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07c09c-4f24-46f5-95e6-ed1f0f175341 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:45.696771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 514/1029] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:45.697457 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07c09c-4f24-46f5-95e6-ed1f0f175341 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:45.779697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:45.784535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e5a8ae-d73f-4216-b0b4-66b7b87e9a4a None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:45.800668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:45.804761 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07c09c-4f24-46f5-95e6-ed1f0f175341 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:45.820640 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d42218-d39a-46e3-af98-59d6a8448810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:45.821179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d42218-d39a-46e3-af98-59d6a8448810 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:45.821455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d42218-d39a-46e3-af98-59d6a8448810 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:45.821723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d42218-d39a-46e3-af98-59d6a8448810 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:45.822420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d42218-d39a-46e3-af98-59d6a8448810 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:45.822723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d42218-d39a-46e3-af98-59d6a8448810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:45.824106 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d42218-d39a-46e3-af98-59d6a8448810 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:45.832640 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 516/1030] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 19:05:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:45.833452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d42218-d39a-46e3-af98-59d6a8448810 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:45.842008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb8c55-a986-4cfb-86af-a20ecc648639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:45.842633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb8c55-a986-4cfb-86af-a20ecc648639 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:45.842903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb8c55-a986-4cfb-86af-a20ecc648639 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:45.843230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8acb8c55-a986-4cfb-86af-a20ecc648639 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:45.843864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb8c55-a986-4cfb-86af-a20ecc648639 None admin] RBAC: Adding query filter params (type=image) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:45.844161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb8c55-a986-4cfb-86af-a20ecc648639 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:45.845525 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8acb8c55-a986-4cfb-86af-a20ecc648639 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:45.851258 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 515/1031] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:45.851913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb8c55-a986-4cfb-86af-a20ecc648639 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:45.943108 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d42218-d39a-46e3-af98-59d6a8448810 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:45.966168 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8acb8c55-a986-4cfb-86af-a20ecc648639 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:45.977401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f1e3d-b13f-4ecb-a7af-b7a0f8d0c1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:45.978145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f1e3d-b13f-4ecb-a7af-b7a0f8d0c1c0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:45.978422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f1e3d-b13f-4ecb-a7af-b7a0f8d0c1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:45.978689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f1e3d-b13f-4ecb-a7af-b7a0f8d0c1c0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:45.979792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f1e3d-b13f-4ecb-a7af-b7a0f8d0c1c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:45.981233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f1e3d-b13f-4ecb-a7af-b7a0f8d0c1c0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:45.982846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 517/1032] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:45.983606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f1e3d-b13f-4ecb-a7af-b7a0f8d0c1c0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:46.004715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0dbe9-99ce-4906-b008-8d0741e44de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:46.005376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0dbe9-99ce-4906-b008-8d0741e44de1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:46.005637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0dbe9-99ce-4906-b008-8d0741e44de1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:46.005922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc0dbe9-99ce-4906-b008-8d0741e44de1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:46.011381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:46.016165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0dbe9-99ce-4906-b008-8d0741e44de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:46.017598 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc0dbe9-99ce-4906-b008-8d0741e44de1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-7bc0dbe9-99ce-4906-b008-8d0741e44de1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:46.032132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:46.033162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:46.034474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:46.034474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:46.034474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:46.034474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 516/1033] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:46.034474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0dbe9-99ce-4906-b008-8d0741e44de1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:46.053974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:46.090114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f1e3d-b13f-4ecb-a7af-b7a0f8d0c1c0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:46.123324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb93016-814f-4899-9b3d-a5977e194640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:46.123930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb93016-814f-4899-9b3d-a5977e194640 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:46.124202 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb93016-814f-4899-9b3d-a5977e194640 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:46.124467 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb93016-814f-4899-9b3d-a5977e194640 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:46.125163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb93016-814f-4899-9b3d-a5977e194640 None admin] RBAC: Adding query filter params (interface=public, service_id=dd6c2a114647477491b27f21aac351df, region_id=RegionOne) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:46.125464 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb93016-814f-4899-9b3d-a5977e194640 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:46.126849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb93016-814f-4899-9b3d-a5977e194640 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:46.131853 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 518/1034] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 19:05:45 2022] GET /identity/v3/endpoints?service_id=dd6c2a114647477491b27f21aac351df&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:46.132643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb93016-814f-4899-9b3d-a5977e194640 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:46.143774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc0dbe9-99ce-4906-b008-8d0741e44de1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:46.179625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8976558-5f99-40ba-bb9c-2379ae7ba4f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:46.180254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8976558-5f99-40ba-bb9c-2379ae7ba4f3 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:46.180537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8976558-5f99-40ba-bb9c-2379ae7ba4f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:46.180808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8976558-5f99-40ba-bb9c-2379ae7ba4f3 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:46.181463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8976558-5f99-40ba-bb9c-2379ae7ba4f3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:46.182967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8976558-5f99-40ba-bb9c-2379ae7ba4f3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:46.206067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 517/1035] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:05:46 2022] POST /identity/v3/users => generated 285 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:05:46.206960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8976558-5f99-40ba-bb9c-2379ae7ba4f3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:46.232830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:46.244826 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb93016-814f-4899-9b3d-a5977e194640 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:46.289333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f44913-0ac2-4f0f-8bf2-963d3f8ac524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:46.290605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f44913-0ac2-4f0f-8bf2-963d3f8ac524 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:46.290966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f44913-0ac2-4f0f-8bf2-963d3f8ac524 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:46.291248 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f44913-0ac2-4f0f-8bf2-963d3f8ac524 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:46.291935 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f44913-0ac2-4f0f-8bf2-963d3f8ac524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:46.292233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f44913-0ac2-4f0f-8bf2-963d3f8ac524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:46.293817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f44913-0ac2-4f0f-8bf2-963d3f8ac524 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:46.301516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:46.309930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 519/1036] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:46.316411 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f44913-0ac2-4f0f-8bf2-963d3f8ac524 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:46.341134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8976558-5f99-40ba-bb9c-2379ae7ba4f3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:46.383069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c59345-4b68-4fcf-bd2d-ba7b3339cbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:46.384041 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c59345-4b68-4fcf-bd2d-ba7b3339cbc1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:46.384318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c59345-4b68-4fcf-bd2d-ba7b3339cbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:46.384580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c59345-4b68-4fcf-bd2d-ba7b3339cbc1 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:46.385203 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c59345-4b68-4fcf-bd2d-ba7b3339cbc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:46.386637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c59345-4b68-4fcf-bd2d-ba7b3339cbc1 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:46.393597 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 518/1037] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 19:05:46 2022] GET /identity/v3/services => generated 1957 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:05:46.430228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f44913-0ac2-4f0f-8bf2-963d3f8ac524 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:46.475484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc38d4-e426-40bd-8ebe-9e93f8165e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:46.476146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc38d4-e426-40bd-8ebe-9e93f8165e58 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:46.476417 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc38d4-e426-40bd-8ebe-9e93f8165e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:46.476681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0bc38d4-e426-40bd-8ebe-9e93f8165e58 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:46.485247 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc38d4-e426-40bd-8ebe-9e93f8165e58 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:46.486901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0bc38d4-e426-40bd-8ebe-9e93f8165e58 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-b0bc38d4-e426-40bd-8ebe-9e93f8165e58 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:46.500808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:46.501978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:46.504023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:46.504023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:46.504023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:46.504023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:46.504023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:46.504023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:46.504023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:46.504023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:46.504023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:05:46.504023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:46.504023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 520/1038] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 19:05:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:46.508490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c59345-4b68-4fcf-bd2d-ba7b3339cbc1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:46.624245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c59345-4b68-4fcf-bd2d-ba7b3339cbc1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:46.659663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ee6c4-c1f4-49c1-bc4b-18c553195bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:46.660292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ee6c4-c1f4-49c1-bc4b-18c553195bb5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:46.660567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ee6c4-c1f4-49c1-bc4b-18c553195bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:46.660835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304ee6c4-c1f4-49c1-bc4b-18c553195bb5 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:46.661571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ee6c4-c1f4-49c1-bc4b-18c553195bb5 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:46.661912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ee6c4-c1f4-49c1-bc4b-18c553195bb5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:46.663348 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304ee6c4-c1f4-49c1-bc4b-18c553195bb5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:46.665109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:46.685282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 519/1039] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 19:05:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:46.693136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc38d4-e426-40bd-8ebe-9e93f8165e58 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:46.714216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:46.806731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0bc38d4-e426-40bd-8ebe-9e93f8165e58 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:46.843168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475879eb-eacb-4068-ab2f-1b153d76b08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:46.843783 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475879eb-eacb-4068-ab2f-1b153d76b08f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:46.844056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475879eb-eacb-4068-ab2f-1b153d76b08f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:46.844318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475879eb-eacb-4068-ab2f-1b153d76b08f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:46.914821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475879eb-eacb-4068-ab2f-1b153d76b08f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:46.916204 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475879eb-eacb-4068-ab2f-1b153d76b08f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:46.932391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:47.020950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 521/1040] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:05:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:05:47.026624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ee6c4-c1f4-49c1-bc4b-18c553195bb5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:47.127333 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304ee6c4-c1f4-49c1-bc4b-18c553195bb5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:47.162291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43773cee-b619-4d0c-a933-d62bcf550dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:47.162930 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43773cee-b619-4d0c-a933-d62bcf550dff None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:47.163202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43773cee-b619-4d0c-a933-d62bcf550dff None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:47.163466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43773cee-b619-4d0c-a933-d62bcf550dff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:47.173937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43773cee-b619-4d0c-a933-d62bcf550dff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:47.175612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43773cee-b619-4d0c-a933-d62bcf550dff None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-43773cee-b619-4d0c-a933-d62bcf550dff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:47.190177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:47.191148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:47.192039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:47.192039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:47.192039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:47.194134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 520/1041] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:47.197006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475879eb-eacb-4068-ab2f-1b153d76b08f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:47.313002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475879eb-eacb-4068-ab2f-1b153d76b08f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:47.328653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:47.354691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f9788-8f64-4f02-828c-4ae3a00e5c2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:47.355640 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9788-8f64-4f02-828c-4ae3a00e5c2f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:47.356067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9788-8f64-4f02-828c-4ae3a00e5c2f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:47.356470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3f9788-8f64-4f02-828c-4ae3a00e5c2f None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:47.357260 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f9788-8f64-4f02-828c-4ae3a00e5c2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:47.357907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f9788-8f64-4f02-828c-4ae3a00e5c2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:47.359409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3f9788-8f64-4f02-828c-4ae3a00e5c2f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:47.371702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 522/1042] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:47.377162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43773cee-b619-4d0c-a933-d62bcf550dff None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:47.424351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:47.481458 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43773cee-b619-4d0c-a933-d62bcf550dff None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:47.515040 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b146e7d-3b97-4033-a079-c24cba043154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:47.515670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b146e7d-3b97-4033-a079-c24cba043154 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:47.515944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b146e7d-3b97-4033-a079-c24cba043154 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:47.516212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b146e7d-3b97-4033-a079-c24cba043154 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:47.522886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b146e7d-3b97-4033-a079-c24cba043154 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:47.524317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b146e7d-3b97-4033-a079-c24cba043154 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-2b146e7d-3b97-4033-a079-c24cba043154 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:47.535607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:47.536511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:47.542455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:47.542455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:47.542455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:47.542455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:47.542455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:47.542455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:47.542455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:47.542455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:47.542455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 521/1043] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:47.542975 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f9788-8f64-4f02-828c-4ae3a00e5c2f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:47.649252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3f9788-8f64-4f02-828c-4ae3a00e5c2f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:47.683721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42778bef-6faa-4032-8063-3bb1c0ac0301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:47.684324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42778bef-6faa-4032-8063-3bb1c0ac0301 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:47.684601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42778bef-6faa-4032-8063-3bb1c0ac0301 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:47.684868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42778bef-6faa-4032-8063-3bb1c0ac0301 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:47.685556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42778bef-6faa-4032-8063-3bb1c0ac0301 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:47.685896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42778bef-6faa-4032-8063-3bb1c0ac0301 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:47.687444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42778bef-6faa-4032-8063-3bb1c0ac0301 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:47.700085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 523/1044] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:47.706174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b146e7d-3b97-4033-a079-c24cba043154 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:47.806095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b146e7d-3b97-4033-a079-c24cba043154 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:47.808407 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:47.841387 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0280a0-7c12-485d-842c-155cd1844b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:47.842025 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0280a0-7c12-485d-842c-155cd1844b67 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:47.842301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0280a0-7c12-485d-842c-155cd1844b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:47.842564 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0280a0-7c12-485d-842c-155cd1844b67 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:47.843285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0280a0-7c12-485d-842c-155cd1844b67 None admin] RBAC: Adding query filter params (role.id=88cd6fa74eaa4bf48cec363a02236cf4, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=38b19e4add2a4321a2fbfeb9a3a1b61d) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:47.843590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0280a0-7c12-485d-842c-155cd1844b67 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:47.845006 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0280a0-7c12-485d-842c-155cd1844b67 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:47.851256 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 522/1045] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:05:47 2022] GET /identity/v3/role_assignments?user.id=38b19e4add2a4321a2fbfeb9a3a1b61d&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=88cd6fa74eaa4bf48cec363a02236cf4 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:48.510238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aec81b-ce25-4aff-9179-5577ad3faac7 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:48.510765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aec81b-ce25-4aff-9179-5577ad3faac7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:48.510765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94aec81b-ce25-4aff-9179-5577ad3faac7 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:48.512192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 524/1046] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:48.517836 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5d358-d588-423d-a439-3161d5384b5a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:48.518394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5d358-d588-423d-a439-3161d5384b5a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:48.518394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5d358-d588-423d-a439-3161d5384b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:48.538742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ecc5d358-d588-423d-a439-3161d5384b5a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:48.539996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ecc5d358-d588-423d-a439-3161d5384b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:48.615925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 523/1047] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:48.661849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99011d-d732-4ab1-b001-c4b9a76b5b4d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:48.662218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99011d-d732-4ab1-b001-c4b9a76b5b4d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:48.662470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99011d-d732-4ab1-b001-c4b9a76b5b4d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:48.664008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 525/1048] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:48.669801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb3045-7cff-4d6a-97d7-812f3e2df8ed None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:48.670061 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb3045-7cff-4d6a-97d7-812f3e2df8ed None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:48.670365 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecb3045-7cff-4d6a-97d7-812f3e2df8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:48.692765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7ecb3045-7cff-4d6a-97d7-812f3e2df8ed None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:48.694004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7ecb3045-7cff-4d6a-97d7-812f3e2df8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:48.769152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 524/1049] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:48.885094 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99011d-d732-4ab1-b001-c4b9a76b5b4d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:48.917320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:48.993683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99011d-d732-4ab1-b001-c4b9a76b5b4d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:49.028714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0063786-36d6-422c-a0ee-c461831be781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:49.029355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063786-36d6-422c-a0ee-c461831be781 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:49.029631 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063786-36d6-422c-a0ee-c461831be781 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:49.029932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0063786-36d6-422c-a0ee-c461831be781 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:49.041061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0063786-36d6-422c-a0ee-c461831be781 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:49.044204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb3045-7cff-4d6a-97d7-812f3e2df8ed None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-d0063786-36d6-422c-a0ee-c461831be781 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:49.046057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:49.047004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:49.047904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:49.047904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:49.047904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:49.047904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:49.047904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:49.047904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:49.047904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:49.047904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:49.047904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:49.047904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:49.047904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:49.047904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:49.047904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 526/1050] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:05:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:49.053546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0063786-36d6-422c-a0ee-c461831be781 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:49.079545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:49.157699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:49.160491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecb3045-7cff-4d6a-97d7-812f3e2df8ed None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:49.167575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0063786-36d6-422c-a0ee-c461831be781 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:49.199751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e3d6d-c25f-45ad-aea2-2c8b6eac5265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:49.200397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e3d6d-c25f-45ad-aea2-2c8b6eac5265 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:49.200673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e3d6d-c25f-45ad-aea2-2c8b6eac5265 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:49.200956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71e3d6d-c25f-45ad-aea2-2c8b6eac5265 None admin] PATH_INFO: `/v3/services/image` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:49.201534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e3d6d-c25f-45ad-aea2-2c8b6eac5265 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:49.202937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71e3d6d-c25f-45ad-aea2-2c8b6eac5265 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:49.205566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2bb7d-1c75-4d71-9bd7-e748f91c18cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:49.206454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2bb7d-1c75-4d71-9bd7-e748f91c18cb None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:49.206740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2bb7d-1c75-4d71-9bd7-e748f91c18cb None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:49.207034 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f2bb7d-1c75-4d71-9bd7-e748f91c18cb None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:49.207659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2bb7d-1c75-4d71-9bd7-e748f91c18cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:49.207956 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2bb7d-1c75-4d71-9bd7-e748f91c18cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:49.209323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f2bb7d-1c75-4d71-9bd7-e748f91c18cb None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c71e3d6d-c25f-45ad-aea2-2c8b6eac5265 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:49.212621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:49.213590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:49.214475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 525/1051] 10.222.0.25 () {56 vars in 1105 bytes} [Thu Sep 15 19:05:49 2022] GET /identity/v3/services/image => generated 86 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:49.219646 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e3d6d-c25f-45ad-aea2-2c8b6eac5265 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:49.223842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 527/1052] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:05:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:49.229987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2bb7d-1c75-4d71-9bd7-e748f91c18cb None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:49.333239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:49.344189 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71e3d6d-c25f-45ad-aea2-2c8b6eac5265 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:49.347422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f2bb7d-1c75-4d71-9bd7-e748f91c18cb None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:49.378785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459874b7-1597-400b-b40a-bc797bac9e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:49.379399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459874b7-1597-400b-b40a-bc797bac9e1a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:49.379673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459874b7-1597-400b-b40a-bc797bac9e1a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:49.379994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459874b7-1597-400b-b40a-bc797bac9e1a None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:49.380566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459874b7-1597-400b-b40a-bc797bac9e1a None admin] RBAC: Adding query filter params (name=image) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:49.380852 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459874b7-1597-400b-b40a-bc797bac9e1a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:49.381191 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b97447-a7af-4cb9-be3d-85faa298057c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:49.381861 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b97447-a7af-4cb9-be3d-85faa298057c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:49.382143 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b97447-a7af-4cb9-be3d-85faa298057c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:49.382245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459874b7-1597-400b-b40a-bc797bac9e1a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:49.382412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b97447-a7af-4cb9-be3d-85faa298057c None admin] PATH_INFO: `/v3/users/7d08380324f04ad19803cb2335e00c72` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:49.392421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 526/1053] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:49 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:49.393477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459874b7-1597-400b-b40a-bc797bac9e1a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:49.400487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b97447-a7af-4cb9-be3d-85faa298057c None admin] RBAC: Authorizing `identity:get_user(user_id=7d08380324f04ad19803cb2335e00c72)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:49.402017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b97447-a7af-4cb9-be3d-85faa298057c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:49.403775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 528/1054] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:05:49 2022] GET /identity/v3/users/7d08380324f04ad19803cb2335e00c72 => generated 285 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:49.410258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b97447-a7af-4cb9-be3d-85faa298057c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:49.428886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:49.513836 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459874b7-1597-400b-b40a-bc797bac9e1a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:49.523978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b97447-a7af-4cb9-be3d-85faa298057c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:49.556366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f821e-1049-4832-bf65-ff16493bcfbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:49.557901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f821e-1049-4832-bf65-ff16493bcfbb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:49.558456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f821e-1049-4832-bf65-ff16493bcfbb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:49.558822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55f821e-1049-4832-bf65-ff16493bcfbb None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:49.559529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f821e-1049-4832-bf65-ff16493bcfbb None admin] RBAC: Adding query filter params (type=image) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:49.559833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f821e-1049-4832-bf65-ff16493bcfbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:49.561404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55f821e-1049-4832-bf65-ff16493bcfbb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:49.561751 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012fede-ebba-441d-a0ca-1f332ea9ac3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:49.562977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012fede-ebba-441d-a0ca-1f332ea9ac3b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:49.562977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012fede-ebba-441d-a0ca-1f332ea9ac3b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:49.563905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8012fede-ebba-441d-a0ca-1f332ea9ac3b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:49.567777 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 527/1055] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:49 2022] GET /identity/v3/services?type=image => generated 350 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:49.573179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f821e-1049-4832-bf65-ff16493bcfbb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:49.602473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:49.637490 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012fede-ebba-441d-a0ca-1f332ea9ac3b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:49.639241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8012fede-ebba-441d-a0ca-1f332ea9ac3b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:49.655186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:49.687587 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55f821e-1049-4832-bf65-ff16493bcfbb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:49.723421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70054d62-c8bb-4a53-8f86-b808bb1b87ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:49.724036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70054d62-c8bb-4a53-8f86-b808bb1b87ff None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:49.724311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70054d62-c8bb-4a53-8f86-b808bb1b87ff None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:49.724572 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70054d62-c8bb-4a53-8f86-b808bb1b87ff None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:49.725240 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70054d62-c8bb-4a53-8f86-b808bb1b87ff None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:49.726635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70054d62-c8bb-4a53-8f86-b808bb1b87ff None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:49.761815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 528/1056] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:05:49 2022] POST /identity/v3/endpoints => generated 327 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:05:49.775811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 529/1057] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:05:49 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 19:05:49.782040 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70054d62-c8bb-4a53-8f86-b808bb1b87ff None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:49.869053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:49.901707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70054d62-c8bb-4a53-8f86-b808bb1b87ff None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:49.942206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137375f6-24f8-4d35-9624-df842c3014bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:49.942777 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137375f6-24f8-4d35-9624-df842c3014bf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:49.943052 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137375f6-24f8-4d35-9624-df842c3014bf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:49.943321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137375f6-24f8-4d35-9624-df842c3014bf None admin] PATH_INFO: `/v3/projects/150966383f6a42849391b13f12bba5ea` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:49.944623 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137375f6-24f8-4d35-9624-df842c3014bf None admin] RBAC: Authorizing `identity:get_project(project_id=150966383f6a42849391b13f12bba5ea)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:49.946205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137375f6-24f8-4d35-9624-df842c3014bf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:49.948179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 529/1058] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:05:49 2022] GET /identity/v3/projects/150966383f6a42849391b13f12bba5ea => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:49.954662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012fede-ebba-441d-a0ca-1f332ea9ac3b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:50.053829 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213204-d6c0-4e92-b3f3-78ff0461436c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:50.054169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213204-d6c0-4e92-b3f3-78ff0461436c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:50.054402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef213204-d6c0-4e92-b3f3-78ff0461436c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:50.055885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 530/1059] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:05:50.060984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd9de2-6bfc-4f03-b476-ae992b352d24 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:50.061262 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd9de2-6bfc-4f03-b476-ae992b352d24 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:50.061545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd9de2-6bfc-4f03-b476-ae992b352d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:50.076370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8012fede-ebba-441d-a0ca-1f332ea9ac3b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:50.082724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-12cd9de2-6bfc-4f03-b476-ae992b352d24 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:50.084253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-12cd9de2-6bfc-4f03-b476-ae992b352d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:50.090893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:50.113193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cf128-f0ae-4b06-a8ff-039ed71be275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:50.113827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cf128-f0ae-4b06-a8ff-039ed71be275 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:50.114106 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cf128-f0ae-4b06-a8ff-039ed71be275 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:50.114372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592cf128-f0ae-4b06-a8ff-039ed71be275 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:50.115097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cf128-f0ae-4b06-a8ff-039ed71be275 None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=150966383f6a42849391b13f12bba5ea, user.id=7d08380324f04ad19803cb2335e00c72) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:50.115403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cf128-f0ae-4b06-a8ff-039ed71be275 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:50.116838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592cf128-f0ae-4b06-a8ff-039ed71be275 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:50.122549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 530/1060] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:05:49 2022] GET /identity/v3/role_assignments?user.id=7d08380324f04ad19803cb2335e00c72&scope.project.id=150966383f6a42849391b13f12bba5ea&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:50.171560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 531/1061] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:05:50.434916 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cf128-f0ae-4b06-a8ff-039ed71be275 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:50.541919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592cf128-f0ae-4b06-a8ff-039ed71be275 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:50.578730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988eed89-b1c4-43d6-8c52-68d3f440afc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:50.579292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988eed89-b1c4-43d6-8c52-68d3f440afc4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:50.579569 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988eed89-b1c4-43d6-8c52-68d3f440afc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:50.579841 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988eed89-b1c4-43d6-8c52-68d3f440afc4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:50.591751 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988eed89-b1c4-43d6-8c52-68d3f440afc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-988eed89-b1c4-43d6-8c52-68d3f440afc4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:50.597991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:50.599104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:50.600109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:50.600109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:50.600109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:50.600109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:50.600109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:50.600109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:50.600109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:50.600109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:50.600109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:50.600109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:50.600109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 19:05:50.600109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:50.604146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 531/1062] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 15 19:05:50 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:50.605353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd9de2-6bfc-4f03-b476-ae992b352d24 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:50.679269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:50.714219 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd9de2-6bfc-4f03-b476-ae992b352d24 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:50.754001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b2d2-8068-4bb4-8502-38b3082d186d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:50.754629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b2d2-8068-4bb4-8502-38b3082d186d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:50.754906 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b2d2-8068-4bb4-8502-38b3082d186d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:50.755178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438b2d2-8068-4bb4-8502-38b3082d186d None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:50.755848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438b2d2-8068-4bb4-8502-38b3082d186d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:50.756151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438b2d2-8068-4bb4-8502-38b3082d186d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:50.757533 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438b2d2-8068-4bb4-8502-38b3082d186d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:50.766616 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 532/1063] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 19:05:50 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:50.773066 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988eed89-b1c4-43d6-8c52-68d3f440afc4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:50.813637 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:50.890724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988eed89-b1c4-43d6-8c52-68d3f440afc4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:50.932674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4f3dc-bf25-4f2b-bb76-f2272d85f2b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:50.933343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4f3dc-bf25-4f2b-bb76-f2272d85f2b6 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:50.933625 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4f3dc-bf25-4f2b-bb76-f2272d85f2b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:50.933923 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4f3dc-bf25-4f2b-bb76-f2272d85f2b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:50.949540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4f3dc-bf25-4f2b-bb76-f2272d85f2b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:50.951099 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4f3dc-bf25-4f2b-bb76-f2272d85f2b6 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-bbd4f3dc-bf25-4f2b-bb76-f2272d85f2b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:50.969047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:50.971679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:50.972706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:50.972706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:50.972706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:50.972706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 532/1064] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:50.979094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b2d2-8068-4bb4-8502-38b3082d186d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:51.102181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438b2d2-8068-4bb4-8502-38b3082d186d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:51.135380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:51.143311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b5d2f-2496-4b7e-9bfb-d05ba4083c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:51.143771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b5d2f-2496-4b7e-9bfb-d05ba4083c75 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:51.144052 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b5d2f-2496-4b7e-9bfb-d05ba4083c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:51.144321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b5d2f-2496-4b7e-9bfb-d05ba4083c75 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:51.145028 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b5d2f-2496-4b7e-9bfb-d05ba4083c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:51.145270 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b5d2f-2496-4b7e-9bfb-d05ba4083c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:51.146674 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b5d2f-2496-4b7e-9bfb-d05ba4083c75 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:51.159556 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 533/1065] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:51.165152 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4f3dc-bf25-4f2b-bb76-f2272d85f2b6 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:51.265764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:51.287471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4f3dc-bf25-4f2b-bb76-f2272d85f2b6 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:51.341648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed040cd0-ce98-442e-9e21-8c09c188c5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:51.342324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed040cd0-ce98-442e-9e21-8c09c188c5aa None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:51.342602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed040cd0-ce98-442e-9e21-8c09c188c5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:51.342871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed040cd0-ce98-442e-9e21-8c09c188c5aa None admin] PATH_INFO: `/v3/users/nova` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:51.351602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed040cd0-ce98-442e-9e21-8c09c188c5aa None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:51.353082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed040cd0-ce98-442e-9e21-8c09c188c5aa None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ed040cd0-ce98-442e-9e21-8c09c188c5aa None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:51.366166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:51.367195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:51.368330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:51.368330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:51.368330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:51.368330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:51.368330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:51.368330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:51.368330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:51.368330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:51.368330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:05:51.368330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:51.368330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 533/1066] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 19:05:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:51.375695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b5d2f-2496-4b7e-9bfb-d05ba4083c75 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:51.500850 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b5d2f-2496-4b7e-9bfb-d05ba4083c75 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:51.538364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d4e5c-cc76-46d9-82da-2b14db792c61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:51.539619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d4e5c-cc76-46d9-82da-2b14db792c61 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:51.540105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d4e5c-cc76-46d9-82da-2b14db792c61 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:51.540566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1d4e5c-cc76-46d9-82da-2b14db792c61 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:51.541492 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d4e5c-cc76-46d9-82da-2b14db792c61 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:51.542031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d4e5c-cc76-46d9-82da-2b14db792c61 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:51.543714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1d4e5c-cc76-46d9-82da-2b14db792c61 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:51.563782 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 534/1067] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 19:05:51 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:51.570636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed040cd0-ce98-442e-9e21-8c09c188c5aa None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:51.693641 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed040cd0-ce98-442e-9e21-8c09c188c5aa None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:51.741385 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5f0eb-3b46-4a0f-a090-bf3ce32a397f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:51.742481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f0eb-3b46-4a0f-a090-bf3ce32a397f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:51.742967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f0eb-3b46-4a0f-a090-bf3ce32a397f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:51.743468 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f5f0eb-3b46-4a0f-a090-bf3ce32a397f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:51.755496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5f0eb-3b46-4a0f-a090-bf3ce32a397f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:51.757281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f5f0eb-3b46-4a0f-a090-bf3ce32a397f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:51.770857 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-24f5f0eb-3b46-4a0f-a090-bf3ce32a397f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:51.778276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:51.779287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:51.780327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:51.780327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:51.780327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:51.781763 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 534/1068] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:51.787704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d4e5c-cc76-46d9-82da-2b14db792c61 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:51.852443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:51.918526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1d4e5c-cc76-46d9-82da-2b14db792c61 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:51.957079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95253f1-23fc-4cae-9e45-b684bb55e86a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:51.958268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95253f1-23fc-4cae-9e45-b684bb55e86a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:51.958742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95253f1-23fc-4cae-9e45-b684bb55e86a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:51.959280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95253f1-23fc-4cae-9e45-b684bb55e86a None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:51.960124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95253f1-23fc-4cae-9e45-b684bb55e86a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:51.960619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95253f1-23fc-4cae-9e45-b684bb55e86a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:51.962215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95253f1-23fc-4cae-9e45-b684bb55e86a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:51.975683 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 535/1069] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:51.981413 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5f0eb-3b46-4a0f-a090-bf3ce32a397f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:52.007252 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcda9d-5145-4218-bf6d-a93346a8ecc6 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:52.007433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcda9d-5145-4218-bf6d-a93346a8ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:52.007702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fcda9d-5145-4218-bf6d-a93346a8ecc6 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:52.009338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 536/1070] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:05:52.014737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be90743-c554-495a-ab0e-a2caddc27068 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:52.015028 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be90743-c554-495a-ab0e-a2caddc27068 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:52.015259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be90743-c554-495a-ab0e-a2caddc27068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:52.041770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7be90743-c554-495a-ab0e-a2caddc27068 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:52.042612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7be90743-c554-495a-ab0e-a2caddc27068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:52.109721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f5f0eb-3b46-4a0f-a090-bf3ce32a397f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:52.133908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 537/1071] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:52.148798 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d60ee0-4b6d-4ad8-a74b-b9f76cdb79e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:52.149446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d60ee0-4b6d-4ad8-a74b-b9f76cdb79e7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:52.149721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d60ee0-4b6d-4ad8-a74b-b9f76cdb79e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:52.150031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d60ee0-4b6d-4ad8-a74b-b9f76cdb79e7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:52.157214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d60ee0-4b6d-4ad8-a74b-b9f76cdb79e7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:52.158965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d60ee0-4b6d-4ad8-a74b-b9f76cdb79e7 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-78d60ee0-4b6d-4ad8-a74b-b9f76cdb79e7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:52.171186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:52.172187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:52.178648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:52.178648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:52.178648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:52.178648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:52.178648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:52.178648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:52.178648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:52.178648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:52.178648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 535/1072] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:52.180388 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be90743-c554-495a-ab0e-a2caddc27068 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:52.234845 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:52.316143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be90743-c554-495a-ab0e-a2caddc27068 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:52.337430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd375-f9ac-4a42-add5-95ca51800054 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:52.337836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd375-f9ac-4a42-add5-95ca51800054 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:52.338000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20dd375-f9ac-4a42-add5-95ca51800054 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:52.339638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 536/1073] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:05:52.344603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72367432-97da-41bb-aa6c-cc145f64e58b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:52.344914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72367432-97da-41bb-aa6c-cc145f64e58b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:52.345156 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72367432-97da-41bb-aa6c-cc145f64e58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:52.357486 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3990c5-1996-4d4d-9ff0-69e49434262f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:52.357946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3990c5-1996-4d4d-9ff0-69e49434262f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:52.358205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3990c5-1996-4d4d-9ff0-69e49434262f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:52.358467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3990c5-1996-4d4d-9ff0-69e49434262f None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:52.359367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3990c5-1996-4d4d-9ff0-69e49434262f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:52.359475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3990c5-1996-4d4d-9ff0-69e49434262f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:52.360905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3990c5-1996-4d4d-9ff0-69e49434262f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:52.365880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-72367432-97da-41bb-aa6c-cc145f64e58b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:52.367101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-72367432-97da-41bb-aa6c-cc145f64e58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:52.378776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 538/1074] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:52.379978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3990c5-1996-4d4d-9ff0-69e49434262f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:52.437518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:52.451227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 537/1075] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:05:52.452524 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72367432-97da-41bb-aa6c-cc145f64e58b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:52.503096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:52.507885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3990c5-1996-4d4d-9ff0-69e49434262f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:52.550314 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764fa54-21f4-47af-adb4-ad2ca92b0904 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:52.551237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764fa54-21f4-47af-adb4-ad2ca92b0904 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:52.551516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764fa54-21f4-47af-adb4-ad2ca92b0904 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:52.552267 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f764fa54-21f4-47af-adb4-ad2ca92b0904 None admin] PATH_INFO: `/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/38b19e4add2a4321a2fbfeb9a3a1b61d/roles/88cd6fa74eaa4bf48cec363a02236cf4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:52.555076 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764fa54-21f4-47af-adb4-ad2ca92b0904 None admin] RBAC: Authorizing `identity:create_grant(project_id=2958a115e7974fc4b5c74a633fc4322c, user_id=38b19e4add2a4321a2fbfeb9a3a1b61d, role_id=88cd6fa74eaa4bf48cec363a02236cf4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:52.556641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f764fa54-21f4-47af-adb4-ad2ca92b0904 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:52.573448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72367432-97da-41bb-aa6c-cc145f64e58b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:52.574504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 539/1076] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:05:52 2022] PUT /identity/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/38b19e4add2a4321a2fbfeb9a3a1b61d/roles/88cd6fa74eaa4bf48cec363a02236cf4 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:05:52.627227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3122a-34ab-4600-8e0f-707218975e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:52.627937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3122a-34ab-4600-8e0f-707218975e2f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:52.628207 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3122a-34ab-4600-8e0f-707218975e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:52.628484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3122a-34ab-4600-8e0f-707218975e2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:52.704051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:52.718342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764fa54-21f4-47af-adb4-ad2ca92b0904 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:52.718554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3122a-34ab-4600-8e0f-707218975e2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:52.720001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3122a-34ab-4600-8e0f-707218975e2f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:52.859290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f764fa54-21f4-47af-adb4-ad2ca92b0904 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:52.866476 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 538/1077] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:05:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:05:52.873939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3122a-34ab-4600-8e0f-707218975e2f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:52.896637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61462a5e-d0cd-4106-b8d4-68649eafacd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:52.897401 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61462a5e-d0cd-4106-b8d4-68649eafacd1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:52.897663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61462a5e-d0cd-4106-b8d4-68649eafacd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:52.897962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61462a5e-d0cd-4106-b8d4-68649eafacd1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:52.914457 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61462a5e-d0cd-4106-b8d4-68649eafacd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-61462a5e-d0cd-4106-b8d4-68649eafacd1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:52.919287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:52.920369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:52.921197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:52.921197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:52.921197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:52.921197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:52.921197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:52.921197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:52.921197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:52.921197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:52.921197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:52.921197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:52.921197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:52.921197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:52.921197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 540/1078] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:05:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:52.927979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61462a5e-d0cd-4106-b8d4-68649eafacd1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:52.954782 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:52.992285 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:53.007186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3122a-34ab-4600-8e0f-707218975e2f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:53.051712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb5d84-2368-4218-9a99-73490e18b5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:53.052396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb5d84-2368-4218-9a99-73490e18b5a0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:53.052639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb5d84-2368-4218-9a99-73490e18b5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:53.052907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cb5d84-2368-4218-9a99-73490e18b5a0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:53.065821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb5d84-2368-4218-9a99-73490e18b5a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:53.067332 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cb5d84-2368-4218-9a99-73490e18b5a0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:53.068473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61462a5e-d0cd-4106-b8d4-68649eafacd1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-79cb5d84-2368-4218-9a99-73490e18b5a0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:53.085292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:53.087680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:53.088765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:53.088765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:53.088765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:53.088765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 539/1079] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:53.092995 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb5d84-2368-4218-9a99-73490e18b5a0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:53.113731 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d7e7a-51bb-4dd9-bdf0-4616a6249f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:53.114313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d7e7a-51bb-4dd9-bdf0-4616a6249f98 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:53.114566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d7e7a-51bb-4dd9-bdf0-4616a6249f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:53.114833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d7e7a-51bb-4dd9-bdf0-4616a6249f98 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:53.115500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d7e7a-51bb-4dd9-bdf0-4616a6249f98 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:53.115797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d7e7a-51bb-4dd9-bdf0-4616a6249f98 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:53.117162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d7e7a-51bb-4dd9-bdf0-4616a6249f98 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:53.134322 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 541/1080] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:05:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:53.135384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d7e7a-51bb-4dd9-bdf0-4616a6249f98 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:53.210323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cb5d84-2368-4218-9a99-73490e18b5a0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:53.230597 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:53.254735 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afaeca-72b3-472a-8776-cf861ceabafe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:53.255187 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d7e7a-51bb-4dd9-bdf0-4616a6249f98 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:53.255387 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afaeca-72b3-472a-8776-cf861ceabafe None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:53.255632 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afaeca-72b3-472a-8776-cf861ceabafe None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:53.255905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8afaeca-72b3-472a-8776-cf861ceabafe None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:53.256556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afaeca-72b3-472a-8776-cf861ceabafe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:53.256850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afaeca-72b3-472a-8776-cf861ceabafe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:53.258276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8afaeca-72b3-472a-8776-cf861ceabafe None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:53.280036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 540/1081] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:53.311532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26801e0-4d93-4629-b01e-d7bb5b6e538b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:53.313743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26801e0-4d93-4629-b01e-d7bb5b6e538b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:53.314128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26801e0-4d93-4629-b01e-d7bb5b6e538b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:53.314442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26801e0-4d93-4629-b01e-d7bb5b6e538b None admin] PATH_INFO: `/v3/users/7d08380324f04ad19803cb2335e00c72` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:53.319496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26801e0-4d93-4629-b01e-d7bb5b6e538b None admin] RBAC: Authorizing `identity:get_user(user_id=7d08380324f04ad19803cb2335e00c72)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:53.319496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26801e0-4d93-4629-b01e-d7bb5b6e538b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:53.319930 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 542/1082] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:05:53 2022] GET /identity/v3/users/7d08380324f04ad19803cb2335e00c72 => generated 285 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:53.326562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afaeca-72b3-472a-8776-cf861ceabafe None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:53.332580 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:53.469098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8afaeca-72b3-472a-8776-cf861ceabafe None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:53.511892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f325398-d5d7-4fd0-a3ec-adb4b5616633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:53.512541 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f325398-d5d7-4fd0-a3ec-adb4b5616633 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:53.512823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f325398-d5d7-4fd0-a3ec-adb4b5616633 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:53.513094 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f325398-d5d7-4fd0-a3ec-adb4b5616633 None admin] PATH_INFO: `/v3/projects/150966383f6a42849391b13f12bba5ea` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:53.514293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f325398-d5d7-4fd0-a3ec-adb4b5616633 None admin] RBAC: Authorizing `identity:get_project(project_id=150966383f6a42849391b13f12bba5ea)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:53.515740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f325398-d5d7-4fd0-a3ec-adb4b5616633 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:53.517398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 541/1083] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:05:53 2022] GET /identity/v3/projects/150966383f6a42849391b13f12bba5ea => generated 311 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:53.523888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26801e0-4d93-4629-b01e-d7bb5b6e538b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:53.655750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26801e0-4d93-4629-b01e-d7bb5b6e538b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:53.693978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21a8811-939d-48c4-aae1-4a853d1ee90c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:53.694651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a8811-939d-48c4-aae1-4a853d1ee90c None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:53.694930 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a8811-939d-48c4-aae1-4a853d1ee90c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:53.695203 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21a8811-939d-48c4-aae1-4a853d1ee90c None admin] PATH_INFO: `/v3/projects/150966383f6a42849391b13f12bba5ea/users/7d08380324f04ad19803cb2335e00c72/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:53.697105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a8811-939d-48c4-aae1-4a853d1ee90c None admin] RBAC: Authorizing `identity:create_grant(project_id=150966383f6a42849391b13f12bba5ea, user_id=7d08380324f04ad19803cb2335e00c72, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:53.698587 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21a8811-939d-48c4-aae1-4a853d1ee90c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:53.713705 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 543/1084] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:05:53 2022] PUT /identity/v3/projects/150966383f6a42849391b13f12bba5ea/users/7d08380324f04ad19803cb2335e00c72/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:05:54.802220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3368125-722c-460d-8bb4-6cede4981807 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:54.802845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3368125-722c-460d-8bb4-6cede4981807 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:54.802845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3368125-722c-460d-8bb4-6cede4981807 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:54.804117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 542/1085] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:54.809929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241b002-6829-4904-a08e-f8878e4a0e36 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:54.810444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241b002-6829-4904-a08e-f8878e4a0e36 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:54.810444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c241b002-6829-4904-a08e-f8878e4a0e36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:54.830239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c241b002-6829-4904-a08e-f8878e4a0e36 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:54.831457 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c241b002-6829-4904-a08e-f8878e4a0e36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:54.834685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:54.917120 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 544/1086] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:55.180570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3368125-722c-460d-8bb4-6cede4981807 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:55.255588 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:55.289992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3368125-722c-460d-8bb4-6cede4981807 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:55.328003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96fd9e-b3a2-49d8-a753-5681aa23fd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:55.328647 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96fd9e-b3a2-49d8-a753-5681aa23fd96 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:55.328921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96fd9e-b3a2-49d8-a753-5681aa23fd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:55.329190 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df96fd9e-b3a2-49d8-a753-5681aa23fd96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:55.340866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df96fd9e-b3a2-49d8-a753-5681aa23fd96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-df96fd9e-b3a2-49d8-a753-5681aa23fd96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:55.346122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:55.347918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:55.348929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:55.348929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:55.348929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:55.348929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:55.348929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:55.348929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:55.348929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:55.348929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:55.348929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:55.348929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:55.348929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 15 19:05:55.348929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:55.348929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 543/1087] 10.222.0.25 () {56 vars in 1120 bytes} [Thu Sep 15 19:05:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:55.353610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241b002-6829-4904-a08e-f8878e4a0e36 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:55.461300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c241b002-6829-4904-a08e-f8878e4a0e36 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:55.497153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa1736-2a98-4dfa-b35b-3202e045f861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:55.497771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa1736-2a98-4dfa-b35b-3202e045f861 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:55.498092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa1736-2a98-4dfa-b35b-3202e045f861 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:55.498358 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa1736-2a98-4dfa-b35b-3202e045f861 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:55.499026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa1736-2a98-4dfa-b35b-3202e045f861 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:55.499329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa1736-2a98-4dfa-b35b-3202e045f861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:55.500699 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fa1736-2a98-4dfa-b35b-3202e045f861 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:55.509733 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 545/1088] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 19:05:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:55.515679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96fd9e-b3a2-49d8-a753-5681aa23fd96 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:55.620406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df96fd9e-b3a2-49d8-a753-5681aa23fd96 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:55.650142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:55.657372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321575b9-741f-45a5-adbb-087036826304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:55.658041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321575b9-741f-45a5-adbb-087036826304 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:55.658452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321575b9-741f-45a5-adbb-087036826304 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:55.658918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321575b9-741f-45a5-adbb-087036826304 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:55.669614 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321575b9-741f-45a5-adbb-087036826304 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:55.671118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-321575b9-741f-45a5-adbb-087036826304 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-321575b9-741f-45a5-adbb-087036826304 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:55.687333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:55.688350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:55.689553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:55.689553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:55.689553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:55.689553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 544/1089] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:55.694780 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa1736-2a98-4dfa-b35b-3202e045f861 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:55.697795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:55.811867 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa1736-2a98-4dfa-b35b-3202e045f861 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:55.849933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5568d0c-09cf-4da3-9036-c79188a13d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:55.850575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5568d0c-09cf-4da3-9036-c79188a13d04 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:55.850853 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5568d0c-09cf-4da3-9036-c79188a13d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:55.851126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5568d0c-09cf-4da3-9036-c79188a13d04 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:55.851789 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5568d0c-09cf-4da3-9036-c79188a13d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:55.852088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5568d0c-09cf-4da3-9036-c79188a13d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:55.853471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5568d0c-09cf-4da3-9036-c79188a13d04 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:55.866378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 546/1090] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:55.872162 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321575b9-741f-45a5-adbb-087036826304 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:55.879300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a28d75-c2b5-4e3c-a993-3986cfea1f8b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:55.879532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a28d75-c2b5-4e3c-a993-3986cfea1f8b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:55.879818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a28d75-c2b5-4e3c-a993-3986cfea1f8b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:55.881158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 547/1091] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:05:55.886506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747f0bb-e393-4472-8433-10ec6759dae3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:55.886753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747f0bb-e393-4472-8433-10ec6759dae3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:55.887018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9747f0bb-e393-4472-8433-10ec6759dae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:55.905401 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9747f0bb-e393-4472-8433-10ec6759dae3 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:55.906698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9747f0bb-e393-4472-8433-10ec6759dae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:55.967735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:55.978043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-321575b9-741f-45a5-adbb-087036826304 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:55.979681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 548/1092] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:05:56.012299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722fb02-85c0-4d75-b0eb-8d535bdadf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:56.012936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722fb02-85c0-4d75-b0eb-8d535bdadf21 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:56.013212 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722fb02-85c0-4d75-b0eb-8d535bdadf21 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:56.013459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3722fb02-85c0-4d75-b0eb-8d535bdadf21 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:56.021724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722fb02-85c0-4d75-b0eb-8d535bdadf21 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:56.023205 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3722fb02-85c0-4d75-b0eb-8d535bdadf21 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-3722fb02-85c0-4d75-b0eb-8d535bdadf21 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:05:56.034644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:56.035612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:56.036556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:56.036556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:56.036556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:05:56.036556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:05:56.036556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:05:56.036556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:05:56.036556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:05:56.036556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:05:56.036556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 15 19:05:56.036556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:56.036556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 545/1093] 10.222.0.25 () {56 vars in 1093 bytes} [Thu Sep 15 19:05:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:56.041960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747f0bb-e393-4472-8433-10ec6759dae3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:56.148423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9747f0bb-e393-4472-8433-10ec6759dae3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:56.184404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31a647-6603-4b3a-8b71-8332428fe37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:56.185011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a647-6603-4b3a-8b71-8332428fe37d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:56.185288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a647-6603-4b3a-8b71-8332428fe37d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:56.185555 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b31a647-6603-4b3a-8b71-8332428fe37d None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:56.186327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31a647-6603-4b3a-8b71-8332428fe37d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:56.186632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31a647-6603-4b3a-8b71-8332428fe37d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:56.188056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b31a647-6603-4b3a-8b71-8332428fe37d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:56.205334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 549/1094] 10.222.0.25 () {56 vars in 1133 bytes} [Thu Sep 15 19:05:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:56.211694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722fb02-85c0-4d75-b0eb-8d535bdadf21 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:56.244870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31a647-6603-4b3a-8b71-8332428fe37d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:56.259801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:56.296080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:56.324195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3722fb02-85c0-4d75-b0eb-8d535bdadf21 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:56.348956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b31a647-6603-4b3a-8b71-8332428fe37d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:56.359567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bda81-11eb-46e3-b47c-2db3b45acd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:56.360186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bda81-11eb-46e3-b47c-2db3b45acd09 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:56.360464 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bda81-11eb-46e3-b47c-2db3b45acd09 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:56.360736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4bda81-11eb-46e3-b47c-2db3b45acd09 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:56.385293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885763a-4fa5-47cb-8f34-8bd0b0f03673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:56.385963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885763a-4fa5-47cb-8f34-8bd0b0f03673 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:56.386239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885763a-4fa5-47cb-8f34-8bd0b0f03673 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:56.386532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c885763a-4fa5-47cb-8f34-8bd0b0f03673 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:56.397850 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c885763a-4fa5-47cb-8f34-8bd0b0f03673 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c885763a-4fa5-47cb-8f34-8bd0b0f03673 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:05:56.402786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:56.403788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:56.404632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:56.404632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:56.404632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:56.404632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:56.404632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:05:56.404632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:05:56.404632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:05:56.404632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:05:56.404632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:05:56.404632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:05:56.404632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:05:56.404632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:56.404632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 550/1095] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:05:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:56.411081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885763a-4fa5-47cb-8f34-8bd0b0f03673 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:56.433684 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bda81-11eb-46e3-b47c-2db3b45acd09 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:56.435162 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4bda81-11eb-46e3-b47c-2db3b45acd09 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:56.481025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:56.518691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c885763a-4fa5-47cb-8f34-8bd0b0f03673 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:56.530071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:56.542315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 546/1096] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:05:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:05:56.548226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bda81-11eb-46e3-b47c-2db3b45acd09 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:56.559711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2247a02-62d3-4643-adf7-16098aa01c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:56.560332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247a02-62d3-4643-adf7-16098aa01c30 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:56.560611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247a02-62d3-4643-adf7-16098aa01c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:56.560881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2247a02-62d3-4643-adf7-16098aa01c30 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:56.561549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2247a02-62d3-4643-adf7-16098aa01c30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:56.561867 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2247a02-62d3-4643-adf7-16098aa01c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:56.563255 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2247a02-62d3-4643-adf7-16098aa01c30 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:56.571813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 551/1097] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:05:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:56.577806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2247a02-62d3-4643-adf7-16098aa01c30 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:56.652277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4bda81-11eb-46e3-b47c-2db3b45acd09 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:56.680035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2247a02-62d3-4643-adf7-16098aa01c30 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:56.690468 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d5ce9-a196-4a53-8f5c-9f4d70f2e19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:56.691120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d5ce9-a196-4a53-8f5c-9f4d70f2e19b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:56.691401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d5ce9-a196-4a53-8f5c-9f4d70f2e19b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:56.691670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88d5ce9-a196-4a53-8f5c-9f4d70f2e19b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:56.702344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d5ce9-a196-4a53-8f5c-9f4d70f2e19b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:56.703815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88d5ce9-a196-4a53-8f5c-9f4d70f2e19b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:56.706088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:56.715882 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9e55c-a6c2-456a-915b-9666c82e647d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:56.716539 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9e55c-a6c2-456a-915b-9666c82e647d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:56.716815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9e55c-a6c2-456a-915b-9666c82e647d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:56.717087 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c9e55c-a6c2-456a-915b-9666c82e647d None admin] PATH_INFO: `/v3/users/7d08380324f04ad19803cb2335e00c72` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:56.718287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9e55c-a6c2-456a-915b-9666c82e647d None admin] RBAC: Authorizing `identity:get_user(user_id=7d08380324f04ad19803cb2335e00c72)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:56.719733 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c9e55c-a6c2-456a-915b-9666c82e647d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c88d5ce9-a196-4a53-8f5c-9f4d70f2e19b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:05:56.721463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:56.722562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:05:56.723512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:05:56.723512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:05:56.723512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:05:56.723691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 552/1098] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:05:56 2022] GET /identity/v3/users/7d08380324f04ad19803cb2335e00c72 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:05:56.723763 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 547/1099] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:05:56.728363 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9e55c-a6c2-456a-915b-9666c82e647d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:56.728514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d5ce9-a196-4a53-8f5c-9f4d70f2e19b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:56.774604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:56.837072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c9e55c-a6c2-456a-915b-9666c82e647d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:56.837742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88d5ce9-a196-4a53-8f5c-9f4d70f2e19b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:56.871964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319f7cf-cf15-4e08-9335-cdae39534ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:56.872237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a8722-2524-4137-a5d6-d1aadaf127a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:56.872727 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319f7cf-cf15-4e08-9335-cdae39534ba3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:56.872818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a8722-2524-4137-a5d6-d1aadaf127a4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:56.872902 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319f7cf-cf15-4e08-9335-cdae39534ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:56.873044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a8722-2524-4137-a5d6-d1aadaf127a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:56.873139 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d319f7cf-cf15-4e08-9335-cdae39534ba3 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:56.873308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351a8722-2524-4137-a5d6-d1aadaf127a4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:56.873721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319f7cf-cf15-4e08-9335-cdae39534ba3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:56.874050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319f7cf-cf15-4e08-9335-cdae39534ba3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:56.875538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d319f7cf-cf15-4e08-9335-cdae39534ba3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:56.889540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 553/1100] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:05:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:56.896212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319f7cf-cf15-4e08-9335-cdae39534ba3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:56.937679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:56.947512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a8722-2524-4137-a5d6-d1aadaf127a4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:56.948973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351a8722-2524-4137-a5d6-d1aadaf127a4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:57.008555 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:57.011972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d319f7cf-cf15-4e08-9335-cdae39534ba3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:57.048612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26adc2-dce2-48bf-9c52-6edc4fc82575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:57.049446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26adc2-dce2-48bf-9c52-6edc4fc82575 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:57.049659 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26adc2-dce2-48bf-9c52-6edc4fc82575 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:57.049939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec26adc2-dce2-48bf-9c52-6edc4fc82575 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:57.050339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 548/1101] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:05:56 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 15 19:05:57.056179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a8722-2524-4137-a5d6-d1aadaf127a4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:57.057630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26adc2-dce2-48bf-9c52-6edc4fc82575 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:57.059078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec26adc2-dce2-48bf-9c52-6edc4fc82575 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ec26adc2-dce2-48bf-9c52-6edc4fc82575 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:05:57.070790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:05:57.071870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:05:57.072750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:05:57.072750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:05:57.072750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:05:57.072750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:05:57.072750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:05:57.072750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:05:57.072750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:05:57.072750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:05:57.072750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 554/1102] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:05:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:05:57.077692 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26adc2-dce2-48bf-9c52-6edc4fc82575 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:57.154330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:57.161754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351a8722-2524-4137-a5d6-d1aadaf127a4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:57.177345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec26adc2-dce2-48bf-9c52-6edc4fc82575 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:57.196310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2743545-fba3-4118-bb8c-6fad81d0af4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:57.196879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2743545-fba3-4118-bb8c-6fad81d0af4f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:57.197136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2743545-fba3-4118-bb8c-6fad81d0af4f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:57.197409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2743545-fba3-4118-bb8c-6fad81d0af4f None admin] PATH_INFO: `/v3/projects/150966383f6a42849391b13f12bba5ea` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:57.198560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2743545-fba3-4118-bb8c-6fad81d0af4f None admin] RBAC: Authorizing `identity:get_project(project_id=150966383f6a42849391b13f12bba5ea)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:57.199996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2743545-fba3-4118-bb8c-6fad81d0af4f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:57.201652 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 549/1103] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:05:57 2022] GET /identity/v3/projects/150966383f6a42849391b13f12bba5ea => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:57.207941 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2743545-fba3-4118-bb8c-6fad81d0af4f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:57.210628 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b347111-468a-475d-ad06-5cf9d7badb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:57.211239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b347111-468a-475d-ad06-5cf9d7badb80 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:57.211514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b347111-468a-475d-ad06-5cf9d7badb80 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:57.211778 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b347111-468a-475d-ad06-5cf9d7badb80 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:57.212472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b347111-468a-475d-ad06-5cf9d7badb80 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:57.212776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b347111-468a-475d-ad06-5cf9d7badb80 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:57.214220 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b347111-468a-475d-ad06-5cf9d7badb80 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:57.226683 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 555/1104] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:05:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:57.232838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b347111-468a-475d-ad06-5cf9d7badb80 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:57.254241 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:05:57.309109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2743545-fba3-4118-bb8c-6fad81d0af4f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:57.336654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b347111-468a-475d-ad06-5cf9d7badb80 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:05:57.352703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0294504-559a-466a-b2fb-7aef44981f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:57.353328 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294504-559a-466a-b2fb-7aef44981f16 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:57.353606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294504-559a-466a-b2fb-7aef44981f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:57.353924 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0294504-559a-466a-b2fb-7aef44981f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:57.354659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0294504-559a-466a-b2fb-7aef44981f16 None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=150966383f6a42849391b13f12bba5ea, user.id=7d08380324f04ad19803cb2335e00c72) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:57.354973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0294504-559a-466a-b2fb-7aef44981f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:57.356416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0294504-559a-466a-b2fb-7aef44981f16 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:57.362807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 550/1105] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:05:57 2022] GET /identity/v3/role_assignments?user.id=7d08380324f04ad19803cb2335e00c72&scope.project.id=150966383f6a42849391b13f12bba5ea&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:57.370577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00378a4-7fc7-4801-a128-601edfacfc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:05:57.371225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00378a4-7fc7-4801-a128-601edfacfc48 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:57.371505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00378a4-7fc7-4801-a128-601edfacfc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:57.371778 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00378a4-7fc7-4801-a128-601edfacfc48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:57.372531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00378a4-7fc7-4801-a128-601edfacfc48 None admin] RBAC: Adding query filter params (role.id=88cd6fa74eaa4bf48cec363a02236cf4, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=38b19e4add2a4321a2fbfeb9a3a1b61d) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:05:57.372846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00378a4-7fc7-4801-a128-601edfacfc48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:05:57.374477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a00378a4-7fc7-4801-a128-601edfacfc48 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:05:57.381657 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 556/1106] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:05:57 2022] GET /identity/v3/role_assignments?user.id=38b19e4add2a4321a2fbfeb9a3a1b61d&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=88cd6fa74eaa4bf48cec363a02236cf4 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:05:59.557728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623eef-9017-485b-9ebd-aa15710a1e96 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:59.558298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623eef-9017-485b-9ebd-aa15710a1e96 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:59.558298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c623eef-9017-485b-9ebd-aa15710a1e96 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:59.559571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 551/1107] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:05:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:05:59.564972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dde18b-53bb-4649-a357-00255e01dd7a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:05:59.565392 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dde18b-53bb-4649-a357-00255e01dd7a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:05:59.565481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dde18b-53bb-4649-a357-00255e01dd7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:05:59.585545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-14dde18b-53bb-4649-a357-00255e01dd7a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:05:59.587390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-14dde18b-53bb-4649-a357-00255e01dd7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:05:59.659986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 557/1108] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:05:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:05:59.930217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c623eef-9017-485b-9ebd-aa15710a1e96 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:05:59.959149 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:00.039115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c623eef-9017-485b-9ebd-aa15710a1e96 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:00.076531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74723803-ee56-4853-9053-21096c0cb307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:00.077157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74723803-ee56-4853-9053-21096c0cb307 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:00.077438 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74723803-ee56-4853-9053-21096c0cb307 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:00.077702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74723803-ee56-4853-9053-21096c0cb307 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:00.078905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74723803-ee56-4853-9053-21096c0cb307 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:00.081067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74723803-ee56-4853-9053-21096c0cb307 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:00.082703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 552/1109] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:05:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:00.088815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dde18b-53bb-4649-a357-00255e01dd7a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:00.105436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:00.191875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dde18b-53bb-4649-a357-00255e01dd7a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:00.226371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395852d8-cbd4-4939-b9ef-165b3eb10f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:00.226970 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395852d8-cbd4-4939-b9ef-165b3eb10f6c None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:00.227242 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395852d8-cbd4-4939-b9ef-165b3eb10f6c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:00.227505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395852d8-cbd4-4939-b9ef-165b3eb10f6c None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:00.228147 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395852d8-cbd4-4939-b9ef-165b3eb10f6c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:00.229556 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395852d8-cbd4-4939-b9ef-165b3eb10f6c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:00.253685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 558/1110] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:06:00 2022] POST /identity/v3/users => generated 286 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:06:02.421652 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767ab95-ed48-45a6-a19f-d3734a6db1aa None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:02.422358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767ab95-ed48-45a6-a19f-d3734a6db1aa None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:02.422358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f767ab95-ed48-45a6-a19f-d3734a6db1aa None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:02.423587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 553/1111] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:02.429368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c055a-c7b3-4b75-967f-41e63131f6ab None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:02.429819 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c055a-c7b3-4b75-967f-41e63131f6ab None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:02.429935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4c055a-c7b3-4b75-967f-41e63131f6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:02.449440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4a4c055a-c7b3-4b75-967f-41e63131f6ab None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:02.450676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4a4c055a-c7b3-4b75-967f-41e63131f6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:02.522271 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:02.528142 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 559/1112] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:06:02.801958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767ab95-ed48-45a6-a19f-d3734a6db1aa None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:02.905813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:02.915488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f767ab95-ed48-45a6-a19f-d3734a6db1aa None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:02.955391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75309ea-e1a2-4dec-a653-21040ea4116d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:02.956033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75309ea-e1a2-4dec-a653-21040ea4116d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:02.956313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75309ea-e1a2-4dec-a653-21040ea4116d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:02.956584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75309ea-e1a2-4dec-a653-21040ea4116d None admin] PATH_INFO: `/v3/roles/568edd5e60424ffaa076d1c402c72b19` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:02.958047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75309ea-e1a2-4dec-a653-21040ea4116d None admin] RBAC: Authorizing `identity:get_role(role_id=568edd5e60424ffaa076d1c402c72b19)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:02.959438 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75309ea-e1a2-4dec-a653-21040ea4116d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:02.960788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 554/1113] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:06:02 2022] GET /identity/v3/roles/568edd5e60424ffaa076d1c402c72b19 => generated 223 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:02.966880 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c055a-c7b3-4b75-967f-41e63131f6ab None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:03.071405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4c055a-c7b3-4b75-967f-41e63131f6ab None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:03.107637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3947a2f-a617-4168-9413-98878e09ef2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:03.108263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3947a2f-a617-4168-9413-98878e09ef2d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:03.108531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3947a2f-a617-4168-9413-98878e09ef2d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:03.108797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3947a2f-a617-4168-9413-98878e09ef2d None admin] PATH_INFO: `/v3/users/f697172b6b0a451c872aed2b0cc81321` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:03.123124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3947a2f-a617-4168-9413-98878e09ef2d None admin] RBAC: Authorizing `identity:get_user(user_id=f697172b6b0a451c872aed2b0cc81321)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:03.124562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3947a2f-a617-4168-9413-98878e09ef2d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:03.126229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 560/1114] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:06:02 2022] GET /identity/v3/users/f697172b6b0a451c872aed2b0cc81321 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:03.132454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75309ea-e1a2-4dec-a653-21040ea4116d None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:03.233687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75309ea-e1a2-4dec-a653-21040ea4116d None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:03.268793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806668c7-7a95-4779-90a6-005a871baab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:03.269381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806668c7-7a95-4779-90a6-005a871baab1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:03.269652 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806668c7-7a95-4779-90a6-005a871baab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:03.269943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806668c7-7a95-4779-90a6-005a871baab1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:03.300166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:03.340867 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806668c7-7a95-4779-90a6-005a871baab1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:03.342280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806668c7-7a95-4779-90a6-005a871baab1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:03.443560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 555/1115] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:06:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:06:03.449808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3947a2f-a617-4168-9413-98878e09ef2d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:03.507922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:03.550711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3947a2f-a617-4168-9413-98878e09ef2d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:03.589857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9848bf-b5cb-4428-ac29-521c65afbfdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:03.590488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9848bf-b5cb-4428-ac29-521c65afbfdb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:03.590758 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9848bf-b5cb-4428-ac29-521c65afbfdb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:03.591792 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9848bf-b5cb-4428-ac29-521c65afbfdb None admin] PATH_INFO: `/v3/projects/150966383f6a42849391b13f12bba5ea` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:03.592262 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9848bf-b5cb-4428-ac29-521c65afbfdb None admin] RBAC: Authorizing `identity:get_project(project_id=150966383f6a42849391b13f12bba5ea)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:03.593690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9848bf-b5cb-4428-ac29-521c65afbfdb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:03.596641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 561/1116] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:06:03 2022] GET /identity/v3/projects/150966383f6a42849391b13f12bba5ea => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:03.603131 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806668c7-7a95-4779-90a6-005a871baab1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:03.666093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:03.706593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806668c7-7a95-4779-90a6-005a871baab1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:03.741960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a29261-089b-4583-a479-47f992c791cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:03.742554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a29261-089b-4583-a479-47f992c791cc None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:03.742826 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a29261-089b-4583-a479-47f992c791cc None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:03.743090 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a29261-089b-4583-a479-47f992c791cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:03.743800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a29261-089b-4583-a479-47f992c791cc None admin] RBAC: Adding query filter params (role.id=568edd5e60424ffaa076d1c402c72b19, scope.project.id=150966383f6a42849391b13f12bba5ea, user.id=f697172b6b0a451c872aed2b0cc81321) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:06:03.744105 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a29261-089b-4583-a479-47f992c791cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:03.745523 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a29261-089b-4583-a479-47f992c791cc None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:03.751108 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 556/1117] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:06:03 2022] GET /identity/v3/role_assignments?user.id=f697172b6b0a451c872aed2b0cc81321&scope.project.id=150966383f6a42849391b13f12bba5ea&role.id=568edd5e60424ffaa076d1c402c72b19 => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:05.870800 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd739cb-4578-4e2d-b4c4-ee69a3c8a16d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:05.871400 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd739cb-4578-4e2d-b4c4-ee69a3c8a16d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:05.871400 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd739cb-4578-4e2d-b4c4-ee69a3c8a16d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:05.872656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 562/1118] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:05.878595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd8ed2-f4cb-4997-9ed6-86479e41f292 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:05.879040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd8ed2-f4cb-4997-9ed6-86479e41f292 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:05.879143 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd8ed2-f4cb-4997-9ed6-86479e41f292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:05.898407 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-91fd8ed2-f4cb-4997-9ed6-86479e41f292 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:05.899616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-91fd8ed2-f4cb-4997-9ed6-86479e41f292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:05.973505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 557/1119] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:06:06.237933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd739cb-4578-4e2d-b4c4-ee69a3c8a16d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:06.342642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd739cb-4578-4e2d-b4c4-ee69a3c8a16d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:06.368963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:06.378841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdba0d-2da3-42b8-960f-be17adac09bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:06.379469 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdba0d-2da3-42b8-960f-be17adac09bb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:06.379743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdba0d-2da3-42b8-960f-be17adac09bb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:06.380043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdba0d-2da3-42b8-960f-be17adac09bb None admin] PATH_INFO: `/v3/roles/568edd5e60424ffaa076d1c402c72b19` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:06.381449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdba0d-2da3-42b8-960f-be17adac09bb None admin] RBAC: Authorizing `identity:get_role(role_id=568edd5e60424ffaa076d1c402c72b19)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:06.382857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87fdba0d-2da3-42b8-960f-be17adac09bb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:06.384192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 563/1120] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:06:06 2022] GET /identity/v3/roles/568edd5e60424ffaa076d1c402c72b19 => generated 223 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:06.390561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd8ed2-f4cb-4997-9ed6-86479e41f292 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:06.448817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:06.496877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91fd8ed2-f4cb-4997-9ed6-86479e41f292 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:06.532865 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f814bc0-457c-46c0-9d51-0c08b198760c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:06.533440 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f814bc0-457c-46c0-9d51-0c08b198760c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:06.533712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f814bc0-457c-46c0-9d51-0c08b198760c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:06.534017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f814bc0-457c-46c0-9d51-0c08b198760c None admin] PATH_INFO: `/v3/users/f697172b6b0a451c872aed2b0cc81321` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:06.535182 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f814bc0-457c-46c0-9d51-0c08b198760c None admin] RBAC: Authorizing `identity:get_user(user_id=f697172b6b0a451c872aed2b0cc81321)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:06.536620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f814bc0-457c-46c0-9d51-0c08b198760c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:06.538247 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 558/1121] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:06:06 2022] GET /identity/v3/users/f697172b6b0a451c872aed2b0cc81321 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:06.544386 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdba0d-2da3-42b8-960f-be17adac09bb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:06.659911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87fdba0d-2da3-42b8-960f-be17adac09bb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:06.701560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b601d69-77f6-4499-af74-d2e023ed9982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:06.702226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b601d69-77f6-4499-af74-d2e023ed9982 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:06.702521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b601d69-77f6-4499-af74-d2e023ed9982 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:06.702767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b601d69-77f6-4499-af74-d2e023ed9982 None admin] PATH_INFO: `/v3/projects/150966383f6a42849391b13f12bba5ea` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:06.703946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b601d69-77f6-4499-af74-d2e023ed9982 None admin] RBAC: Authorizing `identity:get_project(project_id=150966383f6a42849391b13f12bba5ea)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:06.705425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b601d69-77f6-4499-af74-d2e023ed9982 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:06.707113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 564/1122] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:06:06 2022] GET /identity/v3/projects/150966383f6a42849391b13f12bba5ea => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:06.713994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f814bc0-457c-46c0-9d51-0c08b198760c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:06.831805 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f814bc0-457c-46c0-9d51-0c08b198760c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:06.860619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:06.873723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64472221-a9cf-4e85-aba8-a2d4dc90150d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:06.874435 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64472221-a9cf-4e85-aba8-a2d4dc90150d None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:06.874717 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64472221-a9cf-4e85-aba8-a2d4dc90150d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:06.874989 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64472221-a9cf-4e85-aba8-a2d4dc90150d None admin] PATH_INFO: `/v3/projects/150966383f6a42849391b13f12bba5ea/users/f697172b6b0a451c872aed2b0cc81321/roles/568edd5e60424ffaa076d1c402c72b19` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:06.877947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64472221-a9cf-4e85-aba8-a2d4dc90150d None admin] RBAC: Authorizing `identity:create_grant(project_id=150966383f6a42849391b13f12bba5ea, user_id=f697172b6b0a451c872aed2b0cc81321, role_id=568edd5e60424ffaa076d1c402c72b19)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:06.879446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64472221-a9cf-4e85-aba8-a2d4dc90150d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:06.895455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 559/1123] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:06:06 2022] PUT /identity/v3/projects/150966383f6a42849391b13f12bba5ea/users/f697172b6b0a451c872aed2b0cc81321/roles/568edd5e60424ffaa076d1c402c72b19 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:06:09.030906 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b013-a264-4ff7-95d5-7b740a477800 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:09.031507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b013-a264-4ff7-95d5-7b740a477800 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:09.031507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247b013-a264-4ff7-95d5-7b740a477800 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:09.032849 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 565/1124] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:09.043092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb3e14-13de-4cd3-9e2a-86d974fdb321 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:09.043555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb3e14-13de-4cd3-9e2a-86d974fdb321 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:09.043669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb3e14-13de-4cd3-9e2a-86d974fdb321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:09.063304 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-49eb3e14-13de-4cd3-9e2a-86d974fdb321 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:09.064589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-49eb3e14-13de-4cd3-9e2a-86d974fdb321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:09.139130 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 560/1125] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:06:09.401315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247b013-a264-4ff7-95d5-7b740a477800 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:09.466263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:09.507086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247b013-a264-4ff7-95d5-7b740a477800 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:09.541668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37f152-8bf8-4a4d-9d23-42d166c2febc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:09.542335 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37f152-8bf8-4a4d-9d23-42d166c2febc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:09.542602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37f152-8bf8-4a4d-9d23-42d166c2febc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:09.542864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a37f152-8bf8-4a4d-9d23-42d166c2febc None admin] PATH_INFO: `/v3/roles/568edd5e60424ffaa076d1c402c72b19` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:09.544275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37f152-8bf8-4a4d-9d23-42d166c2febc None admin] RBAC: Authorizing `identity:get_role(role_id=568edd5e60424ffaa076d1c402c72b19)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:09.545640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a37f152-8bf8-4a4d-9d23-42d166c2febc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:09.546998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 566/1126] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:06:09 2022] GET /identity/v3/roles/568edd5e60424ffaa076d1c402c72b19 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:09.553407 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb3e14-13de-4cd3-9e2a-86d974fdb321 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:09.657170 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb3e14-13de-4cd3-9e2a-86d974fdb321 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:09.671283 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:09.692910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d18b1-b507-4767-82b2-f8f5d9f3db25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:09.693543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d18b1-b507-4767-82b2-f8f5d9f3db25 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:09.693817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d18b1-b507-4767-82b2-f8f5d9f3db25 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:09.694112 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160d18b1-b507-4767-82b2-f8f5d9f3db25 None admin] PATH_INFO: `/v3/users/f697172b6b0a451c872aed2b0cc81321` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:09.695339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d18b1-b507-4767-82b2-f8f5d9f3db25 None admin] RBAC: Authorizing `identity:get_user(user_id=f697172b6b0a451c872aed2b0cc81321)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:09.696955 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160d18b1-b507-4767-82b2-f8f5d9f3db25 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:09.698634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 561/1127] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:06:09 2022] GET /identity/v3/users/f697172b6b0a451c872aed2b0cc81321 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:09.705311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37f152-8bf8-4a4d-9d23-42d166c2febc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:09.820785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a37f152-8bf8-4a4d-9d23-42d166c2febc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:09.849560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:09.857134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca04c7-bcde-44c5-ac9a-bfeee46a0b6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:09.857769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca04c7-bcde-44c5-ac9a-bfeee46a0b6a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:09.858083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca04c7-bcde-44c5-ac9a-bfeee46a0b6a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:09.858360 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca04c7-bcde-44c5-ac9a-bfeee46a0b6a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:09.932030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca04c7-bcde-44c5-ac9a-bfeee46a0b6a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:09.933490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca04c7-bcde-44c5-ac9a-bfeee46a0b6a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:10.033142 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 567/1128] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:06:09 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:06:10.039508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d18b1-b507-4767-82b2-f8f5d9f3db25 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:10.148241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160d18b1-b507-4767-82b2-f8f5d9f3db25 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:10.184917 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db4a590-d5e4-4fe9-a78e-8502c617daf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:10.185547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4a590-d5e4-4fe9-a78e-8502c617daf6 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:10.185828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4a590-d5e4-4fe9-a78e-8502c617daf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:10.186128 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db4a590-d5e4-4fe9-a78e-8502c617daf6 None admin] PATH_INFO: `/v3/projects/150966383f6a42849391b13f12bba5ea` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:10.187267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4a590-d5e4-4fe9-a78e-8502c617daf6 None admin] RBAC: Authorizing `identity:get_project(project_id=150966383f6a42849391b13f12bba5ea)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:10.188719 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db4a590-d5e4-4fe9-a78e-8502c617daf6 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:10.190415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 562/1129] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:06:10 2022] GET /identity/v3/projects/150966383f6a42849391b13f12bba5ea => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:10.197029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca04c7-bcde-44c5-ac9a-bfeee46a0b6a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:10.228464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:10.299247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca04c7-bcde-44c5-ac9a-bfeee46a0b6a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:10.348350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f188c286-e212-426b-8f02-7af13442c8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:10.348957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188c286-e212-426b-8f02-7af13442c8cc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:10.349231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188c286-e212-426b-8f02-7af13442c8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:10.349495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f188c286-e212-426b-8f02-7af13442c8cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:10.350240 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188c286-e212-426b-8f02-7af13442c8cc None admin] RBAC: Adding query filter params (role.id=568edd5e60424ffaa076d1c402c72b19, scope.project.id=150966383f6a42849391b13f12bba5ea, user.id=f697172b6b0a451c872aed2b0cc81321) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:06:10.350551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188c286-e212-426b-8f02-7af13442c8cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:10.351972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f188c286-e212-426b-8f02-7af13442c8cc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:10.357817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 568/1130] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:06:10 2022] GET /identity/v3/role_assignments?user.id=f697172b6b0a451c872aed2b0cc81321&scope.project.id=150966383f6a42849391b13f12bba5ea&role.id=568edd5e60424ffaa076d1c402c72b19 => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:12.537329 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5a4ef-1c17-4305-8adc-25264639e9c5 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:12.537908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5a4ef-1c17-4305-8adc-25264639e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:12.537908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5a4ef-1c17-4305-8adc-25264639e9c5 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:12.539221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 563/1131] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:12.544762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94875b25-f9bc-4fd3-93ad-bd0c1e525352 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:12.545206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94875b25-f9bc-4fd3-93ad-bd0c1e525352 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:12.545294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94875b25-f9bc-4fd3-93ad-bd0c1e525352 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:12.564576 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-94875b25-f9bc-4fd3-93ad-bd0c1e525352 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:12.565696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-94875b25-f9bc-4fd3-93ad-bd0c1e525352 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:12.634846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 569/1132] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:06:12.905486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5a4ef-1c17-4305-8adc-25264639e9c5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:12.972616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:13.027881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5a4ef-1c17-4305-8adc-25264639e9c5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:13.063382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efcab00a-2648-4bcd-93e8-54cee3524b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:13.064071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcab00a-2648-4bcd-93e8-54cee3524b79 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:13.064349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcab00a-2648-4bcd-93e8-54cee3524b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:13.064617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efcab00a-2648-4bcd-93e8-54cee3524b79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:13.065819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcab00a-2648-4bcd-93e8-54cee3524b79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:13.067258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efcab00a-2648-4bcd-93e8-54cee3524b79 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:13.068844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 564/1133] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:06:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:13.075017 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94875b25-f9bc-4fd3-93ad-bd0c1e525352 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:13.100599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:13.180627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94875b25-f9bc-4fd3-93ad-bd0c1e525352 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:13.217124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317e7421-9bad-477d-9fea-9edfb1a049f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:13.217736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e7421-9bad-477d-9fea-9edfb1a049f8 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:13.218042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e7421-9bad-477d-9fea-9edfb1a049f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:13.218308 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317e7421-9bad-477d-9fea-9edfb1a049f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:13.218963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e7421-9bad-477d-9fea-9edfb1a049f8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:13.220791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317e7421-9bad-477d-9fea-9edfb1a049f8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:13.249108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 570/1134] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:06:13 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:06:15.463425 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8fef3-9257-49b1-bd98-f5ed66a15960 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:15.463979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8fef3-9257-49b1-bd98-f5ed66a15960 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:15.463979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c8fef3-9257-49b1-bd98-f5ed66a15960 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:15.466068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 565/1135] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:15.473197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4036db7-9c46-47b8-a835-b42ed636409a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:15.473816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4036db7-9c46-47b8-a835-b42ed636409a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:15.473944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4036db7-9c46-47b8-a835-b42ed636409a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:15.493683 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b4036db7-9c46-47b8-a835-b42ed636409a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:15.494906 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b4036db7-9c46-47b8-a835-b42ed636409a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:15.565854 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 571/1136] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:06:15.834651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8fef3-9257-49b1-bd98-f5ed66a15960 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:15.950560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c8fef3-9257-49b1-bd98-f5ed66a15960 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:15.969013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:15.989035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36283387-4716-44c4-b827-42080a810d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:15.989663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36283387-4716-44c4-b827-42080a810d92 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:15.989967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36283387-4716-44c4-b827-42080a810d92 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:15.990239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36283387-4716-44c4-b827-42080a810d92 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:15.991443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36283387-4716-44c4-b827-42080a810d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:15.992884 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36283387-4716-44c4-b827-42080a810d92 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:15.994538 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 566/1137] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:06:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:16.001455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4036db7-9c46-47b8-a835-b42ed636409a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:16.014889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:16.113230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4036db7-9c46-47b8-a835-b42ed636409a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:16.150028 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55885bd-1ba4-4bfd-a518-6435c3db27ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:16.150649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55885bd-1ba4-4bfd-a518-6435c3db27ff None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:16.150925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55885bd-1ba4-4bfd-a518-6435c3db27ff None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:16.151195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55885bd-1ba4-4bfd-a518-6435c3db27ff None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:16.151858 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55885bd-1ba4-4bfd-a518-6435c3db27ff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:16.153306 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55885bd-1ba4-4bfd-a518-6435c3db27ff None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:16.179101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 572/1138] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:06:15 2022] POST /identity/v3/users => generated 286 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:06:18.423007 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969105-6806-489e-9282-a3d30afd9422 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:18.423603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969105-6806-489e-9282-a3d30afd9422 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:18.423603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a969105-6806-489e-9282-a3d30afd9422 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:18.424996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 567/1139] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:18.430428 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6688f49-eae6-418d-8148-8b7575a7d533 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:18.430866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6688f49-eae6-418d-8148-8b7575a7d533 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:18.430969 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6688f49-eae6-418d-8148-8b7575a7d533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:18.450172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f6688f49-eae6-418d-8148-8b7575a7d533 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:18.451550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f6688f49-eae6-418d-8148-8b7575a7d533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:18.509679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:18.521934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 573/1140] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:06:18.801227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a969105-6806-489e-9282-a3d30afd9422 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:18.911693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a969105-6806-489e-9282-a3d30afd9422 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:18.946860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5666550-91b0-4b81-add1-df7b6710ed73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:18.947480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5666550-91b0-4b81-add1-df7b6710ed73 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:18.947753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5666550-91b0-4b81-add1-df7b6710ed73 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:18.948018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5666550-91b0-4b81-add1-df7b6710ed73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:18.958536 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5666550-91b0-4b81-add1-df7b6710ed73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-a5666550-91b0-4b81-add1-df7b6710ed73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:06:18.963391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:06:18.964449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:06:18.965479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:06:18.965479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:06:18.965479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:06:18.965479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:06:18.965479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:06:18.965479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:06:18.965479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:06:18.965479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:06:18.965479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:06:18.965479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:06:18.965479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:06:18.965479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:06:18.965479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 568/1141] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:06:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:06:18.971498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6688f49-eae6-418d-8148-8b7575a7d533 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:19.075619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6688f49-eae6-418d-8148-8b7575a7d533 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:19.112408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917462b-1c59-4f4b-a803-743b518ce2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:19.113016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917462b-1c59-4f4b-a803-743b518ce2bf None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:19.113288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917462b-1c59-4f4b-a803-743b518ce2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:19.113558 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3917462b-1c59-4f4b-a803-743b518ce2bf None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:19.114253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917462b-1c59-4f4b-a803-743b518ce2bf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:06:19.114551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917462b-1c59-4f4b-a803-743b518ce2bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:19.115929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3917462b-1c59-4f4b-a803-743b518ce2bf None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:19.124336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 574/1142] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:06:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:19.131222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5666550-91b0-4b81-add1-df7b6710ed73 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:19.181135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:19.237158 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5666550-91b0-4b81-add1-df7b6710ed73 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:19.272157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39722d06-0e05-4882-aa83-13b48a3be075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:19.272790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39722d06-0e05-4882-aa83-13b48a3be075 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:19.273065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39722d06-0e05-4882-aa83-13b48a3be075 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:19.273338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39722d06-0e05-4882-aa83-13b48a3be075 None admin] PATH_INFO: `/v3/users/8005d0013b2a49a38aa7319dccec6669` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:19.287079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39722d06-0e05-4882-aa83-13b48a3be075 None admin] RBAC: Authorizing `identity:get_user(user_id=8005d0013b2a49a38aa7319dccec6669)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:19.288535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39722d06-0e05-4882-aa83-13b48a3be075 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:19.290210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 569/1143] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:06:19 2022] GET /identity/v3/users/8005d0013b2a49a38aa7319dccec6669 => generated 286 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:19.296303 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917462b-1c59-4f4b-a803-743b518ce2bf None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:19.355155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:19.404974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3917462b-1c59-4f4b-a803-743b518ce2bf None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:19.440218 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f8610-9496-4ab2-9410-226d3b260681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:19.440885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f8610-9496-4ab2-9410-226d3b260681 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:19.441085 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f8610-9496-4ab2-9410-226d3b260681 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:19.441354 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72f8610-9496-4ab2-9410-226d3b260681 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:19.509749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f8610-9496-4ab2-9410-226d3b260681 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:19.511215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72f8610-9496-4ab2-9410-226d3b260681 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:19.565810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:19.612501 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 575/1144] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:06:19 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:06:19.618729 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39722d06-0e05-4882-aa83-13b48a3be075 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:19.723303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39722d06-0e05-4882-aa83-13b48a3be075 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:19.725675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:19.758638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab19d9e-6781-44ec-84b6-ff2402cc01fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:19.759263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab19d9e-6781-44ec-84b6-ff2402cc01fe None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:19.759542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab19d9e-6781-44ec-84b6-ff2402cc01fe None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:19.759806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab19d9e-6781-44ec-84b6-ff2402cc01fe None admin] PATH_INFO: `/v3/projects/8d62ef165e3f4fdcbf64c77685c09ee3` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:19.760951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab19d9e-6781-44ec-84b6-ff2402cc01fe None admin] RBAC: Authorizing `identity:get_project(project_id=8d62ef165e3f4fdcbf64c77685c09ee3)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:19.762416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab19d9e-6781-44ec-84b6-ff2402cc01fe None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:19.764055 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 570/1145] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:06:19 2022] GET /identity/v3/projects/8d62ef165e3f4fdcbf64c77685c09ee3 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:19.770874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f8610-9496-4ab2-9410-226d3b260681 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:19.872012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72f8610-9496-4ab2-9410-226d3b260681 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:19.907293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e52f48-b144-41e8-87f3-14b7f47e9fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:19.907892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52f48-b144-41e8-87f3-14b7f47e9fa5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:19.908171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52f48-b144-41e8-87f3-14b7f47e9fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:19.908436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e52f48-b144-41e8-87f3-14b7f47e9fa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:19.909153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e52f48-b144-41e8-87f3-14b7f47e9fa5 None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=8d62ef165e3f4fdcbf64c77685c09ee3, user.id=8005d0013b2a49a38aa7319dccec6669) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:06:19.909457 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e52f48-b144-41e8-87f3-14b7f47e9fa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:19.910937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e52f48-b144-41e8-87f3-14b7f47e9fa5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:19.916569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 576/1146] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:06:19 2022] GET /identity/v3/role_assignments?user.id=8005d0013b2a49a38aa7319dccec6669&scope.project.id=8d62ef165e3f4fdcbf64c77685c09ee3&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:22.029526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e62f2-546f-4d25-b303-ad31c479e3a0 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:22.030139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e62f2-546f-4d25-b303-ad31c479e3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:22.030139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2e62f2-546f-4d25-b303-ad31c479e3a0 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:22.031504 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 571/1147] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:22.036948 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638f168-4b81-45a3-87ea-3595931853a7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:22.037371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638f168-4b81-45a3-87ea-3595931853a7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:22.037479 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0638f168-4b81-45a3-87ea-3595931853a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:22.056977 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0638f168-4b81-45a3-87ea-3595931853a7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:22.058248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0638f168-4b81-45a3-87ea-3595931853a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:22.072182 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:22.126596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 577/1148] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:06:22.398090 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e62f2-546f-4d25-b303-ad31c479e3a0 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:22.505264 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2e62f2-546f-4d25-b303-ad31c479e3a0 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:22.540836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3db3-2309-4bc3-8b6a-ade91701c869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:22.541469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3db3-2309-4bc3-8b6a-ade91701c869 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:22.541742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3db3-2309-4bc3-8b6a-ade91701c869 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:22.542045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1e3db3-2309-4bc3-8b6a-ade91701c869 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:22.553005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1e3db3-2309-4bc3-8b6a-ade91701c869 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-fb1e3db3-2309-4bc3-8b6a-ade91701c869 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:06:22.557706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:06:22.558666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:06:22.559507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:06:22.559507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:06:22.559507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:06:22.559507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:06:22.559507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:06:22.559507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:06:22.559507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:06:22.559507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:06:22.559507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:06:22.559507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:06:22.559507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:06:22.559507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:06:22.559507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 572/1149] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:06:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:06:22.565204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638f168-4b81-45a3-87ea-3595931853a7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:22.669926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0638f168-4b81-45a3-87ea-3595931853a7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:22.713443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70336c3a-10e5-46a1-b55b-f4408a53ecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:22.714081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70336c3a-10e5-46a1-b55b-f4408a53ecd9 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:22.714356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70336c3a-10e5-46a1-b55b-f4408a53ecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:22.714622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70336c3a-10e5-46a1-b55b-f4408a53ecd9 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:22.715284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70336c3a-10e5-46a1-b55b-f4408a53ecd9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:06:22.715587 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70336c3a-10e5-46a1-b55b-f4408a53ecd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:22.716961 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70336c3a-10e5-46a1-b55b-f4408a53ecd9 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:22.725640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 578/1150] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:06:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:22.731772 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3db3-2309-4bc3-8b6a-ade91701c869 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:22.765863 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:22.838822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1e3db3-2309-4bc3-8b6a-ade91701c869 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:22.874517 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d45295-1a0f-468b-a6ea-d08e19a7a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:22.875142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d45295-1a0f-468b-a6ea-d08e19a7a828 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:22.875412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d45295-1a0f-468b-a6ea-d08e19a7a828 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:22.875702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d45295-1a0f-468b-a6ea-d08e19a7a828 None admin] PATH_INFO: `/v3/users/8005d0013b2a49a38aa7319dccec6669` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:22.876948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d45295-1a0f-468b-a6ea-d08e19a7a828 None admin] RBAC: Authorizing `identity:get_user(user_id=8005d0013b2a49a38aa7319dccec6669)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:22.878418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d45295-1a0f-468b-a6ea-d08e19a7a828 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:22.880008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 573/1151] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:06:22 2022] GET /identity/v3/users/8005d0013b2a49a38aa7319dccec6669 => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:22.886102 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70336c3a-10e5-46a1-b55b-f4408a53ecd9 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:22.899630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:23.002347 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70336c3a-10e5-46a1-b55b-f4408a53ecd9 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:23.037506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfe7aa0-28e6-40f3-9fd5-433c86b5e017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:23.038243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe7aa0-28e6-40f3-9fd5-433c86b5e017 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:23.038431 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe7aa0-28e6-40f3-9fd5-433c86b5e017 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:23.038693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfe7aa0-28e6-40f3-9fd5-433c86b5e017 None admin] PATH_INFO: `/v3/projects/8d62ef165e3f4fdcbf64c77685c09ee3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:23.039854 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe7aa0-28e6-40f3-9fd5-433c86b5e017 None admin] RBAC: Authorizing `identity:get_project(project_id=8d62ef165e3f4fdcbf64c77685c09ee3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:23.041283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfe7aa0-28e6-40f3-9fd5-433c86b5e017 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:23.042936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 579/1152] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:06:22 2022] GET /identity/v3/projects/8d62ef165e3f4fdcbf64c77685c09ee3 => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:23.049376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d45295-1a0f-468b-a6ea-d08e19a7a828 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:23.146401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:23.149530 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d45295-1a0f-468b-a6ea-d08e19a7a828 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:23.184358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6cc4aa-29b9-4f9a-92cf-cc2de31d9aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:23.185012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cc4aa-29b9-4f9a-92cf-cc2de31d9aa0 None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:23.185283 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cc4aa-29b9-4f9a-92cf-cc2de31d9aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:23.185556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6cc4aa-29b9-4f9a-92cf-cc2de31d9aa0 None admin] PATH_INFO: `/v3/projects/8d62ef165e3f4fdcbf64c77685c09ee3/users/8005d0013b2a49a38aa7319dccec6669/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:23.187516 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cc4aa-29b9-4f9a-92cf-cc2de31d9aa0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8d62ef165e3f4fdcbf64c77685c09ee3, user_id=8005d0013b2a49a38aa7319dccec6669, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:23.189174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6cc4aa-29b9-4f9a-92cf-cc2de31d9aa0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:23.205095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 574/1153] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:06:23 2022] PUT /identity/v3/projects/8d62ef165e3f4fdcbf64c77685c09ee3/users/8005d0013b2a49a38aa7319dccec6669/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:06:25.316959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3511c-af10-481c-8847-162bcbc52686 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:25.317543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3511c-af10-481c-8847-162bcbc52686 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:25.317543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3511c-af10-481c-8847-162bcbc52686 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:25.318841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 580/1154] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:25.324344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1054abd-6e79-45a1-bfd8-12fc712cf438 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:25.324757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1054abd-6e79-45a1-bfd8-12fc712cf438 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:25.324895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1054abd-6e79-45a1-bfd8-12fc712cf438 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:25.343925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c1054abd-6e79-45a1-bfd8-12fc712cf438 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:25.345716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c1054abd-6e79-45a1-bfd8-12fc712cf438 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:25.415968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 575/1155] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:06:25.698999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3511c-af10-481c-8847-162bcbc52686 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:25.785962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:25.809927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3511c-af10-481c-8847-162bcbc52686 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:25.846141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb5255-c2f8-4baa-9000-5b0a7afd3aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:25.846771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb5255-c2f8-4baa-9000-5b0a7afd3aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:25.847043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb5255-c2f8-4baa-9000-5b0a7afd3aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:25.847291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb5255-c2f8-4baa-9000-5b0a7afd3aa4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:25.858663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb5255-c2f8-4baa-9000-5b0a7afd3aa4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-94cb5255-c2f8-4baa-9000-5b0a7afd3aa4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:06:25.863473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:06:25.864562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:06:25.865681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:06:25.865681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:06:25.865681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:06:25.865681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:06:25.865681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:06:25.865681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:06:25.865681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:06:25.865681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:06:25.865681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:06:25.865681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:06:25.865681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:06:25.865681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:06:25.869838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 581/1156] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:06:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:06:25.870910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1054abd-6e79-45a1-bfd8-12fc712cf438 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:25.963410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:25.974830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1054abd-6e79-45a1-bfd8-12fc712cf438 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:26.012032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442dbb-b1d5-45de-997d-c75553c2b534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:26.012643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442dbb-b1d5-45de-997d-c75553c2b534 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:26.012919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442dbb-b1d5-45de-997d-c75553c2b534 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:26.013186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43442dbb-b1d5-45de-997d-c75553c2b534 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:26.013852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442dbb-b1d5-45de-997d-c75553c2b534 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:06:26.014183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442dbb-b1d5-45de-997d-c75553c2b534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:26.015553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43442dbb-b1d5-45de-997d-c75553c2b534 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:26.024071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 576/1157] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:06:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:06:26.030387 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb5255-c2f8-4baa-9000-5b0a7afd3aa4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:26.139488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb5255-c2f8-4baa-9000-5b0a7afd3aa4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:26.174734 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9bfaa-9cc0-443a-a0aa-0f6b107d463b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:26.175375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9bfaa-9cc0-443a-a0aa-0f6b107d463b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:26.175643 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9bfaa-9cc0-443a-a0aa-0f6b107d463b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:26.175908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc9bfaa-9cc0-443a-a0aa-0f6b107d463b None admin] PATH_INFO: `/v3/users/8005d0013b2a49a38aa7319dccec6669` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:26.177261 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9bfaa-9cc0-443a-a0aa-0f6b107d463b None admin] RBAC: Authorizing `identity:get_user(user_id=8005d0013b2a49a38aa7319dccec6669)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:26.178756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdc9bfaa-9cc0-443a-a0aa-0f6b107d463b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:26.180351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 582/1158] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:06:26 2022] GET /identity/v3/users/8005d0013b2a49a38aa7319dccec6669 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:26.186430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442dbb-b1d5-45de-997d-c75553c2b534 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:26.288387 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43442dbb-b1d5-45de-997d-c75553c2b534 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:26.323540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170a930-1858-4a4e-9849-ee7471dea6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:26.324198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a930-1858-4a4e-9849-ee7471dea6df None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:26.324468 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a930-1858-4a4e-9849-ee7471dea6df None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:26.325046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f170a930-1858-4a4e-9849-ee7471dea6df None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:26.349947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:26.404567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170a930-1858-4a4e-9849-ee7471dea6df None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:26.406052 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f170a930-1858-4a4e-9849-ee7471dea6df None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:26.512061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 577/1159] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:06:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:06:26.518745 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9bfaa-9cc0-443a-a0aa-0f6b107d463b None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:26.528750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:26.631943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc9bfaa-9cc0-443a-a0aa-0f6b107d463b None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:26.671034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2893ea0b-14d0-408b-9a3e-f3f4c0ed35f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:26.671944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ea0b-14d0-408b-9a3e-f3f4c0ed35f6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:26.672641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ea0b-14d0-408b-9a3e-f3f4c0ed35f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:26.672922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2893ea0b-14d0-408b-9a3e-f3f4c0ed35f6 None admin] PATH_INFO: `/v3/projects/8d62ef165e3f4fdcbf64c77685c09ee3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:26.674145 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893ea0b-14d0-408b-9a3e-f3f4c0ed35f6 None admin] RBAC: Authorizing `identity:get_project(project_id=8d62ef165e3f4fdcbf64c77685c09ee3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:26.675573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2893ea0b-14d0-408b-9a3e-f3f4c0ed35f6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:26.677238 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 583/1160] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:06:26 2022] GET /identity/v3/projects/8d62ef165e3f4fdcbf64c77685c09ee3 => generated 311 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:26.683710 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170a930-1858-4a4e-9849-ee7471dea6df None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:26.743751 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:26.801484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f170a930-1858-4a4e-9849-ee7471dea6df None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:26.837546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c86d95e-2fca-4977-97e6-3b49b0e68f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:26.838178 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86d95e-2fca-4977-97e6-3b49b0e68f8b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:26.838450 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86d95e-2fca-4977-97e6-3b49b0e68f8b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:26.838712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c86d95e-2fca-4977-97e6-3b49b0e68f8b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:26.839433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86d95e-2fca-4977-97e6-3b49b0e68f8b None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=8d62ef165e3f4fdcbf64c77685c09ee3, user.id=8005d0013b2a49a38aa7319dccec6669) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:06:26.839736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86d95e-2fca-4977-97e6-3b49b0e68f8b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:26.841159 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c86d95e-2fca-4977-97e6-3b49b0e68f8b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:26.848403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 578/1161] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:06:26 2022] GET /identity/v3/role_assignments?user.id=8005d0013b2a49a38aa7319dccec6669&scope.project.id=8d62ef165e3f4fdcbf64c77685c09ee3&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:29.029002 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f048a93-047f-4bc1-869f-70841800521c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:29.029591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f048a93-047f-4bc1-869f-70841800521c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:29.029591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f048a93-047f-4bc1-869f-70841800521c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:29.030919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 584/1162] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:29.036686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a67995-80f9-4ffe-9b8f-bfec89356ba5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:29.037128 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a67995-80f9-4ffe-9b8f-bfec89356ba5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:29.037235 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a67995-80f9-4ffe-9b8f-bfec89356ba5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:29.056476 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-60a67995-80f9-4ffe-9b8f-bfec89356ba5 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:29.057673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-60a67995-80f9-4ffe-9b8f-bfec89356ba5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:29.128171 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 579/1163] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:06:29.393014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f048a93-047f-4bc1-869f-70841800521c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:29.477880 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:29.506964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f048a93-047f-4bc1-869f-70841800521c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:29.545698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265fb8d-a70f-41c3-8800-95953dab883f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:29.546356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265fb8d-a70f-41c3-8800-95953dab883f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:29.546631 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265fb8d-a70f-41c3-8800-95953dab883f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:29.546898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3265fb8d-a70f-41c3-8800-95953dab883f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:29.620548 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265fb8d-a70f-41c3-8800-95953dab883f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:29.621951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3265fb8d-a70f-41c3-8800-95953dab883f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:29.706901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:29.733805 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 585/1164] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:06:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:06:29.742836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a67995-80f9-4ffe-9b8f-bfec89356ba5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:29.803692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:29.869449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a67995-80f9-4ffe-9b8f-bfec89356ba5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:29.907673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080ee83-5fe8-469b-a4ce-fcc83badccae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:29.908227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ee83-5fe8-469b-a4ce-fcc83badccae None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:29.908507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ee83-5fe8-469b-a4ce-fcc83badccae None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:29.908774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080ee83-5fe8-469b-a4ce-fcc83badccae None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:29.915881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080ee83-5fe8-469b-a4ce-fcc83badccae None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:29.917321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1080ee83-5fe8-469b-a4ce-fcc83badccae None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-1080ee83-5fe8-469b-a4ce-fcc83badccae None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:06:29.929263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:06:29.930506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:06:29.931362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 580/1165] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 19:06:29 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:06:29.936784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265fb8d-a70f-41c3-8800-95953dab883f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:30.044000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3265fb8d-a70f-41c3-8800-95953dab883f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:30.081479 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38907e63-2764-4e29-a579-a0bd78cad00a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:30.082120 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38907e63-2764-4e29-a579-a0bd78cad00a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:30.082395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38907e63-2764-4e29-a579-a0bd78cad00a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:30.082656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38907e63-2764-4e29-a579-a0bd78cad00a None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:30.083298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38907e63-2764-4e29-a579-a0bd78cad00a None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:06:30.083597 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38907e63-2764-4e29-a579-a0bd78cad00a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:30.084952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38907e63-2764-4e29-a579-a0bd78cad00a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:30.092475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 586/1166] 10.222.0.25 () {56 vars in 1115 bytes} [Thu Sep 15 19:06:29 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:32.227953 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a69fe0-1a26-4162-8362-10a8b3a749a1 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:32.228545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a69fe0-1a26-4162-8362-10a8b3a749a1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:32.228545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a69fe0-1a26-4162-8362-10a8b3a749a1 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:32.229864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 581/1167] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:32.235593 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5022e-3628-4c7e-8fac-117e12c3b76b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:32.236063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5022e-3628-4c7e-8fac-117e12c3b76b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:32.236153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d5022e-3628-4c7e-8fac-117e12c3b76b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:32.254612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-59d5022e-3628-4c7e-8fac-117e12c3b76b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:32.255790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-59d5022e-3628-4c7e-8fac-117e12c3b76b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:32.286125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:32.327738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 587/1168] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:06:32.605279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a69fe0-1a26-4162-8362-10a8b3a749a1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:32.717007 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a69fe0-1a26-4162-8362-10a8b3a749a1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:32.725026 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:32.753354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5f1d93-084c-4475-a045-574b3065e0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:32.753992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f1d93-084c-4475-a045-574b3065e0ac None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:32.754270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f1d93-084c-4475-a045-574b3065e0ac None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:32.754539 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5f1d93-084c-4475-a045-574b3065e0ac None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:32.755203 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f1d93-084c-4475-a045-574b3065e0ac None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:32.756578 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5f1d93-084c-4475-a045-574b3065e0ac None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:32.774105 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 582/1169] 10.222.0.25 () {60 vars in 1138 bytes} [Thu Sep 15 19:06:32 2022] POST /identity/v3/domains => generated 267 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:06:35.008059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39ce22-0afd-4a0e-8552-6e154a3d7652 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:35.008620 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39ce22-0afd-4a0e-8552-6e154a3d7652 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:35.008620 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39ce22-0afd-4a0e-8552-6e154a3d7652 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:35.009953 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 588/1170] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:35.015324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ccc13-7630-4bc6-9559-6c8faee4e98e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:35.015913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ccc13-7630-4bc6-9559-6c8faee4e98e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:35.016173 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1ccc13-7630-4bc6-9559-6c8faee4e98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:35.035307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-bb1ccc13-7630-4bc6-9559-6c8faee4e98e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:35.036491 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bb1ccc13-7630-4bc6-9559-6c8faee4e98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:35.106356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 583/1171] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:06:35.370405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39ce22-0afd-4a0e-8552-6e154a3d7652 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:35.474903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be39ce22-0afd-4a0e-8552-6e154a3d7652 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:35.509628 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b39cdb-ff7e-49d8-ac95-12bac4b4c831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:35.510274 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b39cdb-ff7e-49d8-ac95-12bac4b4c831 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:35.510547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b39cdb-ff7e-49d8-ac95-12bac4b4c831 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:35.510815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b39cdb-ff7e-49d8-ac95-12bac4b4c831 None admin] PATH_INFO: `/v3/domains/372d4f80694c4958a2e448b158d55792` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:35.521492 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b39cdb-ff7e-49d8-ac95-12bac4b4c831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=372d4f80694c4958a2e448b158d55792)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:35.522969 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b39cdb-ff7e-49d8-ac95-12bac4b4c831 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:35.524554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 589/1172] 10.222.0.25 () {56 vars in 1183 bytes} [Thu Sep 15 19:06:35 2022] GET /identity/v3/domains/372d4f80694c4958a2e448b158d55792 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:35.530730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ccc13-7630-4bc6-9559-6c8faee4e98e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:35.630663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:35.636892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1ccc13-7630-4bc6-9559-6c8faee4e98e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:35.675088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40ac84e-00ed-47c6-b7d7-c7dbb00c715d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:35.675691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ac84e-00ed-47c6-b7d7-c7dbb00c715d None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:35.675969 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ac84e-00ed-47c6-b7d7-c7dbb00c715d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:35.676239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40ac84e-00ed-47c6-b7d7-c7dbb00c715d None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:35.676886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ac84e-00ed-47c6-b7d7-c7dbb00c715d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:35.678380 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40ac84e-00ed-47c6-b7d7-c7dbb00c715d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:35.707528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 584/1173] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:06:35 2022] POST /identity/v3/projects => generated 361 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:06:37.932289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423f719-1488-4449-a988-8b23836fdcf9 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:37.932881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423f719-1488-4449-a988-8b23836fdcf9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:37.932881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3423f719-1488-4449-a988-8b23836fdcf9 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:37.934195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 590/1174] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:37.940239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa1d9b-ec0c-4c03-a846-4206395e89ce None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:37.940696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa1d9b-ec0c-4c03-a846-4206395e89ce None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:37.940788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1aa1d9b-ec0c-4c03-a846-4206395e89ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:37.960454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e1aa1d9b-ec0c-4c03-a846-4206395e89ce None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:37.961656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e1aa1d9b-ec0c-4c03-a846-4206395e89ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:38.031730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 585/1175] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:06:38.306908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423f719-1488-4449-a988-8b23836fdcf9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:38.337731 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:38.418516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3423f719-1488-4449-a988-8b23836fdcf9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:38.456275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd92360-f0ea-4bae-9346-31d583d7a3c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:38.456936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92360-f0ea-4bae-9346-31d583d7a3c0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:38.457213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92360-f0ea-4bae-9346-31d583d7a3c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:38.457484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd92360-f0ea-4bae-9346-31d583d7a3c0 None admin] PATH_INFO: `/v3/domains/372d4f80694c4958a2e448b158d55792` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:38.458726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd92360-f0ea-4bae-9346-31d583d7a3c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=372d4f80694c4958a2e448b158d55792)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:38.460184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd92360-f0ea-4bae-9346-31d583d7a3c0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:38.461855 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 591/1176] 10.222.0.25 () {56 vars in 1183 bytes} [Thu Sep 15 19:06:38 2022] GET /identity/v3/domains/372d4f80694c4958a2e448b158d55792 => generated 267 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:38.467981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa1d9b-ec0c-4c03-a846-4206395e89ce None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:38.551901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:38.576405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1aa1d9b-ec0c-4c03-a846-4206395e89ce None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:38.613303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37150e49-bed5-44ef-b8ff-ea614248bdd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:38.613944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150e49-bed5-44ef-b8ff-ea614248bdd8 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:38.614223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150e49-bed5-44ef-b8ff-ea614248bdd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:38.614494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37150e49-bed5-44ef-b8ff-ea614248bdd8 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:38.615134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37150e49-bed5-44ef-b8ff-ea614248bdd8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:38.616574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37150e49-bed5-44ef-b8ff-ea614248bdd8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:38.641023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 586/1177] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:06:38 2022] POST /identity/v3/users => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:06:40.832312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfb019-9a80-43ac-afbf-96aa4f0c2e7a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:40.832869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfb019-9a80-43ac-afbf-96aa4f0c2e7a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:40.832869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dfb019-9a80-43ac-afbf-96aa4f0c2e7a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:40.834247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 592/1178] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:40.839884 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483a511-47a6-4f09-9215-229f53d643a3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:40.840299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483a511-47a6-4f09-9215-229f53d643a3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:40.840387 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6483a511-47a6-4f09-9215-229f53d643a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:40.859806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6483a511-47a6-4f09-9215-229f53d643a3 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:40.860998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6483a511-47a6-4f09-9215-229f53d643a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:40.929447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 587/1179] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:06:41.201013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfb019-9a80-43ac-afbf-96aa4f0c2e7a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:41.302009 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:41.309531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dfb019-9a80-43ac-afbf-96aa4f0c2e7a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:41.346490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd135ba-0da0-4bb4-949d-fed81cc28112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:41.347131 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd135ba-0da0-4bb4-949d-fed81cc28112 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:41.347404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd135ba-0da0-4bb4-949d-fed81cc28112 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:41.347673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd135ba-0da0-4bb4-949d-fed81cc28112 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:41.358410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd135ba-0da0-4bb4-949d-fed81cc28112 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-4dd135ba-0da0-4bb4-949d-fed81cc28112 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:06:41.363384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:06:41.364509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:06:41.365520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:06:41.365520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:06:41.365520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:06:41.365520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:06:41.365520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:06:41.365520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:06:41.365520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:06:41.365520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:06:41.365520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:06:41.365520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:06:41.365520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:06:41.365520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:06:41.365520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 593/1180] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:06:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:06:41.370775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483a511-47a6-4f09-9215-229f53d643a3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:41.436375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:41.477888 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6483a511-47a6-4f09-9215-229f53d643a3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:41.512821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb5ae7-3263-4b04-9e95-8e0e5b1485ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:41.513423 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb5ae7-3263-4b04-9e95-8e0e5b1485ee None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:41.513700 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb5ae7-3263-4b04-9e95-8e0e5b1485ee None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:41.514001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb5ae7-3263-4b04-9e95-8e0e5b1485ee None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:41.514660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb5ae7-3263-4b04-9e95-8e0e5b1485ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:06:41.514960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb5ae7-3263-4b04-9e95-8e0e5b1485ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:41.516401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb5ae7-3263-4b04-9e95-8e0e5b1485ee None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:41.524658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 588/1181] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:06:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:41.531084 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd135ba-0da0-4bb4-949d-fed81cc28112 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:41.634223 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd135ba-0da0-4bb4-949d-fed81cc28112 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:41.668816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44585814-a777-4422-8c19-544fb5f930a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:41.669451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585814-a777-4422-8c19-544fb5f930a6 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:41.669728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585814-a777-4422-8c19-544fb5f930a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:41.670039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44585814-a777-4422-8c19-544fb5f930a6 None admin] PATH_INFO: `/v3/users/9055c9c71e6847c1b27ca3fceb88b4fd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:41.684375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44585814-a777-4422-8c19-544fb5f930a6 None admin] RBAC: Authorizing `identity:get_user(user_id=9055c9c71e6847c1b27ca3fceb88b4fd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:41.685825 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44585814-a777-4422-8c19-544fb5f930a6 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:41.687515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 594/1182] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:06:41 2022] GET /identity/v3/users/9055c9c71e6847c1b27ca3fceb88b4fd => generated 311 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:06:41.693818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb5ae7-3263-4b04-9e95-8e0e5b1485ee None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:41.796808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb5ae7-3263-4b04-9e95-8e0e5b1485ee None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:41.823392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:41.834122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd269f0d-a223-4239-852d-7e732c0daba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:41.834743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd269f0d-a223-4239-852d-7e732c0daba6 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:41.835022 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd269f0d-a223-4239-852d-7e732c0daba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:41.835289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd269f0d-a223-4239-852d-7e732c0daba6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:41.907208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd269f0d-a223-4239-852d-7e732c0daba6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:41.908686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd269f0d-a223-4239-852d-7e732c0daba6 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:42.012056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 589/1183] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:06:41 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:06:42.018867 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44585814-a777-4422-8c19-544fb5f930a6 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:42.035959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:42.126406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44585814-a777-4422-8c19-544fb5f930a6 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:42.165097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc10f2d-aa94-4e6d-b0e1-29e76902ae6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:42.165729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc10f2d-aa94-4e6d-b0e1-29e76902ae6d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:42.166041 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc10f2d-aa94-4e6d-b0e1-29e76902ae6d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:42.166313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc10f2d-aa94-4e6d-b0e1-29e76902ae6d None admin] PATH_INFO: `/v3/projects/0a20eb43e30b4a0fad361309fe6186fa` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:42.167448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc10f2d-aa94-4e6d-b0e1-29e76902ae6d None admin] RBAC: Authorizing `identity:get_project(project_id=0a20eb43e30b4a0fad361309fe6186fa)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:42.168886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc10f2d-aa94-4e6d-b0e1-29e76902ae6d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:42.170560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 595/1184] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:06:42 2022] GET /identity/v3/projects/0a20eb43e30b4a0fad361309fe6186fa => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:42.176998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd269f0d-a223-4239-852d-7e732c0daba6 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:42.203790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:42.278363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd269f0d-a223-4239-852d-7e732c0daba6 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:42.317001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788ff69d-61cf-4a51-ad2c-c5575626b013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:42.317635 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff69d-61cf-4a51-ad2c-c5575626b013 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:42.317917 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff69d-61cf-4a51-ad2c-c5575626b013 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:42.318185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788ff69d-61cf-4a51-ad2c-c5575626b013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:42.318907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ff69d-61cf-4a51-ad2c-c5575626b013 None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=0a20eb43e30b4a0fad361309fe6186fa, user.id=9055c9c71e6847c1b27ca3fceb88b4fd) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:06:42.319211 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ff69d-61cf-4a51-ad2c-c5575626b013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:42.321294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788ff69d-61cf-4a51-ad2c-c5575626b013 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:42.330486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 590/1185] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:06:42 2022] GET /identity/v3/role_assignments?user.id=9055c9c71e6847c1b27ca3fceb88b4fd&scope.project.id=0a20eb43e30b4a0fad361309fe6186fa&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:44.442999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329652b7-ae45-4474-a372-294a8e192113 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:44.443559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329652b7-ae45-4474-a372-294a8e192113 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:44.443559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329652b7-ae45-4474-a372-294a8e192113 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:44.444879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 596/1186] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:44.450433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82a0d-71e4-4ea5-bcc3-8fcedfa63dfe None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:44.450837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82a0d-71e4-4ea5-bcc3-8fcedfa63dfe None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:44.450966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd82a0d-71e4-4ea5-bcc3-8fcedfa63dfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:44.470681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2dd82a0d-71e4-4ea5-bcc3-8fcedfa63dfe None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:44.471870 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2dd82a0d-71e4-4ea5-bcc3-8fcedfa63dfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:44.540968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 591/1187] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:06:44.805022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329652b7-ae45-4474-a372-294a8e192113 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:44.889963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:44.911522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329652b7-ae45-4474-a372-294a8e192113 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:44.946420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c196f-cec0-4a3e-8738-bf1a2be5b0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:44.947052 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c196f-cec0-4a3e-8738-bf1a2be5b0ea None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:44.947329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c196f-cec0-4a3e-8738-bf1a2be5b0ea None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:44.947594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0c196f-cec0-4a3e-8738-bf1a2be5b0ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:44.958361 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0c196f-cec0-4a3e-8738-bf1a2be5b0ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-0f0c196f-cec0-4a3e-8738-bf1a2be5b0ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:06:44.963141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:06:44.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:06:44.965449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:06:44.965449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:06:44.965449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:06:44.965449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:06:44.965449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:06:44.965449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:06:44.965449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:06:44.965449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:06:44.965449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:06:44.965449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:06:44.965449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:06:44.965449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:06:44.965449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 597/1188] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:06:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:06:44.971179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd82a0d-71e4-4ea5-bcc3-8fcedfa63dfe None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:44.994838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:45.074673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd82a0d-71e4-4ea5-bcc3-8fcedfa63dfe None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:45.110762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099692c-3a05-417b-9a6f-39ce41a95c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:45.111376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099692c-3a05-417b-9a6f-39ce41a95c13 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:45.111653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099692c-3a05-417b-9a6f-39ce41a95c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:45.111924 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c099692c-3a05-417b-9a6f-39ce41a95c13 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:45.112585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099692c-3a05-417b-9a6f-39ce41a95c13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:06:45.112890 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099692c-3a05-417b-9a6f-39ce41a95c13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:45.114312 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c099692c-3a05-417b-9a6f-39ce41a95c13 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:45.122838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 592/1189] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:06:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:45.129001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c196f-cec0-4a3e-8738-bf1a2be5b0ea None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:45.230249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0c196f-cec0-4a3e-8738-bf1a2be5b0ea None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:45.264915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ea397-d370-4d28-a3d5-d343b75b9fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:45.266032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ea397-d370-4d28-a3d5-d343b75b9fa0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:45.266310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ea397-d370-4d28-a3d5-d343b75b9fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:45.266578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328ea397-d370-4d28-a3d5-d343b75b9fa0 None admin] PATH_INFO: `/v3/users/9055c9c71e6847c1b27ca3fceb88b4fd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:45.267740 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ea397-d370-4d28-a3d5-d343b75b9fa0 None admin] RBAC: Authorizing `identity:get_user(user_id=9055c9c71e6847c1b27ca3fceb88b4fd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:45.269169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328ea397-d370-4d28-a3d5-d343b75b9fa0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:45.270770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 598/1190] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:06:45 2022] GET /identity/v3/users/9055c9c71e6847c1b27ca3fceb88b4fd => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:45.276890 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099692c-3a05-417b-9a6f-39ce41a95c13 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:45.362901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:45.387919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c099692c-3a05-417b-9a6f-39ce41a95c13 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:45.425345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4752c5c7-1a05-4cc9-9895-2fb3d066b31f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:45.426022 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c5c7-1a05-4cc9-9895-2fb3d066b31f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:45.426298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c5c7-1a05-4cc9-9895-2fb3d066b31f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:45.426569 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4752c5c7-1a05-4cc9-9895-2fb3d066b31f None admin] PATH_INFO: `/v3/projects/0a20eb43e30b4a0fad361309fe6186fa` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:45.427695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752c5c7-1a05-4cc9-9895-2fb3d066b31f None admin] RBAC: Authorizing `identity:get_project(project_id=0a20eb43e30b4a0fad361309fe6186fa)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:45.429137 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4752c5c7-1a05-4cc9-9895-2fb3d066b31f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:45.430796 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 593/1191] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:06:45 2022] GET /identity/v3/projects/0a20eb43e30b4a0fad361309fe6186fa => generated 361 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:45.437200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ea397-d370-4d28-a3d5-d343b75b9fa0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:45.451138 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:45.546627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328ea397-d370-4d28-a3d5-d343b75b9fa0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:45.581582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cca668-d828-4397-ab78-45af8bc74883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:45.582264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca668-d828-4397-ab78-45af8bc74883 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:45.582536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca668-d828-4397-ab78-45af8bc74883 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:45.582807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cca668-d828-4397-ab78-45af8bc74883 None admin] PATH_INFO: `/v3/projects/0a20eb43e30b4a0fad361309fe6186fa/users/9055c9c71e6847c1b27ca3fceb88b4fd/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:45.584783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cca668-d828-4397-ab78-45af8bc74883 None admin] RBAC: Authorizing `identity:create_grant(project_id=0a20eb43e30b4a0fad361309fe6186fa, user_id=9055c9c71e6847c1b27ca3fceb88b4fd, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:45.586237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cca668-d828-4397-ab78-45af8bc74883 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:45.601160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 599/1192] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:06:45 2022] PUT /identity/v3/projects/0a20eb43e30b4a0fad361309fe6186fa/users/9055c9c71e6847c1b27ca3fceb88b4fd/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:06:47.786094 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe8fe2-dc71-46aa-8306-cc35c42408fa None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:47.786697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe8fe2-dc71-46aa-8306-cc35c42408fa None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:47.786697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abe8fe2-dc71-46aa-8306-cc35c42408fa None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:47.787983 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 594/1193] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:06:47.793358 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4b261-090f-4092-8ab3-a4e86db47e02 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:47.793837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4b261-090f-4092-8ab3-a4e86db47e02 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:47.793936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c4b261-090f-4092-8ab3-a4e86db47e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:47.813611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-86c4b261-090f-4092-8ab3-a4e86db47e02 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:06:47.814828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-86c4b261-090f-4092-8ab3-a4e86db47e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:06:47.881205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:47.886465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 600/1194] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:06:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:06:48.154239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe8fe2-dc71-46aa-8306-cc35c42408fa None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:48.267619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abe8fe2-dc71-46aa-8306-cc35c42408fa None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:48.303026 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a618d2-5445-4dfe-9ec7-f28452488ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:48.303667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a618d2-5445-4dfe-9ec7-f28452488ed7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:48.303942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a618d2-5445-4dfe-9ec7-f28452488ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:48.304210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a618d2-5445-4dfe-9ec7-f28452488ed7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:48.315715 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a618d2-5445-4dfe-9ec7-f28452488ed7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-b1a618d2-5445-4dfe-9ec7-f28452488ed7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:06:48.320819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:06:48.322076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:06:48.323167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:06:48.323167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:06:48.323167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:06:48.323167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:06:48.323167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:06:48.323167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:06:48.323167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:06:48.323167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:06:48.323167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:06:48.323167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:06:48.323167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:06:48.323167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:06:48.323167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 595/1195] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:06:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:06:48.328993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4b261-090f-4092-8ab3-a4e86db47e02 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:48.436746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c4b261-090f-4092-8ab3-a4e86db47e02 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:48.473255 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed624-d8bf-4770-8518-af0d52276eaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:48.473888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed624-d8bf-4770-8518-af0d52276eaa None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:48.474163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed624-d8bf-4770-8518-af0d52276eaa None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:48.474428 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86ed624-d8bf-4770-8518-af0d52276eaa None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:48.475105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ed624-d8bf-4770-8518-af0d52276eaa None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:06:48.475408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ed624-d8bf-4770-8518-af0d52276eaa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:48.476788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f86ed624-d8bf-4770-8518-af0d52276eaa None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:48.486053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 601/1196] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:06:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:48.492499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a618d2-5445-4dfe-9ec7-f28452488ed7 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:48.508063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:48.599003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a618d2-5445-4dfe-9ec7-f28452488ed7 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:48.633971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588070b-b1cb-4ffb-9abd-886323bc94f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:48.634625 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588070b-b1cb-4ffb-9abd-886323bc94f7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:48.634905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588070b-b1cb-4ffb-9abd-886323bc94f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:48.635179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4588070b-b1cb-4ffb-9abd-886323bc94f7 None admin] PATH_INFO: `/v3/users/9055c9c71e6847c1b27ca3fceb88b4fd` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:48.636295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588070b-b1cb-4ffb-9abd-886323bc94f7 None admin] RBAC: Authorizing `identity:get_user(user_id=9055c9c71e6847c1b27ca3fceb88b4fd)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:48.637745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4588070b-b1cb-4ffb-9abd-886323bc94f7 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:48.639409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 596/1197] 10.222.0.25 () {56 vars in 1177 bytes} [Thu Sep 15 19:06:48 2022] GET /identity/v3/users/9055c9c71e6847c1b27ca3fceb88b4fd => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:48.645414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed624-d8bf-4770-8518-af0d52276eaa None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:48.709334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:48.752559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86ed624-d8bf-4770-8518-af0d52276eaa None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:48.787194 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd9c9b-6115-449d-8c65-1f1a6270855e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:48.787800 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd9c9b-6115-449d-8c65-1f1a6270855e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:48.788069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd9c9b-6115-449d-8c65-1f1a6270855e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:48.788336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd9c9b-6115-449d-8c65-1f1a6270855e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:48.856525 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd9c9b-6115-449d-8c65-1f1a6270855e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:48.857991 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd9c9b-6115-449d-8c65-1f1a6270855e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:48.918239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:48.959559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 602/1198] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:06:48 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:06:48.965808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588070b-b1cb-4ffb-9abd-886323bc94f7 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:49.047407 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:49.071742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4588070b-b1cb-4ffb-9abd-886323bc94f7 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:49.107643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16b106-c3fe-4f28-b8ac-786708807fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:49.108270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b106-c3fe-4f28-b8ac-786708807fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:49.108902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b106-c3fe-4f28-b8ac-786708807fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:49.109181 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16b106-c3fe-4f28-b8ac-786708807fd9 None admin] PATH_INFO: `/v3/projects/0a20eb43e30b4a0fad361309fe6186fa` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:49.110505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16b106-c3fe-4f28-b8ac-786708807fd9 None admin] RBAC: Authorizing `identity:get_project(project_id=0a20eb43e30b4a0fad361309fe6186fa)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:49.111971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f16b106-c3fe-4f28-b8ac-786708807fd9 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:49.113607 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 597/1199] 10.222.0.25 () {56 vars in 1186 bytes} [Thu Sep 15 19:06:48 2022] GET /identity/v3/projects/0a20eb43e30b4a0fad361309fe6186fa => generated 361 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:49.120106 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd9c9b-6115-449d-8c65-1f1a6270855e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:06:49.223174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd9c9b-6115-449d-8c65-1f1a6270855e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:06:49.260938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604751d2-801e-4559-8825-73fb29250445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:06:49.261541 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604751d2-801e-4559-8825-73fb29250445 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:06:49.261823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604751d2-801e-4559-8825-73fb29250445 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:06:49.262122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604751d2-801e-4559-8825-73fb29250445 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:06:49.262853 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604751d2-801e-4559-8825-73fb29250445 None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=0a20eb43e30b4a0fad361309fe6186fa, user.id=9055c9c71e6847c1b27ca3fceb88b4fd) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:06:49.263158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604751d2-801e-4559-8825-73fb29250445 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:06:49.264571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604751d2-801e-4559-8825-73fb29250445 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:06:49.271113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 603/1200] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:06:49 2022] GET /identity/v3/role_assignments?user.id=9055c9c71e6847c1b27ca3fceb88b4fd&scope.project.id=0a20eb43e30b4a0fad361309fe6186fa&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:06:59.102928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=27 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:06:59.268427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=87 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:45.392948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c351062-9a04-4352-bef9-10a8efce5d15 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:45.393542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c351062-9a04-4352-bef9-10a8efce5d15 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:45.393542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c351062-9a04-4352-bef9-10a8efce5d15 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:45.394974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 598/1201] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:07:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:07:45.400565 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254045f3-3b08-4f1a-a637-fbb532757495 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:45.401109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254045f3-3b08-4f1a-a637-fbb532757495 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:45.401109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254045f3-3b08-4f1a-a637-fbb532757495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:45.421526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-254045f3-3b08-4f1a-a637-fbb532757495 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:07:45.422813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-254045f3-3b08-4f1a-a637-fbb532757495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:07:45.526332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 604/1202] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:07:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:07:45.820768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c351062-9a04-4352-bef9-10a8efce5d15 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:45.953705 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c351062-9a04-4352-bef9-10a8efce5d15 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:45.995323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09b013-05fd-4bc1-97a6-7aeb80068c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:45.996127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09b013-05fd-4bc1-97a6-7aeb80068c6f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:45.996501 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09b013-05fd-4bc1-97a6-7aeb80068c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:45.996769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09b013-05fd-4bc1-97a6-7aeb80068c6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:46.014438 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09b013-05fd-4bc1-97a6-7aeb80068c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:46.014438 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09b013-05fd-4bc1-97a6-7aeb80068c6f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-be09b013-05fd-4bc1-97a6-7aeb80068c6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:07:46.033095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:07:46.034401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:07:46.035430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:07:46.035430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:07:46.035430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:07:46.035430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 599/1203] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:07:46.040808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254045f3-3b08-4f1a-a637-fbb532757495 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:46.170477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254045f3-3b08-4f1a-a637-fbb532757495 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:46.208556 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:46.217641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263d80c-688a-4771-b986-5c75d246e7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:46.218371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263d80c-688a-4771-b986-5c75d246e7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:46.219246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263d80c-688a-4771-b986-5c75d246e7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:46.219529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263d80c-688a-4771-b986-5c75d246e7a2 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:46.220321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263d80c-688a-4771-b986-5c75d246e7a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:07:46.220717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263d80c-688a-4771-b986-5c75d246e7a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:46.222334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2263d80c-688a-4771-b986-5c75d246e7a2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:46.241840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 605/1204] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:07:46.248412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09b013-05fd-4bc1-97a6-7aeb80068c6f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:46.327734 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:46.391621 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09b013-05fd-4bc1-97a6-7aeb80068c6f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:46.434452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d4a867-e9ac-461c-9d67-6f362c06a941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:46.435113 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a867-e9ac-461c-9d67-6f362c06a941 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:46.435194 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a867-e9ac-461c-9d67-6f362c06a941 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:46.435460 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d4a867-e9ac-461c-9d67-6f362c06a941 None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:46.436175 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4a867-e9ac-461c-9d67-6f362c06a941 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:46.437678 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d4a867-e9ac-461c-9d67-6f362c06a941 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:46.465637 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 600/1205] 10.222.0.25 () {60 vars in 1132 bytes} [Thu Sep 15 19:07:46 2022] POST /identity/v3/users => generated 251 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:07:48.904474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe1a57-2990-4c73-881c-ba900875a092 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:48.905090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe1a57-2990-4c73-881c-ba900875a092 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:48.905090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fe1a57-2990-4c73-881c-ba900875a092 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:48.906615 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 606/1206] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:07:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:07:48.912441 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb62de-6b92-4979-b4a9-a120209f6354 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:48.913016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb62de-6b92-4979-b4a9-a120209f6354 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:48.913313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fb62de-6b92-4979-b4a9-a120209f6354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:48.935765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-02fb62de-6b92-4979-b4a9-a120209f6354 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:07:48.937023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-02fb62de-6b92-4979-b4a9-a120209f6354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:07:49.021677 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 601/1207] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:07:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:07:49.302752 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe1a57-2990-4c73-881c-ba900875a092 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:49.428083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fe1a57-2990-4c73-881c-ba900875a092 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:49.464788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437b459-1bfe-4a07-87dc-1d4d0185d433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:49.466004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437b459-1bfe-4a07-87dc-1d4d0185d433 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:49.466370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437b459-1bfe-4a07-87dc-1d4d0185d433 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:49.466541 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437b459-1bfe-4a07-87dc-1d4d0185d433 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:49.478946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7437b459-1bfe-4a07-87dc-1d4d0185d433 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-7437b459-1bfe-4a07-87dc-1d4d0185d433 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:07:49.483939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:07:49.486119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:07:49.487079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:07:49.487079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:07:49.487079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:07:49.487079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:07:49.487079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:07:49.487079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:07:49.487079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:07:49.487079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:07:49.487079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:07:49.487079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:07:49.487079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:07:49.487079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:07:49.487079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 607/1208] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:07:49.492214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb62de-6b92-4979-b4a9-a120209f6354 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:49.534168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:49.607419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fb62de-6b92-4979-b4a9-a120209f6354 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:49.644987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e27e7-e623-44ac-ad21-a507111225a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:49.645754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e27e7-e623-44ac-ad21-a507111225a4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:49.646057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e27e7-e623-44ac-ad21-a507111225a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:49.646388 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120e27e7-e623-44ac-ad21-a507111225a4 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:49.647157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e27e7-e623-44ac-ad21-a507111225a4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:07:49.647613 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e27e7-e623-44ac-ad21-a507111225a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:49.649114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-120e27e7-e623-44ac-ad21-a507111225a4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:49.659817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 602/1209] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:07:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:07:49.665830 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437b459-1bfe-4a07-87dc-1d4d0185d433 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:49.730887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:49.787428 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7437b459-1bfe-4a07-87dc-1d4d0185d433 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:49.828031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c0afe-e841-440e-a77b-11903f50321a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:49.828774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c0afe-e841-440e-a77b-11903f50321a None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:49.829004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c0afe-e841-440e-a77b-11903f50321a None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:49.829274 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17c0afe-e841-440e-a77b-11903f50321a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:49.841250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c0afe-e841-440e-a77b-11903f50321a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:49.843073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17c0afe-e841-440e-a77b-11903f50321a None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-b17c0afe-e841-440e-a77b-11903f50321a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:07:49.861795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:07:49.867866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:07:49.869038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:07:49.869038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:07:49.869038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:07:49.869038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 608/1210] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:07:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:07:49.871048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e27e7-e623-44ac-ad21-a507111225a4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:49.991641 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:49.995445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120e27e7-e623-44ac-ad21-a507111225a4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:50.034381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdea403-cbaa-4f22-9cb7-e948b6c6596f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:50.035054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdea403-cbaa-4f22-9cb7-e948b6c6596f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:50.035336 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdea403-cbaa-4f22-9cb7-e948b6c6596f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:50.035659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdea403-cbaa-4f22-9cb7-e948b6c6596f None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:50.036312 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdea403-cbaa-4f22-9cb7-e948b6c6596f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:07:50.036619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdea403-cbaa-4f22-9cb7-e948b6c6596f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:50.038054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdea403-cbaa-4f22-9cb7-e948b6c6596f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:50.050951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 603/1211] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:07:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:07:50.056871 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c0afe-e841-440e-a77b-11903f50321a None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:50.171409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17c0afe-e841-440e-a77b-11903f50321a None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:50.173100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:50.212363 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006117b-35d7-4fb2-abc8-3a5d32bacdcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:50.213030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006117b-35d7-4fb2-abc8-3a5d32bacdcb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:50.213303 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006117b-35d7-4fb2-abc8-3a5d32bacdcb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:50.213570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6006117b-35d7-4fb2-abc8-3a5d32bacdcb None admin] PATH_INFO: `/v3/users/placement` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:50.222741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006117b-35d7-4fb2-abc8-3a5d32bacdcb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:50.224198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6006117b-35d7-4fb2-abc8-3a5d32bacdcb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6006117b-35d7-4fb2-abc8-3a5d32bacdcb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:07:50.237227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:07:50.238381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:07:50.239366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:07:50.239366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:07:50.239366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:07:50.239366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:07:50.239366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:07:50.239366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:07:50.239366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:07:50.239366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:07:50.239366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 19:07:50.239366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:07:50.244842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 609/1212] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:07:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:07:50.246133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdea403-cbaa-4f22-9cb7-e948b6c6596f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:50.380313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdea403-cbaa-4f22-9cb7-e948b6c6596f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:50.421099 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ff13-ce85-4264-8d11-b7a0984a6fac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:50.421822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ff13-ce85-4264-8d11-b7a0984a6fac None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:50.422066 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ff13-ce85-4264-8d11-b7a0984a6fac None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:50.422337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5ff13-ce85-4264-8d11-b7a0984a6fac None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:50.423137 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5ff13-ce85-4264-8d11-b7a0984a6fac None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:07:50.423437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5ff13-ce85-4264-8d11-b7a0984a6fac None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:50.424877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c5ff13-ce85-4264-8d11-b7a0984a6fac None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:50.444037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 604/1213] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 15 19:07:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:07:50.450268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006117b-35d7-4fb2-abc8-3a5d32bacdcb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:50.561894 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6006117b-35d7-4fb2-abc8-3a5d32bacdcb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:50.597542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f062e-33e3-47b2-878a-a0b44ebeb90f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:50.598183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f062e-33e3-47b2-878a-a0b44ebeb90f None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:50.598459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f062e-33e3-47b2-878a-a0b44ebeb90f None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:50.598751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6f062e-33e3-47b2-878a-a0b44ebeb90f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:50.632371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:50.671330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f062e-33e3-47b2-878a-a0b44ebeb90f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:50.672855 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6f062e-33e3-47b2-878a-a0b44ebeb90f None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:50.792808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 610/1214] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:07:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:07:50.794772 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ff13-ce85-4264-8d11-b7a0984a6fac None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:50.814205 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:50.911762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c5ff13-ce85-4264-8d11-b7a0984a6fac None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:50.959340 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803c5fc-8890-4c26-8102-bbb79572fb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:50.960236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803c5fc-8890-4c26-8102-bbb79572fb91 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:50.960614 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803c5fc-8890-4c26-8102-bbb79572fb91 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:50.961093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0803c5fc-8890-4c26-8102-bbb79572fb91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:50.974674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803c5fc-8890-4c26-8102-bbb79572fb91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:50.976410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0803c5fc-8890-4c26-8102-bbb79572fb91 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-0803c5fc-8890-4c26-8102-bbb79572fb91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:07:50.994426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:07:50.996246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:07:50.997404 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:07:50.997404 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:07:50.997404 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:07:50.998343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 605/1215] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:07:51.004750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f062e-33e3-47b2-878a-a0b44ebeb90f None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:51.089287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:51.122736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6f062e-33e3-47b2-878a-a0b44ebeb90f None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:51.159477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baa46a-876b-4daa-b49d-3701773956a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:51.160129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baa46a-876b-4daa-b49d-3701773956a4 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:51.160409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baa46a-876b-4daa-b49d-3701773956a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:51.160681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89baa46a-876b-4daa-b49d-3701773956a4 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:51.162543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baa46a-876b-4daa-b49d-3701773956a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:07:51.162855 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baa46a-876b-4daa-b49d-3701773956a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:51.164297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89baa46a-876b-4daa-b49d-3701773956a4 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:51.177225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 611/1216] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:07:51.182831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803c5fc-8890-4c26-8102-bbb79572fb91 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:51.271071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:51.306296 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0803c5fc-8890-4c26-8102-bbb79572fb91 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:51.356804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3e8b5-1c18-4502-b845-ef9f93fa069e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:51.357480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3e8b5-1c18-4502-b845-ef9f93fa069e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:51.357876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3e8b5-1c18-4502-b845-ef9f93fa069e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:51.358132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3e8b5-1c18-4502-b845-ef9f93fa069e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:51.370078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3e8b5-1c18-4502-b845-ef9f93fa069e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:51.371710 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3e8b5-1c18-4502-b845-ef9f93fa069e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-b0f3e8b5-1c18-4502-b845-ef9f93fa069e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:07:51.388121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:07:51.389575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:07:51.390721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:07:51.390721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:07:51.390721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:07:51.390721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:07:51.390721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:07:51.390721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:07:51.390721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:07:51.390721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:07:51.390721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 606/1217] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:07:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:07:51.401226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baa46a-876b-4daa-b49d-3701773956a4 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:51.519690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89baa46a-876b-4daa-b49d-3701773956a4 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:51.545651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:51.559791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f870262-37d0-4059-8c18-11bd85737b3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:51.560482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f870262-37d0-4059-8c18-11bd85737b3b None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:51.560707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f870262-37d0-4059-8c18-11bd85737b3b None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:51.560983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f870262-37d0-4059-8c18-11bd85737b3b None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:51.561710 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f870262-37d0-4059-8c18-11bd85737b3b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:07:51.562060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f870262-37d0-4059-8c18-11bd85737b3b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:51.563553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f870262-37d0-4059-8c18-11bd85737b3b None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:51.578571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 612/1218] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:07:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:07:51.585019 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3e8b5-1c18-4502-b845-ef9f93fa069e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:51.725903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3e8b5-1c18-4502-b845-ef9f93fa069e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:51.769060 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:51.776424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30ae107-f364-405b-b697-49109837f300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:51.777340 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ae107-f364-405b-b697-49109837f300 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:51.777615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ae107-f364-405b-b697-49109837f300 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:51.777935 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30ae107-f364-405b-b697-49109837f300 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:51.778688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ae107-f364-405b-b697-49109837f300 None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=35d5f3ec00844cf28c01a14f8a071a69) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:07:51.779005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ae107-f364-405b-b697-49109837f300 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:51.780506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30ae107-f364-405b-b697-49109837f300 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:51.789420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 607/1219] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:07:51 2022] GET /identity/v3/role_assignments?user.id=35d5f3ec00844cf28c01a14f8a071a69&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:07:54.136830 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6284935-cfdf-40c2-b859-f12ff8c4d5e7 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:54.137448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6284935-cfdf-40c2-b859-f12ff8c4d5e7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:54.137448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6284935-cfdf-40c2-b859-f12ff8c4d5e7 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:54.139003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 613/1220] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:07:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:07:54.145141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed3293-b704-4399-b970-b355427c84a8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:54.145646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed3293-b704-4399-b970-b355427c84a8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:54.145745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eed3293-b704-4399-b970-b355427c84a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:54.166974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6eed3293-b704-4399-b970-b355427c84a8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:07:54.168948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6eed3293-b704-4399-b970-b355427c84a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:07:54.245506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 608/1221] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:07:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:07:54.526174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6284935-cfdf-40c2-b859-f12ff8c4d5e7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:54.647613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6284935-cfdf-40c2-b859-f12ff8c4d5e7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:54.703204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08789975-c308-42a1-8599-6ee0976a1dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:54.703843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08789975-c308-42a1-8599-6ee0976a1dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:54.704144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08789975-c308-42a1-8599-6ee0976a1dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:54.704406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08789975-c308-42a1-8599-6ee0976a1dc1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:54.718713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08789975-c308-42a1-8599-6ee0976a1dc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-08789975-c308-42a1-8599-6ee0976a1dc1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:07:54.723636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:07:54.725100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:07:54.726346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:07:54.726346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:07:54.726346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:07:54.726346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:07:54.726346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:07:54.726346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:07:54.726346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:07:54.726346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:07:54.726346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:07:54.726346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:07:54.726346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:07:54.726346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:07:54.726346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 614/1222] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:07:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:07:54.733838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed3293-b704-4399-b970-b355427c84a8 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:54.852881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eed3293-b704-4399-b970-b355427c84a8 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:54.881648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:54.894076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46bbaa-0da3-4906-b7ae-c79872834660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:54.894711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46bbaa-0da3-4906-b7ae-c79872834660 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:54.895245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46bbaa-0da3-4906-b7ae-c79872834660 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:54.895526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db46bbaa-0da3-4906-b7ae-c79872834660 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:54.896198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46bbaa-0da3-4906-b7ae-c79872834660 None admin] RBAC: Adding query filter params (name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:07:54.896500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46bbaa-0da3-4906-b7ae-c79872834660 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:54.897912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db46bbaa-0da3-4906-b7ae-c79872834660 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:54.911791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 609/1223] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:07:54 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:07:54.913153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08789975-c308-42a1-8599-6ee0976a1dc1 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:54.968633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:55.040270 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08789975-c308-42a1-8599-6ee0976a1dc1 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:55.082985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7bb62-4796-4217-a2bf-1bf43c18bb8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:55.083729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7bb62-4796-4217-a2bf-1bf43c18bb8c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:55.084014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7bb62-4796-4217-a2bf-1bf43c18bb8c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:55.084317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b7bb62-4796-4217-a2bf-1bf43c18bb8c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:55.095809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7bb62-4796-4217-a2bf-1bf43c18bb8c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:55.097263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b7bb62-4796-4217-a2bf-1bf43c18bb8c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-57b7bb62-4796-4217-a2bf-1bf43c18bb8c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:07:55.112693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:07:55.113686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:07:55.114637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:07:55.114637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:07:55.114637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:07:55.114637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 615/1224] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:07:55.119861 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46bbaa-0da3-4906-b7ae-c79872834660 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:55.233743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db46bbaa-0da3-4906-b7ae-c79872834660 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:55.292491 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f82096-dc31-4f87-89c5-e1a8c78ea08c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:55.293227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f82096-dc31-4f87-89c5-e1a8c78ea08c None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:55.293539 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f82096-dc31-4f87-89c5-e1a8c78ea08c None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:55.293913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f82096-dc31-4f87-89c5-e1a8c78ea08c None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:55.294537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f82096-dc31-4f87-89c5-e1a8c78ea08c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:07:55.295196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f82096-dc31-4f87-89c5-e1a8c78ea08c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:55.297206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f82096-dc31-4f87-89c5-e1a8c78ea08c None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:55.312253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 610/1225] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:07:55.318755 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7bb62-4796-4217-a2bf-1bf43c18bb8c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:55.424072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:55.431613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b7bb62-4796-4217-a2bf-1bf43c18bb8c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:55.468574 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc88ee-5f39-4032-81c0-77c807aef070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:55.469248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc88ee-5f39-4032-81c0-77c807aef070 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:55.469759 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc88ee-5f39-4032-81c0-77c807aef070 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:55.469912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcc88ee-5f39-4032-81c0-77c807aef070 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:55.478376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc88ee-5f39-4032-81c0-77c807aef070 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:55.480320 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcc88ee-5f39-4032-81c0-77c807aef070 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8bcc88ee-5f39-4032-81c0-77c807aef070 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:07:55.497167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:07:55.498410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:07:55.499491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:07:55.499491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:07:55.499491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:07:55.499491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:07:55.499491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:07:55.499491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:07:55.499491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:07:55.499491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:07:55.499491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 19:07:55.499491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:07:55.499491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 616/1226] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:07:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:07:55.505282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f82096-dc31-4f87-89c5-e1a8c78ea08c None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:55.559882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:55.624343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f82096-dc31-4f87-89c5-e1a8c78ea08c None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:55.664127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc135e52-4ffd-4b05-90bf-4f61b139079f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:55.664755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc135e52-4ffd-4b05-90bf-4f61b139079f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:55.665032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc135e52-4ffd-4b05-90bf-4f61b139079f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:55.665303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc135e52-4ffd-4b05-90bf-4f61b139079f None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:55.666075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc135e52-4ffd-4b05-90bf-4f61b139079f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:07:55.666381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc135e52-4ffd-4b05-90bf-4f61b139079f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:55.668582 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc135e52-4ffd-4b05-90bf-4f61b139079f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:55.687618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 611/1227] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 15 19:07:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:07:55.693844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc88ee-5f39-4032-81c0-77c807aef070 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:55.805056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcc88ee-5f39-4032-81c0-77c807aef070 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:55.843830 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803bf91-257f-4afb-8fa9-6808a8eaa475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:55.844510 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803bf91-257f-4afb-8fa9-6808a8eaa475 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:55.844783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803bf91-257f-4afb-8fa9-6808a8eaa475 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:55.845050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2803bf91-257f-4afb-8fa9-6808a8eaa475 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:55.857756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803bf91-257f-4afb-8fa9-6808a8eaa475 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:55.859293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2803bf91-257f-4afb-8fa9-6808a8eaa475 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-2803bf91-257f-4afb-8fa9-6808a8eaa475 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:07:55.882049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:07:55.883622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:07:55.884772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:07:55.884772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:07:55.884772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:07:55.884772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 617/1228] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:07:55.890918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc135e52-4ffd-4b05-90bf-4f61b139079f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:56.006420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc135e52-4ffd-4b05-90bf-4f61b139079f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:56.008675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:56.045133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad39ac-8ca1-4e5c-a7df-d7e89d0774f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:56.045754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad39ac-8ca1-4e5c-a7df-d7e89d0774f8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:56.046071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad39ac-8ca1-4e5c-a7df-d7e89d0774f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:56.046340 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aad39ac-8ca1-4e5c-a7df-d7e89d0774f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:56.046985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad39ac-8ca1-4e5c-a7df-d7e89d0774f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:07:56.047305 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad39ac-8ca1-4e5c-a7df-d7e89d0774f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:56.048659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aad39ac-8ca1-4e5c-a7df-d7e89d0774f8 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:56.061533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 612/1229] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:07:56.067319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803bf91-257f-4afb-8fa9-6808a8eaa475 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:56.077514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:56.181286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2803bf91-257f-4afb-8fa9-6808a8eaa475 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:56.222226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfffc2-862b-4ebe-b61d-5b3a2a02384c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:56.222904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfffc2-862b-4ebe-b61d-5b3a2a02384c None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:56.223177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfffc2-862b-4ebe-b61d-5b3a2a02384c None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:56.223443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcfffc2-862b-4ebe-b61d-5b3a2a02384c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:56.230908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfffc2-862b-4ebe-b61d-5b3a2a02384c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:56.232449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcfffc2-862b-4ebe-b61d-5b3a2a02384c None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-cbcfffc2-862b-4ebe-b61d-5b3a2a02384c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:07:56.243954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:07:56.246209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:07:56.257205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:07:56.257205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:07:56.257205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:07:56.257205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:07:56.257205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:07:56.257205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:07:56.257205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:07:56.257205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:07:56.257205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 618/1230] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:07:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:07:56.258274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad39ac-8ca1-4e5c-a7df-d7e89d0774f8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:56.387807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aad39ac-8ca1-4e5c-a7df-d7e89d0774f8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:56.429902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979f5b44-8da9-4519-a427-e96e35af420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:56.430745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f5b44-8da9-4519-a427-e96e35af420a None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:56.431090 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f5b44-8da9-4519-a427-e96e35af420a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:56.431535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979f5b44-8da9-4519-a427-e96e35af420a None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:56.433053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f5b44-8da9-4519-a427-e96e35af420a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:07:56.433347 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f5b44-8da9-4519-a427-e96e35af420a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:56.435882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979f5b44-8da9-4519-a427-e96e35af420a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:56.454104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 613/1231] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:07:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:07:56.462344 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfffc2-862b-4ebe-b61d-5b3a2a02384c None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:56.534983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:56.579014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcfffc2-862b-4ebe-b61d-5b3a2a02384c None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:56.625052 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35f403a7-855e-4614-8419-f2e93a41b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:56.625941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f403a7-855e-4614-8419-f2e93a41b365 None admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:56.626244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f403a7-855e-4614-8419-f2e93a41b365 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:56.626511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35f403a7-855e-4614-8419-f2e93a41b365 None admin] PATH_INFO: `/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/35d5f3ec00844cf28c01a14f8a071a69/roles/4f6a1ac8e24d4fbbb77c428a26d085ac` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:56.642934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f403a7-855e-4614-8419-f2e93a41b365 None admin] RBAC: Authorizing `identity:create_grant(project_id=2958a115e7974fc4b5c74a633fc4322c, user_id=35d5f3ec00844cf28c01a14f8a071a69, role_id=4f6a1ac8e24d4fbbb77c428a26d085ac)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:56.644560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35f403a7-855e-4614-8419-f2e93a41b365 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:56.659706 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 619/1232] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:07:56 2022] PUT /identity/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/35d5f3ec00844cf28c01a14f8a071a69/roles/4f6a1ac8e24d4fbbb77c428a26d085ac => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:07:58.856644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c5acf-1ff2-42ec-a0ee-83d6243c99c1 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:58.857252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c5acf-1ff2-42ec-a0ee-83d6243c99c1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:58.857361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660c5acf-1ff2-42ec-a0ee-83d6243c99c1 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:58.858985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 614/1233] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:07:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:07:58.864788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d0f25-a670-45b1-9345-8d19a83dc910 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:58.865299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d0f25-a670-45b1-9345-8d19a83dc910 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:58.865299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2d0f25-a670-45b1-9345-8d19a83dc910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:58.883985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0e2d0f25-a670-45b1-9345-8d19a83dc910 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:07:58.885184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0e2d0f25-a670-45b1-9345-8d19a83dc910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:07:58.960960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 620/1234] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:07:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:07:59.254206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c5acf-1ff2-42ec-a0ee-83d6243c99c1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:59.285693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:59.394934 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660c5acf-1ff2-42ec-a0ee-83d6243c99c1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:59.435803 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bfa94-e3d4-48b6-9d4e-345fc904aff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:59.436486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bfa94-e3d4-48b6-9d4e-345fc904aff9 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:59.436783 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bfa94-e3d4-48b6-9d4e-345fc904aff9 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:59.437039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50bfa94-e3d4-48b6-9d4e-345fc904aff9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:59.448308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50bfa94-e3d4-48b6-9d4e-345fc904aff9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-d50bfa94-e3d4-48b6-9d4e-345fc904aff9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:07:59.453766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:07:59.457808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:07:59.458950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:07:59.458950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:07:59.458950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:07:59.458950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:07:59.458950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:07:59.458950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:07:59.458950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:07:59.458950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:07:59.458950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:07:59.458950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:07:59.458950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 15 19:07:59.458950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:07:59.458950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 615/1235] 10.222.0.25 () {56 vars in 1102 bytes} [Thu Sep 15 19:07:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:07:59.461150 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d0f25-a670-45b1-9345-8d19a83dc910 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:59.517166 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:59.584001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2d0f25-a670-45b1-9345-8d19a83dc910 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:59.633793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b989224-e1cb-416a-9dba-fd9791873ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:59.634446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989224-e1cb-416a-9dba-fd9791873ddb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:59.634726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989224-e1cb-416a-9dba-fd9791873ddb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:59.635009 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b989224-e1cb-416a-9dba-fd9791873ddb None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:59.635694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b989224-e1cb-416a-9dba-fd9791873ddb None admin] RBAC: Adding query filter params (name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:07:59.636111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b989224-e1cb-416a-9dba-fd9791873ddb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:59.637509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b989224-e1cb-416a-9dba-fd9791873ddb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:59.647213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 621/1236] 10.222.0.25 () {56 vars in 1103 bytes} [Thu Sep 15 19:07:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:07:59.653507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bfa94-e3d4-48b6-9d4e-345fc904aff9 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:59.753801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:07:59.772458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50bfa94-e3d4-48b6-9d4e-345fc904aff9 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:59.807898 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c377-68ac-4fe7-befc-d003954df4b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:07:59.808608 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c377-68ac-4fe7-befc-d003954df4b0 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:07:59.808915 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c377-68ac-4fe7-befc-d003954df4b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:07:59.809236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7787c377-68ac-4fe7-befc-d003954df4b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:07:59.820724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787c377-68ac-4fe7-befc-d003954df4b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:07:59.822240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7787c377-68ac-4fe7-befc-d003954df4b0 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-7787c377-68ac-4fe7-befc-d003954df4b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:07:59.837334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:07:59.838591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:07:59.839692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:07:59.839692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:07:59.839692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:07:59.839692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 616/1237] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:07:59.845109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b989224-e1cb-416a-9dba-fd9791873ddb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:07:59.974567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b989224-e1cb-416a-9dba-fd9791873ddb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:07:59.990189 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:00.020892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cc205-9aff-42a7-a5cd-5cd7507a8742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:00.021543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cc205-9aff-42a7-a5cd-5cd7507a8742 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:00.021942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cc205-9aff-42a7-a5cd-5cd7507a8742 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:00.022184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6cc205-9aff-42a7-a5cd-5cd7507a8742 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:00.022924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cc205-9aff-42a7-a5cd-5cd7507a8742 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:00.023177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cc205-9aff-42a7-a5cd-5cd7507a8742 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:00.024691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6cc205-9aff-42a7-a5cd-5cd7507a8742 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:00.039560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 622/1238] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:00.045991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c377-68ac-4fe7-befc-d003954df4b0 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:00.172901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7787c377-68ac-4fe7-befc-d003954df4b0 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:00.219061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88151cf3-9d9d-4874-9a7d-cc0c48d4bb58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:00.219802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88151cf3-9d9d-4874-9a7d-cc0c48d4bb58 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:00.220080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88151cf3-9d9d-4874-9a7d-cc0c48d4bb58 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:00.220393 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88151cf3-9d9d-4874-9a7d-cc0c48d4bb58 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:00.224238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:00.229225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88151cf3-9d9d-4874-9a7d-cc0c48d4bb58 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:00.231086 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88151cf3-9d9d-4874-9a7d-cc0c48d4bb58 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-88151cf3-9d9d-4874-9a7d-cc0c48d4bb58 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:08:00.247280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:00.248804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:00.249944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:00.249944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:00.249944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:08:00.249944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:08:00.249944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:08:00.249944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:08:00.249944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:08:00.249944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:08:00.249944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 19:08:00.249944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:08:00.249944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 617/1239] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:08:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:00.254790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cc205-9aff-42a7-a5cd-5cd7507a8742 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:00.369648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6cc205-9aff-42a7-a5cd-5cd7507a8742 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:00.411264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f524757-d5ae-4178-a5e8-50f7892a5592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:00.411942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f524757-d5ae-4178-a5e8-50f7892a5592 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:00.412260 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f524757-d5ae-4178-a5e8-50f7892a5592 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:00.412571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f524757-d5ae-4178-a5e8-50f7892a5592 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:00.413371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f524757-d5ae-4178-a5e8-50f7892a5592 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:00.413716 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f524757-d5ae-4178-a5e8-50f7892a5592 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:00.415337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f524757-d5ae-4178-a5e8-50f7892a5592 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:00.435164 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 623/1240] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 15 19:08:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:00.441430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88151cf3-9d9d-4874-9a7d-cc0c48d4bb58 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:00.552098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88151cf3-9d9d-4874-9a7d-cc0c48d4bb58 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:00.589583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8d79-01c8-4fd2-b289-0a0da7dd90e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:00.590360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8d79-01c8-4fd2-b289-0a0da7dd90e7 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:00.590700 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8d79-01c8-4fd2-b289-0a0da7dd90e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:00.591046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a8d79-01c8-4fd2-b289-0a0da7dd90e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:00.668826 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:00.676810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a8d79-01c8-4fd2-b289-0a0da7dd90e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:00.678564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b9a8d79-01c8-4fd2-b289-0a0da7dd90e7 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:00.800131 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 618/1241] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:08:00 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:08:00.807022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f524757-d5ae-4178-a5e8-50f7892a5592 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:00.839674 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:00.923610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f524757-d5ae-4178-a5e8-50f7892a5592 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:00.973600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ea5d3-7f06-431e-b44e-b7051a6e43e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:00.974358 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ea5d3-7f06-431e-b44e-b7051a6e43e8 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:00.974713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ea5d3-7f06-431e-b44e-b7051a6e43e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:00.975336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32ea5d3-7f06-431e-b44e-b7051a6e43e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:00.990233 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ea5d3-7f06-431e-b44e-b7051a6e43e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:00.992004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32ea5d3-7f06-431e-b44e-b7051a6e43e8 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-c32ea5d3-7f06-431e-b44e-b7051a6e43e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:08:01.009299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:01.010738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:08:01.011695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:08:01.011695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:01.011695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:01.011695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 624/1242] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:08:01.016933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8d79-01c8-4fd2-b289-0a0da7dd90e7 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:01.136115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:01.143175 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a8d79-01c8-4fd2-b289-0a0da7dd90e7 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:01.183415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccc04a-c19c-452d-9a58-3b05fceb442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:01.184174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccc04a-c19c-452d-9a58-3b05fceb442e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:01.184452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccc04a-c19c-452d-9a58-3b05fceb442e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:01.184720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ccc04a-c19c-452d-9a58-3b05fceb442e None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:01.185376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccc04a-c19c-452d-9a58-3b05fceb442e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:01.185667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccc04a-c19c-452d-9a58-3b05fceb442e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:01.187177 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ccc04a-c19c-452d-9a58-3b05fceb442e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:01.201638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 619/1243] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:01.207924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ea5d3-7f06-431e-b44e-b7051a6e43e8 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:01.311355 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:01.343360 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32ea5d3-7f06-431e-b44e-b7051a6e43e8 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:01.384094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef7a2b-ecb9-4a5d-8e85-d6adeea76276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:01.384833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef7a2b-ecb9-4a5d-8e85-d6adeea76276 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:01.385133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef7a2b-ecb9-4a5d-8e85-d6adeea76276 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:01.385434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ef7a2b-ecb9-4a5d-8e85-d6adeea76276 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:01.394749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef7a2b-ecb9-4a5d-8e85-d6adeea76276 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:01.396154 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ef7a2b-ecb9-4a5d-8e85-d6adeea76276 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-33ef7a2b-ecb9-4a5d-8e85-d6adeea76276 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:08:01.408654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:01.409947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:01.411074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:08:01.411074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:08:01.411074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:08:01.411074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:08:01.411074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:08:01.411074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:08:01.411074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:08:01.411074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:01.411074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 625/1244] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:01.416319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccc04a-c19c-452d-9a58-3b05fceb442e None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:01.541449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ccc04a-c19c-452d-9a58-3b05fceb442e None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:01.581581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab9ea9-f2b3-40e3-927d-8de106841553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:01.582267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab9ea9-f2b3-40e3-927d-8de106841553 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:01.582548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab9ea9-f2b3-40e3-927d-8de106841553 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:01.582821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab9ea9-f2b3-40e3-927d-8de106841553 None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:01.583547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab9ea9-f2b3-40e3-927d-8de106841553 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:01.583855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab9ea9-f2b3-40e3-927d-8de106841553 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:01.585297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab9ea9-f2b3-40e3-927d-8de106841553 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:01.598617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 620/1245] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:08:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:01.605813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef7a2b-ecb9-4a5d-8e85-d6adeea76276 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:01.725822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ef7a2b-ecb9-4a5d-8e85-d6adeea76276 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:01.764504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c621af-8f12-48bf-a92f-c06eaa10a250 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:01.765118 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c621af-8f12-48bf-a92f-c06eaa10a250 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:01.765396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c621af-8f12-48bf-a92f-c06eaa10a250 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:01.765668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c621af-8f12-48bf-a92f-c06eaa10a250 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:01.766410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c621af-8f12-48bf-a92f-c06eaa10a250 None admin] RBAC: Adding query filter params (role.id=4f6a1ac8e24d4fbbb77c428a26d085ac, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=35d5f3ec00844cf28c01a14f8a071a69) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:01.766711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c621af-8f12-48bf-a92f-c06eaa10a250 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:01.768140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c621af-8f12-48bf-a92f-c06eaa10a250 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:01.785835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 626/1246] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:08:01 2022] GET /identity/v3/role_assignments?user.id=35d5f3ec00844cf28c01a14f8a071a69&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=4f6a1ac8e24d4fbbb77c428a26d085ac => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:04.320220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e496f2-fe15-4381-9709-271aaad218d7 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:04.320771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e496f2-fe15-4381-9709-271aaad218d7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:04.320771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e496f2-fe15-4381-9709-271aaad218d7 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:04.322139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 621/1247] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:08:04.328025 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25988c-1f30-457c-900c-1b4cac21c93d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:04.328455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25988c-1f30-457c-900c-1b4cac21c93d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:04.328597 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba25988c-1f30-457c-900c-1b4cac21c93d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:04.335380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:04.351109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ba25988c-1f30-457c-900c-1b4cac21c93d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:08:04.352550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ba25988c-1f30-457c-900c-1b4cac21c93d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:08:04.430601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 627/1248] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:08:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:08:04.741475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e496f2-fe15-4381-9709-271aaad218d7 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:04.760769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:04.859370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e496f2-fe15-4381-9709-271aaad218d7 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:04.896776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbdf7f-e741-40e6-9590-d56b6207acbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:04.897450 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbdf7f-e741-40e6-9590-d56b6207acbf None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:04.897846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbdf7f-e741-40e6-9590-d56b6207acbf None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:04.897997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdbdf7f-e741-40e6-9590-d56b6207acbf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:04.909821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdbdf7f-e741-40e6-9590-d56b6207acbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-ebdbdf7f-e741-40e6-9590-d56b6207acbf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:08:04.914728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:04.915901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:04.917196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:04.917196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:04.917196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:04.917196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:04.917196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:08:04.917196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:08:04.917196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:08:04.917196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:08:04.917196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:08:04.917196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:08:04.917196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:08:04.917196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:08:04.917196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 622/1249] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:08:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:04.922826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25988c-1f30-457c-900c-1b4cac21c93d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:05.041099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba25988c-1f30-457c-900c-1b4cac21c93d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:05.072411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:05.078843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad1b72-f523-44d1-97bd-04875d104dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:05.079531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad1b72-f523-44d1-97bd-04875d104dde None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:05.079807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad1b72-f523-44d1-97bd-04875d104dde None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:05.080077 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ad1b72-f523-44d1-97bd-04875d104dde None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:05.080808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad1b72-f523-44d1-97bd-04875d104dde None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:05.081118 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad1b72-f523-44d1-97bd-04875d104dde None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:05.082554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ad1b72-f523-44d1-97bd-04875d104dde None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:05.092230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 628/1250] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:08:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:05.098587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbdf7f-e741-40e6-9590-d56b6207acbf None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:05.187246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:05.213439 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdbdf7f-e741-40e6-9590-d56b6207acbf None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:05.249727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66795acd-3741-482b-84a5-d66b94270248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:05.250391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66795acd-3741-482b-84a5-d66b94270248 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:05.250669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66795acd-3741-482b-84a5-d66b94270248 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:05.250940 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66795acd-3741-482b-84a5-d66b94270248 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:05.260974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66795acd-3741-482b-84a5-d66b94270248 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:05.262739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66795acd-3741-482b-84a5-d66b94270248 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-66795acd-3741-482b-84a5-d66b94270248 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:08:05.278225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:05.279428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:08:05.280817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:08:05.280817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:05.280817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:08:05.280817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 623/1251] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:05.285594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad1b72-f523-44d1-97bd-04875d104dde None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:05.410810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ad1b72-f523-44d1-97bd-04875d104dde None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:05.449590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b01e49-29ee-4a25-9891-f08299ebe303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:05.450250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01e49-29ee-4a25-9891-f08299ebe303 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:05.450535 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01e49-29ee-4a25-9891-f08299ebe303 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:05.450806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b01e49-29ee-4a25-9891-f08299ebe303 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:05.451514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b01e49-29ee-4a25-9891-f08299ebe303 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:05.452579 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b01e49-29ee-4a25-9891-f08299ebe303 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:05.454013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b01e49-29ee-4a25-9891-f08299ebe303 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:05.468206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 629/1252] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:08:05.474189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66795acd-3741-482b-84a5-d66b94270248 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:05.600140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66795acd-3741-482b-84a5-d66b94270248 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:05.631971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:05.643637 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbcfdd-1a7a-4b76-a285-3c998683811b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:05.644285 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbcfdd-1a7a-4b76-a285-3c998683811b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:05.644560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbcfdd-1a7a-4b76-a285-3c998683811b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:05.644833 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bbcfdd-1a7a-4b76-a285-3c998683811b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:05.654974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbcfdd-1a7a-4b76-a285-3c998683811b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:05.656507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48bbcfdd-1a7a-4b76-a285-3c998683811b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-48bbcfdd-1a7a-4b76-a285-3c998683811b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:08:05.670054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:05.671278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:05.672694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:05.672694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:05.672694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:08:05.672694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:08:05.672694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:08:05.672694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:08:05.672694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:08:05.672694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:08:05.672694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 19:08:05.672694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:08:05.672694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 624/1253] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:08:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:05.677533 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b01e49-29ee-4a25-9891-f08299ebe303 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:05.741833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:05.790547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b01e49-29ee-4a25-9891-f08299ebe303 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:05.827271 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d398218-9dd9-46fd-b330-eef67eacf0e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:05.828058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d398218-9dd9-46fd-b330-eef67eacf0e0 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:05.828430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d398218-9dd9-46fd-b330-eef67eacf0e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:05.828788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d398218-9dd9-46fd-b330-eef67eacf0e0 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:05.829630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d398218-9dd9-46fd-b330-eef67eacf0e0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:05.829978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d398218-9dd9-46fd-b330-eef67eacf0e0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:05.831468 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d398218-9dd9-46fd-b330-eef67eacf0e0 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:05.851353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 630/1254] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 15 19:08:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:05.857622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbcfdd-1a7a-4b76-a285-3c998683811b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:05.976088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48bbcfdd-1a7a-4b76-a285-3c998683811b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:06.019921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e859f6-32a4-4f1f-96fa-b6d4afad66fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:06.020535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e859f6-32a4-4f1f-96fa-b6d4afad66fe None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:06.020810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e859f6-32a4-4f1f-96fa-b6d4afad66fe None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:06.021076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e859f6-32a4-4f1f-96fa-b6d4afad66fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:06.082693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:06.095331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e859f6-32a4-4f1f-96fa-b6d4afad66fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:06.096794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e859f6-32a4-4f1f-96fa-b6d4afad66fe None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:06.204459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 625/1255] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:08:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:08:06.210605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d398218-9dd9-46fd-b330-eef67eacf0e0 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:06.322024 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d398218-9dd9-46fd-b330-eef67eacf0e0 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:06.337999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:06.362495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05eb744-37bf-40fe-93f3-665f34bcd596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:06.363249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eb744-37bf-40fe-93f3-665f34bcd596 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:06.363565 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eb744-37bf-40fe-93f3-665f34bcd596 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:06.363934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05eb744-37bf-40fe-93f3-665f34bcd596 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:06.376176 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05eb744-37bf-40fe-93f3-665f34bcd596 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:06.377817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05eb744-37bf-40fe-93f3-665f34bcd596 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-f05eb744-37bf-40fe-93f3-665f34bcd596 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:08:06.394514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:06.395668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:08:06.396756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:08:06.396756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:06.396756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:06.396756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 631/1256] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 15 19:08:06.402715 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e859f6-32a4-4f1f-96fa-b6d4afad66fe None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:06.501721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:06.519577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e859f6-32a4-4f1f-96fa-b6d4afad66fe None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:06.563001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ed821-2172-4756-b646-afc8bb5ce1e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:06.563968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ed821-2172-4756-b646-afc8bb5ce1e1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:06.564440 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ed821-2172-4756-b646-afc8bb5ce1e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:06.564908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6ed821-2172-4756-b646-afc8bb5ce1e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:06.566093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ed821-2172-4756-b646-afc8bb5ce1e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:06.566630 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ed821-2172-4756-b646-afc8bb5ce1e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:06.568767 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6ed821-2172-4756-b646-afc8bb5ce1e1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:06.585715 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 626/1257] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:06.592662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05eb744-37bf-40fe-93f3-665f34bcd596 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:06.709230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05eb744-37bf-40fe-93f3-665f34bcd596 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:06.748346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5594c7-97d4-4fef-aaf3-917b6cef4a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:06.748986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5594c7-97d4-4fef-aaf3-917b6cef4a0d None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:06.749289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5594c7-97d4-4fef-aaf3-917b6cef4a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:06.749528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5594c7-97d4-4fef-aaf3-917b6cef4a0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:06.757625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5594c7-97d4-4fef-aaf3-917b6cef4a0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:06.758996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5594c7-97d4-4fef-aaf3-917b6cef4a0d None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-ad5594c7-97d4-4fef-aaf3-917b6cef4a0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:08:06.770650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:06.772426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:06.773666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:08:06.773666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:08:06.773666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:08:06.773666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:08:06.773666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:08:06.773666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:08:06.773666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:08:06.773666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:06.773666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 632/1258] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:08:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:06.780347 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ed821-2172-4756-b646-afc8bb5ce1e1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:06.893707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6ed821-2172-4756-b646-afc8bb5ce1e1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:06.939649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a62c3-ec4d-4f33-8700-9a051e9220aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:06.940349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a62c3-ec4d-4f33-8700-9a051e9220aa None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:06.940564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a62c3-ec4d-4f33-8700-9a051e9220aa None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:06.940830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a62c3-ec4d-4f33-8700-9a051e9220aa None admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:06.941545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a62c3-ec4d-4f33-8700-9a051e9220aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:06.941888 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a62c3-ec4d-4f33-8700-9a051e9220aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:06.943389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7a62c3-ec4d-4f33-8700-9a051e9220aa None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:06.958596 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 627/1259] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:08:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:06.965525 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5594c7-97d4-4fef-aaf3-917b6cef4a0d None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:06.998280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:07.084181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5594c7-97d4-4fef-aaf3-917b6cef4a0d None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:07.123270 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1ce5a-1211-4b87-ae60-6db040681f52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:07.123899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1ce5a-1211-4b87-ae60-6db040681f52 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:07.124170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1ce5a-1211-4b87-ae60-6db040681f52 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:07.124436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1ce5a-1211-4b87-ae60-6db040681f52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:07.125187 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1ce5a-1211-4b87-ae60-6db040681f52 None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=35d5f3ec00844cf28c01a14f8a071a69) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:07.125493 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1ce5a-1211-4b87-ae60-6db040681f52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:07.127000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1ce5a-1211-4b87-ae60-6db040681f52 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:07.133300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 633/1260] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:08:06 2022] GET /identity/v3/role_assignments?user.id=35d5f3ec00844cf28c01a14f8a071a69&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:09.302197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5861e-5944-4f10-8a29-2615b2d32f23 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:09.302668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5861e-5944-4f10-8a29-2615b2d32f23 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:09.302755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d5861e-5944-4f10-8a29-2615b2d32f23 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:09.304119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 628/1261] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:08:09.310109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359a93b-8655-47c1-8d05-46bf26a7f976 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:09.310618 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359a93b-8655-47c1-8d05-46bf26a7f976 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:09.310618 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359a93b-8655-47c1-8d05-46bf26a7f976 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:09.329962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b359a93b-8655-47c1-8d05-46bf26a7f976 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:08:09.331167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b359a93b-8655-47c1-8d05-46bf26a7f976 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:08:09.404956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 634/1262] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:08:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 15 19:08:09.673600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5861e-5944-4f10-8a29-2615b2d32f23 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:09.685471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:09.785669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d5861e-5944-4f10-8a29-2615b2d32f23 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:09.826194 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067531dd-ac4b-438f-84f7-208fa4c73cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:09.826825 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067531dd-ac4b-438f-84f7-208fa4c73cc8 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:09.827102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067531dd-ac4b-438f-84f7-208fa4c73cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:09.827375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067531dd-ac4b-438f-84f7-208fa4c73cc8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:09.839360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067531dd-ac4b-438f-84f7-208fa4c73cc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-067531dd-ac4b-438f-84f7-208fa4c73cc8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:08:09.844669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:09.845889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:09.846961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:09.846961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:09.846961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:09.846961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:09.846961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:08:09.846961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:08:09.846961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:08:09.846961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:08:09.846961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:08:09.846961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:08:09.846961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:08:09.846961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:08:09.846961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 629/1263] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:08:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:09.852353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359a93b-8655-47c1-8d05-46bf26a7f976 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:09.873152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:09.963380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359a93b-8655-47c1-8d05-46bf26a7f976 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:10.007319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a927bf-bbf3-419d-8e34-848290b19266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:10.007953 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a927bf-bbf3-419d-8e34-848290b19266 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:10.008296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a927bf-bbf3-419d-8e34-848290b19266 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:10.008575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a927bf-bbf3-419d-8e34-848290b19266 None admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:10.009252 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a927bf-bbf3-419d-8e34-848290b19266 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:10.009554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a927bf-bbf3-419d-8e34-848290b19266 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:10.011363 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a927bf-bbf3-419d-8e34-848290b19266 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:10.023430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 635/1264] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:08:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:10.030510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067531dd-ac4b-438f-84f7-208fa4c73cc8 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:10.105642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:10.143249 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067531dd-ac4b-438f-84f7-208fa4c73cc8 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:10.180449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999b651-b5ea-472c-80ad-dcb4a348d7e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:10.181085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999b651-b5ea-472c-80ad-dcb4a348d7e4 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:10.181365 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999b651-b5ea-472c-80ad-dcb4a348d7e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:10.181636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999b651-b5ea-472c-80ad-dcb4a348d7e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:10.193456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999b651-b5ea-472c-80ad-dcb4a348d7e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:10.194971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999b651-b5ea-472c-80ad-dcb4a348d7e4 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-c999b651-b5ea-472c-80ad-dcb4a348d7e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:08:10.210542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:10.215910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:08:10.217436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:08:10.217436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:10.217436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:08:10.217436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 630/1265] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:10.218217 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a927bf-bbf3-419d-8e34-848290b19266 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:10.306397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:10.328222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a927bf-bbf3-419d-8e34-848290b19266 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:10.370397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b317b-417c-4984-8e32-fca086eea9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:10.371021 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b317b-417c-4984-8e32-fca086eea9dc None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:10.371302 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b317b-417c-4984-8e32-fca086eea9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:10.371571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b317b-417c-4984-8e32-fca086eea9dc None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:10.372225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b317b-417c-4984-8e32-fca086eea9dc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:10.372524 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b317b-417c-4984-8e32-fca086eea9dc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:10.373927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211b317b-417c-4984-8e32-fca086eea9dc None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:10.388317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 636/1266] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:10.394630 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999b651-b5ea-472c-80ad-dcb4a348d7e4 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:10.507970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999b651-b5ea-472c-80ad-dcb4a348d7e4 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:10.528535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:10.546969 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf9288-7959-4270-93fe-7afe4d0e37f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:10.547611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf9288-7959-4270-93fe-7afe4d0e37f1 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:10.548487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf9288-7959-4270-93fe-7afe4d0e37f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:10.548487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcf9288-7959-4270-93fe-7afe4d0e37f1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:10.558061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf9288-7959-4270-93fe-7afe4d0e37f1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:10.559536 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcf9288-7959-4270-93fe-7afe4d0e37f1 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-bdcf9288-7959-4270-93fe-7afe4d0e37f1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:08:10.571643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:10.572823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:10.573807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:10.573807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:10.573807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:08:10.573807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:08:10.573807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:08:10.573807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:08:10.573807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:08:10.573807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:08:10.573807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 19:08:10.573807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:08:10.573807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 631/1267] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:08:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:10.579606 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b317b-417c-4984-8e32-fca086eea9dc None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:10.708866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211b317b-417c-4984-8e32-fca086eea9dc None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:10.751909 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7c123-2f14-45f3-84a6-b68be6eb2e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:10.752529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7c123-2f14-45f3-84a6-b68be6eb2e04 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:10.752809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7c123-2f14-45f3-84a6-b68be6eb2e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:10.753075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a7c123-2f14-45f3-84a6-b68be6eb2e04 None admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:10.753820 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7c123-2f14-45f3-84a6-b68be6eb2e04 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:10.754146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7c123-2f14-45f3-84a6-b68be6eb2e04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:10.755605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a7c123-2f14-45f3-84a6-b68be6eb2e04 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:10.766944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:10.778247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 637/1268] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 15 19:08:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:10.785146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf9288-7959-4270-93fe-7afe4d0e37f1 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:10.913131 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcf9288-7959-4270-93fe-7afe4d0e37f1 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:10.956554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04393d57-c2f0-40e4-ac65-2af6d3d04202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:10.957213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04393d57-c2f0-40e4-ac65-2af6d3d04202 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:10.957769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04393d57-c2f0-40e4-ac65-2af6d3d04202 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:10.958277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04393d57-c2f0-40e4-ac65-2af6d3d04202 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:10.974327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04393d57-c2f0-40e4-ac65-2af6d3d04202 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:10.976350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04393d57-c2f0-40e4-ac65-2af6d3d04202 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-04393d57-c2f0-40e4-ac65-2af6d3d04202 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:08:10.996848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:10.998049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:08:10.999187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:08:10.999187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:10.999187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:08:10.999187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 632/1269] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:11.005221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7c123-2f14-45f3-84a6-b68be6eb2e04 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:11.120649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a7c123-2f14-45f3-84a6-b68be6eb2e04 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:11.157618 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc852f-fbc8-40de-bda1-8592e1456d04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:11.158237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc852f-fbc8-40de-bda1-8592e1456d04 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:11.158514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc852f-fbc8-40de-bda1-8592e1456d04 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:11.158779 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedc852f-fbc8-40de-bda1-8592e1456d04 None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:11.159422 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc852f-fbc8-40de-bda1-8592e1456d04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:11.159722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc852f-fbc8-40de-bda1-8592e1456d04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:11.161089 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedc852f-fbc8-40de-bda1-8592e1456d04 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:11.174177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 638/1270] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:08:11.183519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04393d57-c2f0-40e4-ac65-2af6d3d04202 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:11.219156 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:11.302881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04393d57-c2f0-40e4-ac65-2af6d3d04202 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:11.348378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ac9e8-1cde-45bc-bdb4-b3eaa5bc506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:11.349404 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ac9e8-1cde-45bc-bdb4-b3eaa5bc506b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:11.349874 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ac9e8-1cde-45bc-bdb4-b3eaa5bc506b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:11.350365 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782ac9e8-1cde-45bc-bdb4-b3eaa5bc506b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:11.362125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ac9e8-1cde-45bc-bdb4-b3eaa5bc506b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:11.364484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782ac9e8-1cde-45bc-bdb4-b3eaa5bc506b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-782ac9e8-1cde-45bc-bdb4-b3eaa5bc506b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:08:11.382469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:11.383563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:11.390744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:08:11.390744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:08:11.390744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:08:11.390744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:08:11.390744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:08:11.390744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:08:11.390744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:08:11.390744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:08:11.390744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 633/1271] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:11.393863 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc852f-fbc8-40de-bda1-8592e1456d04 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:11.479964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:11.534770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedc852f-fbc8-40de-bda1-8592e1456d04 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:11.581119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ed5643-e059-4883-b791-2b0e6d4be8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:11.582339 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5643-e059-4883-b791-2b0e6d4be8ce None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:11.582601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5643-e059-4883-b791-2b0e6d4be8ce None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:11.582873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ed5643-e059-4883-b791-2b0e6d4be8ce None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:11.583577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed5643-e059-4883-b791-2b0e6d4be8ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:11.583885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed5643-e059-4883-b791-2b0e6d4be8ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:11.585330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ed5643-e059-4883-b791-2b0e6d4be8ce None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:11.598853 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 639/1272] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:11.606847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ac9e8-1cde-45bc-bdb4-b3eaa5bc506b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:11.714823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:11.725488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782ac9e8-1cde-45bc-bdb4-b3eaa5bc506b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:11.761865 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dae8c7e-f658-4fd3-b358-2a2651c8546a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:11.762531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae8c7e-f658-4fd3-b358-2a2651c8546a None admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:11.762803 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae8c7e-f658-4fd3-b358-2a2651c8546a None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:11.763070 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dae8c7e-f658-4fd3-b358-2a2651c8546a None admin] PATH_INFO: `/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/35d5f3ec00844cf28c01a14f8a071a69/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:11.765235 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae8c7e-f658-4fd3-b358-2a2651c8546a None admin] RBAC: Authorizing `identity:create_grant(project_id=2958a115e7974fc4b5c74a633fc4322c, user_id=35d5f3ec00844cf28c01a14f8a071a69, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:11.766697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dae8c7e-f658-4fd3-b358-2a2651c8546a None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:11.785733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 634/1273] 10.222.0.25 () {58 vars in 1439 bytes} [Thu Sep 15 19:08:11 2022] PUT /identity/v3/projects/2958a115e7974fc4b5c74a633fc4322c/users/35d5f3ec00844cf28c01a14f8a071a69/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:08:14.011690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825adf5-a4b2-42ad-8dcf-4f3921203503 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:14.012288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825adf5-a4b2-42ad-8dcf-4f3921203503 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:14.012288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825adf5-a4b2-42ad-8dcf-4f3921203503 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:14.013560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 640/1274] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:08:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:08:14.019158 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f806c-5fda-499f-bdf7-d6e55c8d96c0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:14.019607 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f806c-5fda-499f-bdf7-d6e55c8d96c0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:14.019698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940f806c-5fda-499f-bdf7-d6e55c8d96c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:14.039434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-940f806c-5fda-499f-bdf7-d6e55c8d96c0 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:08:14.040664 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-940f806c-5fda-499f-bdf7-d6e55c8d96c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:08:14.114963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 635/1275] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:08:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:08:14.379531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825adf5-a4b2-42ad-8dcf-4f3921203503 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:14.487211 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e825adf5-a4b2-42ad-8dcf-4f3921203503 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:14.504825 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:14.523937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900da61-57e0-449f-a50b-2a016fc2ab93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:14.524600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900da61-57e0-449f-a50b-2a016fc2ab93 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:14.524868 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900da61-57e0-449f-a50b-2a016fc2ab93 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:14.525134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8900da61-57e0-449f-a50b-2a016fc2ab93 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:14.536288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8900da61-57e0-449f-a50b-2a016fc2ab93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-8900da61-57e0-449f-a50b-2a016fc2ab93 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 15 19:08:14.541033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:14.542966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:14.544088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:14.544088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:14.544088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:14.544088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:14.544088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 15 19:08:14.544088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 15 19:08:14.544088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 15 19:08:14.544088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 15 19:08:14.544088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 15 19:08:14.544088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 15 19:08:14.544088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 15 19:08:14.544088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:14.544088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 641/1276] 10.222.0.25 () {56 vars in 1096 bytes} [Thu Sep 15 19:08:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:14.548779 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f806c-5fda-499f-bdf7-d6e55c8d96c0 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:14.635435 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:14.656992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940f806c-5fda-499f-bdf7-d6e55c8d96c0 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:14.693153 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e52ba-a1d8-4a5d-a03c-cd2321ce9b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:14.693764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e52ba-a1d8-4a5d-a03c-cd2321ce9b91 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:14.694071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e52ba-a1d8-4a5d-a03c-cd2321ce9b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:14.694345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608e52ba-a1d8-4a5d-a03c-cd2321ce9b91 None admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:14.694987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e52ba-a1d8-4a5d-a03c-cd2321ce9b91 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:14.695288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e52ba-a1d8-4a5d-a03c-cd2321ce9b91 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:14.696663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608e52ba-a1d8-4a5d-a03c-cd2321ce9b91 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:14.705363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 636/1277] 10.222.0.25 () {56 vars in 1099 bytes} [Thu Sep 15 19:08:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:14.711550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900da61-57e0-449f-a50b-2a016fc2ab93 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:14.819371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8900da61-57e0-449f-a50b-2a016fc2ab93 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:14.855785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f832871-be93-4cdc-81e9-841dd64e4cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:14.856411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f832871-be93-4cdc-81e9-841dd64e4cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:14.856687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f832871-be93-4cdc-81e9-841dd64e4cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:14.856954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f832871-be93-4cdc-81e9-841dd64e4cf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:14.868158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f832871-be93-4cdc-81e9-841dd64e4cf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:14.869693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f832871-be93-4cdc-81e9-841dd64e4cf5 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-4f832871-be93-4cdc-81e9-841dd64e4cf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:08:14.885821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:14.886978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:08:14.888045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:08:14.888045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:14.888045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:14.888045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 642/1278] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:14.893346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e52ba-a1d8-4a5d-a03c-cd2321ce9b91 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:15.008802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608e52ba-a1d8-4a5d-a03c-cd2321ce9b91 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:15.043691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b0bbd-6ac9-4041-b1b3-ee71e13aed50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:15.044315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b0bbd-6ac9-4041-b1b3-ee71e13aed50 None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:15.044555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b0bbd-6ac9-4041-b1b3-ee71e13aed50 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:15.044828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b0bbd-6ac9-4041-b1b3-ee71e13aed50 None admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:15.045471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b0bbd-6ac9-4041-b1b3-ee71e13aed50 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:15.045831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b0bbd-6ac9-4041-b1b3-ee71e13aed50 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:15.047220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474b0bbd-6ac9-4041-b1b3-ee71e13aed50 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:15.059189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 637/1279] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:15.065301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f832871-be93-4cdc-81e9-841dd64e4cf5 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:15.098500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:15.173755 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f832871-be93-4cdc-81e9-841dd64e4cf5 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:15.209715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703510c-705c-4697-a36f-b7988d02da32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:15.210377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703510c-705c-4697-a36f-b7988d02da32 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:15.210652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703510c-705c-4697-a36f-b7988d02da32 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:15.210919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7703510c-705c-4697-a36f-b7988d02da32 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:15.219291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703510c-705c-4697-a36f-b7988d02da32 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:15.220753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7703510c-705c-4697-a36f-b7988d02da32 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-7703510c-705c-4697-a36f-b7988d02da32 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 15 19:08:15.232072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:15.233175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:15.234192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:15.234192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:15.234192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 15 19:08:15.234192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 15 19:08:15.234192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 15 19:08:15.234192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 15 19:08:15.234192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 15 19:08:15.234192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 15 19:08:15.234192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 15 19:08:15.234192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:15.234192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 643/1280] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:08:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:15.239346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b0bbd-6ac9-4041-b1b3-ee71e13aed50 None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:15.243266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:15.346192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474b0bbd-6ac9-4041-b1b3-ee71e13aed50 None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:15.381412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a900e-8c1e-4fc3-8391-598d9f1ede5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:15.382052 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a900e-8c1e-4fc3-8391-598d9f1ede5b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:15.382345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a900e-8c1e-4fc3-8391-598d9f1ede5b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:15.382609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571a900e-8c1e-4fc3-8391-598d9f1ede5b None admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:15.383340 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a900e-8c1e-4fc3-8391-598d9f1ede5b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:15.383643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a900e-8c1e-4fc3-8391-598d9f1ede5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:15.385172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571a900e-8c1e-4fc3-8391-598d9f1ede5b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:15.403694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 638/1281] 10.222.0.25 () {56 vars in 1143 bytes} [Thu Sep 15 19:08:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:15.409920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703510c-705c-4697-a36f-b7988d02da32 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:15.504161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:15.515746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7703510c-705c-4697-a36f-b7988d02da32 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:15.551195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75955583-04be-4907-8428-3eb6e1a81cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:15.551810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955583-04be-4907-8428-3eb6e1a81cbd None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:15.552085 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955583-04be-4907-8428-3eb6e1a81cbd None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:15.552352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75955583-04be-4907-8428-3eb6e1a81cbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:15.626083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75955583-04be-4907-8428-3eb6e1a81cbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:15.627544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75955583-04be-4907-8428-3eb6e1a81cbd None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:15.720846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:15.732285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 644/1282] 10.222.0.25 () {58 vars in 1282 bytes} [Thu Sep 15 19:08:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 15 19:08:15.738592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a900e-8c1e-4fc3-8391-598d9f1ede5b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:15.804992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:15.847120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571a900e-8c1e-4fc3-8391-598d9f1ede5b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:15.884697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ce421-8f2a-4ccb-bdba-a20544e4c2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:15.885497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ce421-8f2a-4ccb-bdba-a20544e4c2ff None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:15.885702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ce421-8f2a-4ccb-bdba-a20544e4c2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:15.886036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2ce421-8f2a-4ccb-bdba-a20544e4c2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:15.897310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ce421-8f2a-4ccb-bdba-a20544e4c2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:15.898781 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2ce421-8f2a-4ccb-bdba-a20544e4c2ff None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-bb2ce421-8f2a-4ccb-bdba-a20544e4c2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 15 19:08:15.914327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:15.915429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 15 19:08:15.916507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 15 19:08:15.916507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 15 19:08:15.916507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:08:15.916507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 639/1283] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:15.921482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75955583-04be-4907-8428-3eb6e1a81cbd None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:16.025769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75955583-04be-4907-8428-3eb6e1a81cbd None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:16.060720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37b8e5-cbca-4a2a-ba9a-2c8909db25eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:16.061253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37b8e5-cbca-4a2a-ba9a-2c8909db25eb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:16.061513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37b8e5-cbca-4a2a-ba9a-2c8909db25eb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:16.061798 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c37b8e5-cbca-4a2a-ba9a-2c8909db25eb None admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:16.062470 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37b8e5-cbca-4a2a-ba9a-2c8909db25eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:16.062777 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37b8e5-cbca-4a2a-ba9a-2c8909db25eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:16.064148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c37b8e5-cbca-4a2a-ba9a-2c8909db25eb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:16.076087 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 645/1284] 10.222.0.25 () {56 vars in 1109 bytes} [Thu Sep 15 19:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:16.082220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ce421-8f2a-4ccb-bdba-a20544e4c2ff None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:16.185550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2ce421-8f2a-4ccb-bdba-a20544e4c2ff None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:16.199505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:16.222484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f380db-ca72-4c8b-8e4d-3be9cf2ada3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:16.223107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f380db-ca72-4c8b-8e4d-3be9cf2ada3b None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:16.223382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f380db-ca72-4c8b-8e4d-3be9cf2ada3b None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:16.223648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f380db-ca72-4c8b-8e4d-3be9cf2ada3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:16.230562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f380db-ca72-4c8b-8e4d-3be9cf2ada3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:16.232000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f380db-ca72-4c8b-8e4d-3be9cf2ada3b None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application [None req-87f380db-ca72-4c8b-8e4d-3be9cf2ada3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 15 19:08:16.243587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:16.245991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:16.247213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 15 19:08:16.247213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 15 19:08:16.247213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 15 19:08:16.247213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 15 19:08:16.247213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 15 19:08:16.247213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 15 19:08:16.247213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 15 19:08:16.247213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: ERROR keystone.server.flask.application Sep 15 19:08:16.247213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 640/1285] 10.222.0.25 () {56 vars in 1111 bytes} [Thu Sep 15 19:08:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:16.250927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37b8e5-cbca-4a2a-ba9a-2c8909db25eb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:16.303977 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:16.356844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c37b8e5-cbca-4a2a-ba9a-2c8909db25eb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:16.390612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bca4e19-4093-4c84-abd4-2ba7b6e01bd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:16.391215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca4e19-4093-4c84-abd4-2ba7b6e01bd2 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:16.391487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca4e19-4093-4c84-abd4-2ba7b6e01bd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:16.391757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bca4e19-4093-4c84-abd4-2ba7b6e01bd2 None admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:16.392441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca4e19-4093-4c84-abd4-2ba7b6e01bd2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:16.392740 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca4e19-4093-4c84-abd4-2ba7b6e01bd2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:16.394186 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bca4e19-4093-4c84-abd4-2ba7b6e01bd2 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:16.406128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 646/1286] 10.222.0.25 () {56 vars in 1148 bytes} [Thu Sep 15 19:08:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:16.412498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f380db-ca72-4c8b-8e4d-3be9cf2ada3b None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:16.519605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f380db-ca72-4c8b-8e4d-3be9cf2ada3b None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:16.556876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742ec4ca-5cf7-42af-8334-a4cfc2f1fa0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:16.557485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ec4ca-5cf7-42af-8334-a4cfc2f1fa0d None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:16.557732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ec4ca-5cf7-42af-8334-a4cfc2f1fa0d None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:16.558061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742ec4ca-5cf7-42af-8334-a4cfc2f1fa0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:16.558785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ec4ca-5cf7-42af-8334-a4cfc2f1fa0d None admin] RBAC: Adding query filter params (role.id=8c827c3f69ef45bfa17c290bf2a29333, scope.project.id=2958a115e7974fc4b5c74a633fc4322c, user.id=35d5f3ec00844cf28c01a14f8a071a69) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:16.559093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ec4ca-5cf7-42af-8334-a4cfc2f1fa0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:16.560554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-742ec4ca-5cf7-42af-8334-a4cfc2f1fa0d None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:16.566559 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 641/1287] 10.222.0.25 () {56 vars in 1374 bytes} [Thu Sep 15 19:08:16 2022] GET /identity/v3/role_assignments?user.id=35d5f3ec00844cf28c01a14f8a071a69&scope.project.id=2958a115e7974fc4b5c74a633fc4322c&role.id=8c827c3f69ef45bfa17c290bf2a29333 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:18.719244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68550ec0-c336-48bf-ab96-1507658de835 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:18.719872 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68550ec0-c336-48bf-ab96-1507658de835 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:18.719872 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68550ec0-c336-48bf-ab96-1507658de835 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:18.721041 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 647/1288] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:08:18.726493 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba2012-8039-47f7-bc3f-146060d02f78 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:18.726928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba2012-8039-47f7-bc3f-146060d02f78 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:18.727026 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ba2012-8039-47f7-bc3f-146060d02f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:18.746714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e1ba2012-8039-47f7-bc3f-146060d02f78 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:08:18.747919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e1ba2012-8039-47f7-bc3f-146060d02f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:08:18.779651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:18.819327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 642/1289] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:08:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:08:19.109905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68550ec0-c336-48bf-ab96-1507658de835 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:19.219959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68550ec0-c336-48bf-ab96-1507658de835 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:19.230930 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:19.256090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e4da8-9319-450c-81ef-22a28acf2ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:19.256714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e4da8-9319-450c-81ef-22a28acf2ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:19.256986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e4da8-9319-450c-81ef-22a28acf2ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:19.257257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9e4da8-9319-450c-81ef-22a28acf2ad3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:19.257868 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e4da8-9319-450c-81ef-22a28acf2ad3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:19.259227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f9e4da8-9319-450c-81ef-22a28acf2ad3 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-6f9e4da8-9319-450c-81ef-22a28acf2ad3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:19.268291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:19.269654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:19.270837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 648/1290] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 19:08:19 2022] GET /identity/v3/services/placement => generated 90 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:19.275673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba2012-8039-47f7-bc3f-146060d02f78 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:19.382754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ba2012-8039-47f7-bc3f-146060d02f78 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:19.420660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1457dde9-0bc4-4e16-845d-36eff24e7c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:19.421280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457dde9-0bc4-4e16-845d-36eff24e7c5f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:19.421549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457dde9-0bc4-4e16-845d-36eff24e7c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:19.421829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1457dde9-0bc4-4e16-845d-36eff24e7c5f None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:19.422478 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457dde9-0bc4-4e16-845d-36eff24e7c5f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:19.422791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457dde9-0bc4-4e16-845d-36eff24e7c5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:19.424148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1457dde9-0bc4-4e16-845d-36eff24e7c5f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:19.429817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 643/1291] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Sep 15 19:08:19 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:19.435992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e4da8-9319-450c-81ef-22a28acf2ad3 None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:19.539951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9e4da8-9319-450c-81ef-22a28acf2ad3 None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:19.576785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394a0aa-0850-423a-996d-7f905b089f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:19.577402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a0aa-0850-423a-996d-7f905b089f98 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:19.577680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a0aa-0850-423a-996d-7f905b089f98 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:19.577979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394a0aa-0850-423a-996d-7f905b089f98 None admin] PATH_INFO: `/v3/services` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:19.578618 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394a0aa-0850-423a-996d-7f905b089f98 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:19.578922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394a0aa-0850-423a-996d-7f905b089f98 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:19.580300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394a0aa-0850-423a-996d-7f905b089f98 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:19.584812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 649/1292] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Sep 15 19:08:19 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:21.706742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadae62-f6e6-4058-b2e3-f41df144c15e None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:21.707294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadae62-f6e6-4058-b2e3-f41df144c15e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:21.707294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dadae62-f6e6-4058-b2e3-f41df144c15e None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:21.708522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 644/1293] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:08:21.714752 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48760c00-83d0-4a69-9f45-f5d5fe395b02 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:21.715179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48760c00-83d0-4a69-9f45-f5d5fe395b02 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:21.715278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48760c00-83d0-4a69-9f45-f5d5fe395b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:21.735419 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-48760c00-83d0-4a69-9f45-f5d5fe395b02 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:08:21.736620 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-48760c00-83d0-4a69-9f45-f5d5fe395b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:08:21.768100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:21.808154 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 650/1294] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:08:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:08:22.079329 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadae62-f6e6-4058-b2e3-f41df144c15e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:22.112201 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:22.185993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dadae62-f6e6-4058-b2e3-f41df144c15e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:22.221794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2dee19-769f-4f9d-a59b-ee1b4a8a8485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:22.222418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dee19-769f-4f9d-a59b-ee1b4a8a8485 None admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:22.222875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dee19-769f-4f9d-a59b-ee1b4a8a8485 None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:22.223276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2dee19-769f-4f9d-a59b-ee1b4a8a8485 None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:22.223926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dee19-769f-4f9d-a59b-ee1b4a8a8485 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:22.225292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2dee19-769f-4f9d-a59b-ee1b4a8a8485 None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:22.242607 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 645/1295] 10.222.0.25 () {60 vars in 1141 bytes} [Thu Sep 15 19:08:22 2022] POST /identity/v3/services => generated 246 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:08:24.433219 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfab9c-19fe-4296-83a7-8c9ff55191ec None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:24.433827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfab9c-19fe-4296-83a7-8c9ff55191ec None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:24.433827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfab9c-19fe-4296-83a7-8c9ff55191ec None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:24.435138 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 651/1296] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:08:24.440638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3887004-658d-46fa-84dc-b498ff133517 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:24.441099 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3887004-658d-46fa-84dc-b498ff133517 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:24.441197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3887004-658d-46fa-84dc-b498ff133517 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:24.460734 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e3887004-658d-46fa-84dc-b498ff133517 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:08:24.462007 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e3887004-658d-46fa-84dc-b498ff133517 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:08:24.543188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 646/1297] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:08:24 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:08:24.817346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfab9c-19fe-4296-83a7-8c9ff55191ec None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:24.926525 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfab9c-19fe-4296-83a7-8c9ff55191ec None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:24.967209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba604a-26dd-4821-820d-7b429c0c917e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:24.967848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba604a-26dd-4821-820d-7b429c0c917e None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:24.968132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba604a-26dd-4821-820d-7b429c0c917e None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:24.968397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ba604a-26dd-4821-820d-7b429c0c917e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:24.968986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba604a-26dd-4821-820d-7b429c0c917e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:24.970406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ba604a-26dd-4821-820d-7b429c0c917e None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-d8ba604a-26dd-4821-820d-7b429c0c917e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:24.980001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:24.981204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:24.982290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 652/1298] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 19:08:24 2022] GET /identity/v3/services/placement => generated 90 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:24.987481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3887004-658d-46fa-84dc-b498ff133517 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:25.008423 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:25.094662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3887004-658d-46fa-84dc-b498ff133517 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:25.142278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594376ea-66cf-4373-9607-820e5051662f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:25.142961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594376ea-66cf-4373-9607-820e5051662f None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:25.143237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594376ea-66cf-4373-9607-820e5051662f None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:25.143505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594376ea-66cf-4373-9607-820e5051662f None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:25.144144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594376ea-66cf-4373-9607-820e5051662f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:25.144444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594376ea-66cf-4373-9607-820e5051662f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:25.145877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594376ea-66cf-4373-9607-820e5051662f None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:25.152636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 647/1299] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Sep 15 19:08:24 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:25.158943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba604a-26dd-4821-820d-7b429c0c917e None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:25.193714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:25.265024 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ba604a-26dd-4821-820d-7b429c0c917e None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:25.301264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfd677c-00ea-4f20-b29d-2b09cf16b796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:25.301924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd677c-00ea-4f20-b29d-2b09cf16b796 None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:25.302200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd677c-00ea-4f20-b29d-2b09cf16b796 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:25.302471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfd677c-00ea-4f20-b29d-2b09cf16b796 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:25.303172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd677c-00ea-4f20-b29d-2b09cf16b796 None admin] RBAC: Adding query filter params (interface=public, service_id=e13629e42b8448eabf69f6e1d81f4a6f, region_id=RegionOne) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:25.303475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd677c-00ea-4f20-b29d-2b09cf16b796 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:25.304848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfd677c-00ea-4f20-b29d-2b09cf16b796 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:25.310524 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 653/1300] 10.222.0.25 () {56 vars in 1251 bytes} [Thu Sep 15 19:08:25 2022] GET /identity/v3/endpoints?service_id=e13629e42b8448eabf69f6e1d81f4a6f&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:08:25.316443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594376ea-66cf-4373-9607-820e5051662f None admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:25.402688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:25.422269 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594376ea-66cf-4373-9607-820e5051662f None admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:25.457800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62943de3-a87b-44ba-9b98-df56dc86510e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:25.458481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62943de3-a87b-44ba-9b98-df56dc86510e None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:25.458789 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62943de3-a87b-44ba-9b98-df56dc86510e None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:25.459057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62943de3-a87b-44ba-9b98-df56dc86510e None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:25.459660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62943de3-a87b-44ba-9b98-df56dc86510e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:25.461067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62943de3-a87b-44ba-9b98-df56dc86510e None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:25.468969 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 648/1301] 10.222.0.25 () {56 vars in 1087 bytes} [Thu Sep 15 19:08:25 2022] GET /identity/v3/services => generated 2191 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:08:27.589887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806e710-3d75-4aa9-a162-71f85ab5def2 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:27.590432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806e710-3d75-4aa9-a162-71f85ab5def2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:27.590432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f806e710-3d75-4aa9-a162-71f85ab5def2 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:27.591997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 654/1302] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:08:27.597361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe66b56-5c91-44e4-94e9-2d33f88f9318 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:27.597832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe66b56-5c91-44e4-94e9-2d33f88f9318 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:27.597928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe66b56-5c91-44e4-94e9-2d33f88f9318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:27.616997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9fe66b56-5c91-44e4-94e9-2d33f88f9318 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:08:27.618230 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9fe66b56-5c91-44e4-94e9-2d33f88f9318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:08:27.687012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 649/1303] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:08:27 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 15 19:08:27.953127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806e710-3d75-4aa9-a162-71f85ab5def2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:28.053417 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:28.061387 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f806e710-3d75-4aa9-a162-71f85ab5def2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:28.097260 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e6961-84cb-47dc-9f12-15934ea687cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:28.097925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e6961-84cb-47dc-9f12-15934ea687cb None admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:28.098202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e6961-84cb-47dc-9f12-15934ea687cb None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:28.098454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e6961-84cb-47dc-9f12-15934ea687cb None admin] PATH_INFO: `/v3/services/placement` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:28.099042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e6961-84cb-47dc-9f12-15934ea687cb None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:28.100431 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990e6961-84cb-47dc-9f12-15934ea687cb None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application [None req-990e6961-84cb-47dc-9f12-15934ea687cb None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 15 19:08:28.110445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 15 19:08:28.111662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.get_or_create( Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application with Lock( Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self._enter() Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application return self.creator() Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application created_value = creator( Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: ERROR keystone.server.flask.application Sep 15 19:08:28.112503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 655/1304] 10.222.0.25 () {56 vars in 1117 bytes} [Thu Sep 15 19:08:27 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 15 19:08:28.117825 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe66b56-5c91-44e4-94e9-2d33f88f9318 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:28.198524 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:28.223704 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe66b56-5c91-44e4-94e9-2d33f88f9318 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:28.259257 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf9b205-ecce-4159-8116-6a775dccd2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:28.259971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9b205-ecce-4159-8116-6a775dccd2bf None admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:28.260317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9b205-ecce-4159-8116-6a775dccd2bf None admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:28.260664 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf9b205-ecce-4159-8116-6a775dccd2bf None admin] PATH_INFO: `/v3/services` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:28.261420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9b205-ecce-4159-8116-6a775dccd2bf None admin] RBAC: Adding query filter params (name=placement) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:08:28.261725 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9b205-ecce-4159-8116-6a775dccd2bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:28.263142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf9b205-ecce-4159-8116-6a775dccd2bf None admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:28.268546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 650/1305] 10.222.0.25 () {56 vars in 1116 bytes} [Thu Sep 15 19:08:28 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:08:28.274617 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e6961-84cb-47dc-9f12-15934ea687cb None admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:08:28.386526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e6961-84cb-47dc-9f12-15934ea687cb None admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:08:28.420532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877efb37-5c44-4b36-aef2-58d82e0bd001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:08:28.421158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877efb37-5c44-4b36-aef2-58d82e0bd001 None admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:08:28.421443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877efb37-5c44-4b36-aef2-58d82e0bd001 None admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:08:28.421714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877efb37-5c44-4b36-aef2-58d82e0bd001 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:08:28.422443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877efb37-5c44-4b36-aef2-58d82e0bd001 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:08:28.423820 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877efb37-5c44-4b36-aef2-58d82e0bd001 None admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:08:28.445495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 656/1306] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:08:28 2022] POST /identity/v3/endpoints => generated 331 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:08:38.265343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=30 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:08:38.441160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:34.042281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c7346-c5da-4e45-acc1-32a4207e10b0 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:34.042844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c7346-c5da-4e45-acc1-32a4207e10b0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:34.042844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1c7346-c5da-4e45-acc1-32a4207e10b0 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:34.044165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 651/1307] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:09:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:09:34.049399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bc281-44be-4bd9-8b1b-7f04cae5743a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:34.049840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bc281-44be-4bd9-8b1b-7f04cae5743a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:34.050003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71bc281-44be-4bd9-8b1b-7f04cae5743a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:34.167149 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d71bc281-44be-4bd9-8b1b-7f04cae5743a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:09:34.168370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d71bc281-44be-4bd9-8b1b-7f04cae5743a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:34.289927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 657/1308] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:09:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:09:34.582338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b96ca-e3cf-4c26-a6a9-2603a804a320 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:34.582794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b96ca-e3cf-4c26-a6a9-2603a804a320 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:34.583146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b96ca-e3cf-4c26-a6a9-2603a804a320 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:34.584948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 652/1309] 10.222.0.25 () {54 vars in 965 bytes} [Thu Sep 15 19:09:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:09:34.591782 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f08af0-c321-4dba-b013-b14e906cdc22 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:34.592099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f08af0-c321-4dba-b013-b14e906cdc22 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:34.592331 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f08af0-c321-4dba-b013-b14e906cdc22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:34.687883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-79f08af0-c321-4dba-b013-b14e906cdc22 None None] MFA Rules not processed for user `4591e01ab4954b22a81f6b09cdb2d544`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:09:34.689392 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-79f08af0-c321-4dba-b013-b14e906cdc22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:34.712563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:34.772739 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 658/1310] 10.222.0.25 () {58 vars in 1062 bytes} [Thu Sep 15 19:09:34 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:09:34.781509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b96ca-e3cf-4c26-a6a9-2603a804a320 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:09:34.783272 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-926b96ca-e3cf-4c26-a6a9-2603a804a320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:34.895540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b96ca-e3cf-4c26-a6a9-2603a804a320 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:09:34.976573 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba81e76-9df7-4c3a-b31c-fd259d96ee97 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:09:34.977098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba81e76-9df7-4c3a-b31c-fd259d96ee97 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:34.977352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba81e76-9df7-4c3a-b31c-fd259d96ee97 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:34.977610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba81e76-9df7-4c3a-b31c-fd259d96ee97 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:34.979283 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5ba81e76-9df7-4c3a-b31c-fd259d96ee97 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:35.038624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:35.101035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba81e76-9df7-4c3a-b31c-fd259d96ee97 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:09:35.102629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba81e76-9df7-4c3a-b31c-fd259d96ee97 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:09:35.122344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 653/1311] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:09:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:09:37.640806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4a7d3-184b-4f64-9abd-81201e9ff5dc None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:37.641405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4a7d3-184b-4f64-9abd-81201e9ff5dc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:37.641405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c4a7d3-184b-4f64-9abd-81201e9ff5dc None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:37.642740 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 659/1312] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:09:37.648369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f892b-a101-425d-aa60-32040b26d939 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:37.648918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f892b-a101-425d-aa60-32040b26d939 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:37.648918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5f892b-a101-425d-aa60-32040b26d939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:37.722020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ae5f892b-a101-425d-aa60-32040b26d939 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:09:37.723224 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ae5f892b-a101-425d-aa60-32040b26d939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:37.832035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 654/1313] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:09:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:09:38.134368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd971e4-147f-4803-812a-70cca634c5b6 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:38.134651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd971e4-147f-4803-812a-70cca634c5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:38.134918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd971e4-147f-4803-812a-70cca634c5b6 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:38.136285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 660/1314] 10.222.0.25 () {54 vars in 965 bytes} [Thu Sep 15 19:09:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:09:38.142490 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8bba-69a3-4a4b-948f-16b931262bd3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:38.142782 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8bba-69a3-4a4b-948f-16b931262bd3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:38.143053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f8bba-69a3-4a4b-948f-16b931262bd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:38.155433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:38.227944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-666f8bba-69a3-4a4b-948f-16b931262bd3 None None] MFA Rules not processed for user `4591e01ab4954b22a81f6b09cdb2d544`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:09:38.229182 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-666f8bba-69a3-4a4b-948f-16b931262bd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:38.325455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 655/1315] 10.222.0.25 () {58 vars in 1062 bytes} [Thu Sep 15 19:09:38 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:09:38.335135 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd971e4-147f-4803-812a-70cca634c5b6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:09:38.336716 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7dd971e4-147f-4803-812a-70cca634c5b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:38.451798 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd971e4-147f-4803-812a-70cca634c5b6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:09:38.527224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:38.529986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1650138d-6ccc-469c-9aca-058db0c0da82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:09:38.530665 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650138d-6ccc-469c-9aca-058db0c0da82 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:38.530938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650138d-6ccc-469c-9aca-058db0c0da82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:38.531458 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1650138d-6ccc-469c-9aca-058db0c0da82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:38.533455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1650138d-6ccc-469c-9aca-058db0c0da82 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:38.648448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650138d-6ccc-469c-9aca-058db0c0da82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:09:38.649811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1650138d-6ccc-469c-9aca-058db0c0da82 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:09:38.669326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 661/1316] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:09:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:09:41.396963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655add-8af7-42f6-829b-23a431af42c3 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:41.397552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655add-8af7-42f6-829b-23a431af42c3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:41.397552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87655add-8af7-42f6-829b-23a431af42c3 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:41.398898 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 656/1317] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:09:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:09:41.404780 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0362a9-c41c-400e-97f9-2d347a052e7c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:41.405225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0362a9-c41c-400e-97f9-2d347a052e7c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:41.405339 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0362a9-c41c-400e-97f9-2d347a052e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:41.473929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ca0362a9-c41c-400e-97f9-2d347a052e7c None None] MFA Rules not processed for user `b7178f44ee68469b88cc62895e6492a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:09:41.475162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ca0362a9-c41c-400e-97f9-2d347a052e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:41.531730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:41.579537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 662/1318] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:09:41 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:09:41.870365 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87655add-8af7-42f6-829b-23a431af42c3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:09:41.873066 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-87655add-8af7-42f6-829b-23a431af42c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:42.003911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87655add-8af7-42f6-829b-23a431af42c3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:09:42.006775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:42.089166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd29c609-101b-4150-a52c-1e8305a9c955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:09:42.089769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29c609-101b-4150-a52c-1e8305a9c955 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:42.090072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29c609-101b-4150-a52c-1e8305a9c955 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:42.090341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd29c609-101b-4150-a52c-1e8305a9c955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:42.091897 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cd29c609-101b-4150-a52c-1e8305a9c955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:42.203197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29c609-101b-4150-a52c-1e8305a9c955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:09:42.204542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd29c609-101b-4150-a52c-1e8305a9c955 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:09:42.223670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 657/1319] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:09:41 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:09:44.964485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd44d61-23e3-4469-850e-f8d23d65ab4f None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:44.965055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd44d61-23e3-4469-850e-f8d23d65ab4f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:44.965055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd44d61-23e3-4469-850e-f8d23d65ab4f None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:44.966425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 663/1320] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:09:44.973619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41eb8a-770d-400f-9d08-a656a38f6f47 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:44.974148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41eb8a-770d-400f-9d08-a656a38f6f47 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:44.974270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c41eb8a-770d-400f-9d08-a656a38f6f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:45.020696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:45.048700 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1c41eb8a-770d-400f-9d08-a656a38f6f47 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:09:45.049954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1c41eb8a-770d-400f-9d08-a656a38f6f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:45.154548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 658/1321] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:09:44 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:09:45.444214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd44d61-23e3-4469-850e-f8d23d65ab4f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:09:45.445796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2dd44d61-23e3-4469-850e-f8d23d65ab4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:45.557382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd44d61-23e3-4469-850e-f8d23d65ab4f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:09:45.634158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda27ff2-9ee0-4a1d-8979-8bfa2dc120fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:09:45.634771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda27ff2-9ee0-4a1d-8979-8bfa2dc120fd service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:45.635045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda27ff2-9ee0-4a1d-8979-8bfa2dc120fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:45.635312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda27ff2-9ee0-4a1d-8979-8bfa2dc120fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:45.636913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-dda27ff2-9ee0-4a1d-8979-8bfa2dc120fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:45.644073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:45.753824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda27ff2-9ee0-4a1d-8979-8bfa2dc120fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:09:45.755343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda27ff2-9ee0-4a1d-8979-8bfa2dc120fd service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:09:45.775443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 664/1322] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:09:45 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:09:48.674693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ece32-47f9-42fb-97d1-8e5b07faf9dd None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:48.675218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ece32-47f9-42fb-97d1-8e5b07faf9dd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:48.675218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2ece32-47f9-42fb-97d1-8e5b07faf9dd None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:48.676661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 659/1323] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:09:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:09:48.683266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600250-7b10-4d97-8fae-c65c5bdf336b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:48.683826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600250-7b10-4d97-8fae-c65c5bdf336b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:48.683826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7600250-7b10-4d97-8fae-c65c5bdf336b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:48.765361 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a7600250-7b10-4d97-8fae-c65c5bdf336b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:09:48.766685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a7600250-7b10-4d97-8fae-c65c5bdf336b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:48.836736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:48.888512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 665/1324] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:09:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:09:49.170514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ece32-47f9-42fb-97d1-8e5b07faf9dd None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:09:49.172058 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5a2ece32-47f9-42fb-97d1-8e5b07faf9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:49.288146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2ece32-47f9-42fb-97d1-8e5b07faf9dd None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:09:49.302106 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:49.366014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d92e14-26a2-4dc0-ba70-84734d51ac4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:09:49.366627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d92e14-26a2-4dc0-ba70-84734d51ac4b service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:49.366899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d92e14-26a2-4dc0-ba70-84734d51ac4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:49.367181 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d92e14-26a2-4dc0-ba70-84734d51ac4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:49.368772 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-87d92e14-26a2-4dc0-ba70-84734d51ac4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:49.483369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d92e14-26a2-4dc0-ba70-84734d51ac4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:09:49.484815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d92e14-26a2-4dc0-ba70-84734d51ac4b service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:09:49.503558 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 660/1325] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:09:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:09:51.721771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea1c95-9d94-4309-9414-b54592ae8340 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:51.722749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea1c95-9d94-4309-9414-b54592ae8340 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:51.723023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fea1c95-9d94-4309-9414-b54592ae8340 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:51.724391 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 666/1326] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:09:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:09:51.730225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c7d3-8aca-423b-a4b6-d338c0cdd7f9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:51.730732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c7d3-8aca-423b-a4b6-d338c0cdd7f9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:51.730732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d7c7d3-8aca-423b-a4b6-d338c0cdd7f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:51.781416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:51.807464 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-15d7c7d3-8aca-423b-a4b6-d338c0cdd7f9 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:09:51.808773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-15d7c7d3-8aca-423b-a4b6-d338c0cdd7f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:51.912827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 661/1327] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:09:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:09:52.217098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea1c95-9d94-4309-9414-b54592ae8340 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:09:52.218717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9fea1c95-9d94-4309-9414-b54592ae8340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:52.335127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fea1c95-9d94-4309-9414-b54592ae8340 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:09:52.413053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b36b30-4774-46ae-86cf-2737840f8cdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:09:52.413641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b36b30-4774-46ae-86cf-2737840f8cdc service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:52.413947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b36b30-4774-46ae-86cf-2737840f8cdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:52.414214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b36b30-4774-46ae-86cf-2737840f8cdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:52.415823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-87b36b30-4774-46ae-86cf-2737840f8cdc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:52.434014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:52.533264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b36b30-4774-46ae-86cf-2737840f8cdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:09:52.534826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b36b30-4774-46ae-86cf-2737840f8cdc service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:09:52.553699 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 667/1328] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:09:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:09:54.778464 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02ee7e-b873-4d28-9a04-315729b75be5 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:54.779014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02ee7e-b873-4d28-9a04-315729b75be5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:54.779014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e02ee7e-b873-4d28-9a04-315729b75be5 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:54.780379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 662/1329] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:09:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:09:54.786036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22975b-a94d-4c54-89da-9e49f9a7e8fb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:54.786522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22975b-a94d-4c54-89da-9e49f9a7e8fb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:54.786634 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be22975b-a94d-4c54-89da-9e49f9a7e8fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:54.855718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-be22975b-a94d-4c54-89da-9e49f9a7e8fb None None] MFA Rules not processed for user `b7178f44ee68469b88cc62895e6492a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:09:54.856941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-be22975b-a94d-4c54-89da-9e49f9a7e8fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:54.933165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:54.967662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 668/1330] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:09:54 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:09:55.248298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02ee7e-b873-4d28-9a04-315729b75be5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:09:55.250222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6e02ee7e-b873-4d28-9a04-315729b75be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:55.380769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e02ee7e-b873-4d28-9a04-315729b75be5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:09:55.403481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:55.464236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26835e0b-f41f-4f52-b95c-e1c8dcaa651c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:09:55.464995 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26835e0b-f41f-4f52-b95c-e1c8dcaa651c service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:55.465274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26835e0b-f41f-4f52-b95c-e1c8dcaa651c service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:55.465540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26835e0b-f41f-4f52-b95c-e1c8dcaa651c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:55.467201 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-26835e0b-f41f-4f52-b95c-e1c8dcaa651c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:55.590965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26835e0b-f41f-4f52-b95c-e1c8dcaa651c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:09:55.592416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26835e0b-f41f-4f52-b95c-e1c8dcaa651c service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:09:55.612531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 663/1331] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:09:55 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:09:58.071762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef1d03-150b-4df4-adb4-5d16a3a0cdc8 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:58.072329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef1d03-150b-4df4-adb4-5d16a3a0cdc8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:58.072329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef1d03-150b-4df4-adb4-5d16a3a0cdc8 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:58.073642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 669/1332] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:09:58.079822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3be1f-7584-4ddc-bfac-c31c18c92431 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:58.080399 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3be1f-7584-4ddc-bfac-c31c18c92431 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:58.080495 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b3be1f-7584-4ddc-bfac-c31c18c92431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:58.154503 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:58.158490 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-61b3be1f-7584-4ddc-bfac-c31c18c92431 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:09:58.160984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-61b3be1f-7584-4ddc-bfac-c31c18c92431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:58.269339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 664/1333] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:09:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:09:58.560596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef1d03-150b-4df4-adb4-5d16a3a0cdc8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:09:58.562520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-04ef1d03-150b-4df4-adb4-5d16a3a0cdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:58.683396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef1d03-150b-4df4-adb4-5d16a3a0cdc8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:09:58.761687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7a213-f370-4e54-b9e7-0bbbd1b3b6d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:09:58.762344 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7a213-f370-4e54-b9e7-0bbbd1b3b6d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:09:58.762621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7a213-f370-4e54-b9e7-0bbbd1b3b6d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:09:58.762891 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7a213-f370-4e54-b9e7-0bbbd1b3b6d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:09:58.764511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-09f7a213-f370-4e54-b9e7-0bbbd1b3b6d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:09:58.793018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:09:58.882237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7a213-f370-4e54-b9e7-0bbbd1b3b6d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:09:58.883582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7a213-f370-4e54-b9e7-0bbbd1b3b6d0 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:09:58.902735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 670/1334] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:09:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:10:01.159065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3298f-2ba6-4202-8e8d-e78f3a8cb78a None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:01.159679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3298f-2ba6-4202-8e8d-e78f3a8cb78a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:01.159679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3298f-2ba6-4202-8e8d-e78f3a8cb78a None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:01.161206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 665/1335] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:01.167293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667744f0-fe66-49de-a36f-8b7354ca6f8d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:01.167843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667744f0-fe66-49de-a36f-8b7354ca6f8d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:01.167843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667744f0-fe66-49de-a36f-8b7354ca6f8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:01.240577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-667744f0-fe66-49de-a36f-8b7354ca6f8d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:01.241824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-667744f0-fe66-49de-a36f-8b7354ca6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:01.324209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:01.350456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 671/1336] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:10:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:10:01.635459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3298f-2ba6-4202-8e8d-e78f3a8cb78a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:10:01.637014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c7f3298f-2ba6-4202-8e8d-e78f3a8cb78a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:01.745276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3298f-2ba6-4202-8e8d-e78f3a8cb78a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:10:01.776912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:01.827924 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e374378d-202a-4b58-bf17-53445e749952 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:10:01.828540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374378d-202a-4b58-bf17-53445e749952 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:01.828816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374378d-202a-4b58-bf17-53445e749952 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:01.829084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e374378d-202a-4b58-bf17-53445e749952 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:01.830776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e374378d-202a-4b58-bf17-53445e749952 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:01.962924 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374378d-202a-4b58-bf17-53445e749952 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:10:01.964281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e374378d-202a-4b58-bf17-53445e749952 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:10:01.983464 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 666/1337] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:10:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:10:04.509517 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649741db-c17c-45ed-94db-bd978c03708f None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:04.510111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649741db-c17c-45ed-94db-bd978c03708f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:04.510111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649741db-c17c-45ed-94db-bd978c03708f None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:04.511376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 672/1338] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:04.516877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbfb19-b456-42b8-b002-1a779c2b6c62 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:04.517364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbfb19-b456-42b8-b002-1a779c2b6c62 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:04.517364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfbfb19-b456-42b8-b002-1a779c2b6c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:04.604251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-dbfbfb19-b456-42b8-b002-1a779c2b6c62 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:04.605825 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dbfbfb19-b456-42b8-b002-1a779c2b6c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:04.618621 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:04.721721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 667/1339] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:10:04 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:05.005336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649741db-c17c-45ed-94db-bd978c03708f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:10:05.006938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-649741db-c17c-45ed-94db-bd978c03708f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:05.116736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649741db-c17c-45ed-94db-bd978c03708f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:10:05.194050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbd5ea8-267e-486d-a4c3-3a430465628d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:10:05.194661 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd5ea8-267e-486d-a4c3-3a430465628d service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:05.194936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd5ea8-267e-486d-a4c3-3a430465628d service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:05.195202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbd5ea8-267e-486d-a4c3-3a430465628d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:05.196804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-abbd5ea8-267e-486d-a4c3-3a430465628d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:05.235343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:05.316100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd5ea8-267e-486d-a4c3-3a430465628d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:10:05.317600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbd5ea8-267e-486d-a4c3-3a430465628d service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:10:05.337289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 673/1340] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:10:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:10:09.585497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509177f0-5f2e-4488-b6f7-da38f725935f None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:09.586138 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509177f0-5f2e-4488-b6f7-da38f725935f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:09.586138 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509177f0-5f2e-4488-b6f7-da38f725935f None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:09.587761 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 668/1341] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:10:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:09.594783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616aa44-9042-4349-8a37-777723188c6a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:09.595327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616aa44-9042-4349-8a37-777723188c6a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:09.595686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1616aa44-9042-4349-8a37-777723188c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:09.688790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1616aa44-9042-4349-8a37-777723188c6a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:09.688790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1616aa44-9042-4349-8a37-777723188c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:09.840170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:09.864995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 674/1342] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:10:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:10.185443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509177f0-5f2e-4488-b6f7-da38f725935f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:10:10.187746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-509177f0-5f2e-4488-b6f7-da38f725935f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:10.328562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509177f0-5f2e-4488-b6f7-da38f725935f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:10:10.375466 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:10.423569 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce9c58-a0e5-4aa8-a939-2cc9069fb06e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:10:10.424363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce9c58-a0e5-4aa8-a939-2cc9069fb06e service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:10.424639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce9c58-a0e5-4aa8-a939-2cc9069fb06e service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:10.424913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce9c58-a0e5-4aa8-a939-2cc9069fb06e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:10.426740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-01ce9c58-a0e5-4aa8-a939-2cc9069fb06e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:10.563794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce9c58-a0e5-4aa8-a939-2cc9069fb06e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:10:10.565263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ce9c58-a0e5-4aa8-a939-2cc9069fb06e service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:10:10.587927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 669/1343] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:10:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:10:13.498906 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12328c9-2846-45b0-8d60-337518bfeacf None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:13.499722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12328c9-2846-45b0-8d60-337518bfeacf None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:13.499722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12328c9-2846-45b0-8d60-337518bfeacf None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:13.501827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 675/1344] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:10:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:13.507916 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6246-90eb-448a-b14d-7efb36e2f32e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:13.508667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6246-90eb-448a-b14d-7efb36e2f32e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:13.508667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddf6246-90eb-448a-b14d-7efb36e2f32e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:13.588638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9ddf6246-90eb-448a-b14d-7efb36e2f32e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:13.589843 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9ddf6246-90eb-448a-b14d-7efb36e2f32e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:13.611884 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:13.710363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 670/1345] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:10:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:10:14.004920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12328c9-2846-45b0-8d60-337518bfeacf None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:10:14.006526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d12328c9-2846-45b0-8d60-337518bfeacf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:14.136265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12328c9-2846-45b0-8d60-337518bfeacf None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:10:14.253996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fb3ef-377c-450e-b7b8-e5fa95d535e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:10:14.254671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fb3ef-377c-450e-b7b8-e5fa95d535e1 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:14.254951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fb3ef-377c-450e-b7b8-e5fa95d535e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:14.255225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fb3ef-377c-450e-b7b8-e5fa95d535e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:14.257114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b02fb3ef-377c-450e-b7b8-e5fa95d535e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:14.318232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:14.429815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fb3ef-377c-450e-b7b8-e5fa95d535e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:10:14.432324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fb3ef-377c-450e-b7b8-e5fa95d535e1 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:10:14.462030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 676/1346] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:10:14 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:10:20.027801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6371c-452b-4125-bc9e-68ce5686fed6 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:20.028547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6371c-452b-4125-bc9e-68ce5686fed6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:20.028965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f6371c-452b-4125-bc9e-68ce5686fed6 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:20.031062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 671/1347] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:10:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:20.040082 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e78f4-8c20-4a51-ae1d-38db7bcdc4a0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:20.040761 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e78f4-8c20-4a51-ae1d-38db7bcdc4a0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:20.040998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308e78f4-8c20-4a51-ae1d-38db7bcdc4a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:20.136449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-308e78f4-8c20-4a51-ae1d-38db7bcdc4a0 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:20.137643 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-308e78f4-8c20-4a51-ae1d-38db7bcdc4a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:20.239234 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:20.242334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 677/1348] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:10:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:20.524964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6371c-452b-4125-bc9e-68ce5686fed6 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:10:20.526564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a2f6371c-452b-4125-bc9e-68ce5686fed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:20.639792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f6371c-452b-4125-bc9e-68ce5686fed6 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:10:20.692446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:20.720765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb72cdb-f508-49ae-96e4-75af9d01c2b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:10:20.721389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72cdb-f508-49ae-96e4-75af9d01c2b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:20.721662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72cdb-f508-49ae-96e4-75af9d01c2b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:20.722181 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb72cdb-f508-49ae-96e4-75af9d01c2b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:20.723721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ddb72cdb-f508-49ae-96e4-75af9d01c2b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:20.838242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb72cdb-f508-49ae-96e4-75af9d01c2b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:10:20.839686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb72cdb-f508-49ae-96e4-75af9d01c2b0 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:10:20.859407 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 672/1349] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:10:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:10:25.986290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef703d-0651-42cc-9c45-d7a8fab2846a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:25.986841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef703d-0651-42cc-9c45-d7a8fab2846a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:25.986841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbef703d-0651-42cc-9c45-d7a8fab2846a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:25.991618 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 678/1350] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:10:25 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:25.996946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84c8e6-2d3e-4843-a013-82293c9a304f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:25.997434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84c8e6-2d3e-4843-a013-82293c9a304f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:25.997525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84c8e6-2d3e-4843-a013-82293c9a304f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:26.121197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2d84c8e6-2d3e-4843-a013-82293c9a304f None None] MFA Rules not processed for user `35d5f3ec00844cf28c01a14f8a071a69`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:26.121850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2d84c8e6-2d3e-4843-a013-82293c9a304f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:26.155594 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:26.351773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 673/1351] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:10:25 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 356 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:31.188186 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cec397-7e35-46f5-a19f-c6db30aa4421 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:31.189350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cec397-7e35-46f5-a19f-c6db30aa4421 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:31.190012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cec397-7e35-46f5-a19f-c6db30aa4421 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:31.192058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 679/1352] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:10:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:10:31.198708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc843e-c744-4cc7-83d7-12212eaedd64 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:31.199227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc843e-c744-4cc7-83d7-12212eaedd64 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:31.199678 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cc843e-c744-4cc7-83d7-12212eaedd64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:31.326952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-85cc843e-c744-4cc7-83d7-12212eaedd64 None None] MFA Rules not processed for user `35d5f3ec00844cf28c01a14f8a071a69`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:31.328563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-85cc843e-c744-4cc7-83d7-12212eaedd64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:31.436603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:31.496062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 674/1353] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:10:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:32.697349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d2b1f-e34e-4289-9ccb-71d063eac9b2 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:32.697904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d2b1f-e34e-4289-9ccb-71d063eac9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:32.698240 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48d2b1f-e34e-4289-9ccb-71d063eac9b2 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:32.699667 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 680/1354] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:32.705027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86d92c-55e9-4107-8ff7-1b25e85da80f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:32.705470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86d92c-55e9-4107-8ff7-1b25e85da80f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:32.705591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86d92c-55e9-4107-8ff7-1b25e85da80f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:32.787487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2e86d92c-55e9-4107-8ff7-1b25e85da80f None None] MFA Rules not processed for user `35d5f3ec00844cf28c01a14f8a071a69`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:32.788714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2e86d92c-55e9-4107-8ff7-1b25e85da80f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:32.914649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 675/1355] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:10:32 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:10:36.501536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0d13-288b-410a-bbf6-c1be6e0212a1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:36.502423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0d13-288b-410a-bbf6-c1be6e0212a1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:36.502866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687d0d13-288b-410a-bbf6-c1be6e0212a1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:36.506448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 681/1356] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:10:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:36.512450 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee586a-a688-47ec-b912-ab507df8bfc8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:36.512993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee586a-a688-47ec-b912-ab507df8bfc8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:36.512993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cee586a-a688-47ec-b912-ab507df8bfc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:36.559636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:36.605547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8cee586a-a688-47ec-b912-ab507df8bfc8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:36.606948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8cee586a-a688-47ec-b912-ab507df8bfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:36.727590 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 676/1357] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:10:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:37.039957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e8cc-bb4e-4b4e-afa2-04942a0a5986 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:37.040396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e8cc-bb4e-4b4e-afa2-04942a0a5986 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:37.041173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c603e8cc-bb4e-4b4e-afa2-04942a0a5986 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:37.044289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 682/1358] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 15 19:10:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:37.052763 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a99a4-75fa-4f08-95a0-818f8c07d30b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:37.053281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a99a4-75fa-4f08-95a0-818f8c07d30b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:37.055001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a99a4-75fa-4f08-95a0-818f8c07d30b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:37.169574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-976a99a4-75fa-4f08-95a0-818f8c07d30b None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:37.171033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-976a99a4-75fa-4f08-95a0-818f8c07d30b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:37.254827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:37.358366 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 677/1359] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 15 19:10:37 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:37.367432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603e8cc-bb4e-4b4e-afa2-04942a0a5986 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:10:37.369116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c603e8cc-bb4e-4b4e-afa2-04942a0a5986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:37.559708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c603e8cc-bb4e-4b4e-afa2-04942a0a5986 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:10:37.663159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:37.714973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbe85fd-fdb2-4570-9b19-5b3361eb316b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:10:37.715608 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe85fd-fdb2-4570-9b19-5b3361eb316b service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:37.715885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe85fd-fdb2-4570-9b19-5b3361eb316b service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:37.716152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbe85fd-fdb2-4570-9b19-5b3361eb316b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:37.717866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0dbe85fd-fdb2-4570-9b19-5b3361eb316b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:37.814813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe85fd-fdb2-4570-9b19-5b3361eb316b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:10:37.816508 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbe85fd-fdb2-4570-9b19-5b3361eb316b service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:10:37.835993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 683/1360] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:10:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:10:40.232709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f40be-bf86-49e5-9362-41210b34aaff None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:40.233264 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f40be-bf86-49e5-9362-41210b34aaff None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:40.233264 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f40be-bf86-49e5-9362-41210b34aaff None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:40.234695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 678/1361] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:40.240459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60a661-6ea5-4bcb-a2e3-9a31295e514e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:40.240974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60a661-6ea5-4bcb-a2e3-9a31295e514e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:40.241074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c60a661-6ea5-4bcb-a2e3-9a31295e514e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:40.321080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5c60a661-6ea5-4bcb-a2e3-9a31295e514e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:40.322362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5c60a661-6ea5-4bcb-a2e3-9a31295e514e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:40.362146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:40.433288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 684/1362] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:10:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:40.728972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f40be-bf86-49e5-9362-41210b34aaff None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:10:40.730662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f52f40be-bf86-49e5-9362-41210b34aaff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:40.902974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f40be-bf86-49e5-9362-41210b34aaff None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:10:40.912753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:41.025525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8402aaab-6a5d-4b51-a716-7ee344062719 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:10:41.026178 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402aaab-6a5d-4b51-a716-7ee344062719 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:41.026452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402aaab-6a5d-4b51-a716-7ee344062719 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:41.026741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8402aaab-6a5d-4b51-a716-7ee344062719 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:41.028330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8402aaab-6a5d-4b51-a716-7ee344062719 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:41.124030 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402aaab-6a5d-4b51-a716-7ee344062719 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:10:41.125645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8402aaab-6a5d-4b51-a716-7ee344062719 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:10:41.147164 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 679/1363] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:10:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:10:43.691215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddadfe-7b5d-47dd-bfc2-aa98c7d9a878 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:43.692656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddadfe-7b5d-47dd-bfc2-aa98c7d9a878 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:43.692656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ddadfe-7b5d-47dd-bfc2-aa98c7d9a878 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:43.693223 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 685/1364] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:10:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:43.699029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915bdf5-ed8a-4d03-8890-ba07ba5379c3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:43.699569 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915bdf5-ed8a-4d03-8890-ba07ba5379c3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:43.699569 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e915bdf5-ed8a-4d03-8890-ba07ba5379c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:43.716490 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:43.784387 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e915bdf5-ed8a-4d03-8890-ba07ba5379c3 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:43.787578 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e915bdf5-ed8a-4d03-8890-ba07ba5379c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:43.930036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 680/1365] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:10:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:44.220663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30109aaa-0028-4293-8a7f-95c6b9e8e320 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:44.221090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30109aaa-0028-4293-8a7f-95c6b9e8e320 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:44.221468 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30109aaa-0028-4293-8a7f-95c6b9e8e320 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:44.223628 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 686/1366] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 15 19:10:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:44.230098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344bc1-1ca6-4fbd-afee-e7e22d8c6961 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:44.230737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344bc1-1ca6-4fbd-afee-e7e22d8c6961 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:44.231020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5344bc1-1ca6-4fbd-afee-e7e22d8c6961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:44.359895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d5344bc1-1ca6-4fbd-afee-e7e22d8c6961 None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:44.361220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d5344bc1-1ca6-4fbd-afee-e7e22d8c6961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:44.401641 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:44.498467 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 681/1367] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 15 19:10:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:44.507362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30109aaa-0028-4293-8a7f-95c6b9e8e320 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:10:44.509102 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-30109aaa-0028-4293-8a7f-95c6b9e8e320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:44.696291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30109aaa-0028-4293-8a7f-95c6b9e8e320 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:10:44.729458 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:44.865538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b366ac7-3e78-4cdb-bbee-f7ae5bb3984a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:10:44.866214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b366ac7-3e78-4cdb-bbee-f7ae5bb3984a service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:44.866489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b366ac7-3e78-4cdb-bbee-f7ae5bb3984a service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:44.866757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b366ac7-3e78-4cdb-bbee-f7ae5bb3984a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:44.868517 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0b366ac7-3e78-4cdb-bbee-f7ae5bb3984a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:44.873583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb4886-847e-456f-af54-74d83f727db6 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:44.874660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb4886-847e-456f-af54-74d83f727db6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:44.875371 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb4886-847e-456f-af54-74d83f727db6 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:44.877843 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 682/1368] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:10:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:10:44.884241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3297b-6240-4f1a-91bd-cf6487bcf5d8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:44.884527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3297b-6240-4f1a-91bd-cf6487bcf5d8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:44.884784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a3297b-6240-4f1a-91bd-cf6487bcf5d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:44.959806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b1a3297b-6240-4f1a-91bd-cf6487bcf5d8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:44.961190 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b1a3297b-6240-4f1a-91bd-cf6487bcf5d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:44.986914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b366ac7-3e78-4cdb-bbee-f7ae5bb3984a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:10:44.989171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b366ac7-3e78-4cdb-bbee-f7ae5bb3984a service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:10:45.012318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 687/1369] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:10:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:10:45.069570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:45.078031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 683/1370] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:10:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:10:45.418857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337a727-364d-496e-9b22-ee16faf90809 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:45.418857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337a727-364d-496e-9b22-ee16faf90809 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:45.418857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6337a727-364d-496e-9b22-ee16faf90809 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:45.420741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 688/1371] 10.222.0.25 () {54 vars in 964 bytes} [Thu Sep 15 19:10:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:45.427352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337726-b0d0-41c8-a54a-98c49ddf67ce None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:45.427352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337726-b0d0-41c8-a54a-98c49ddf67ce None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:45.427774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd337726-b0d0-41c8-a54a-98c49ddf67ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:45.555306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-dd337726-b0d0-41c8-a54a-98c49ddf67ce None None] MFA Rules not processed for user `677623b8ea5042ffa0169be83a7205d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:45.557415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dd337726-b0d0-41c8-a54a-98c49ddf67ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:45.679290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337a727-364d-496e-9b22-ee16faf90809 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:10:45.681058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6337a727-364d-496e-9b22-ee16faf90809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:45.681909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 684/1372] 10.222.0.25 () {58 vars in 1061 bytes} [Thu Sep 15 19:10:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:45.716774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:45.822453 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6337a727-364d-496e-9b22-ee16faf90809 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:10:45.908892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d941de-f7c6-4402-b824-6cc334f196b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:10:45.909666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d941de-f7c6-4402-b824-6cc334f196b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:45.910253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d941de-f7c6-4402-b824-6cc334f196b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:45.910420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d941de-f7c6-4402-b824-6cc334f196b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:45.912389 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-62d941de-f7c6-4402-b824-6cc334f196b9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:46.004395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:46.066915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d941de-f7c6-4402-b824-6cc334f196b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:10:46.070019 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d941de-f7c6-4402-b824-6cc334f196b9 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:10:46.104108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 689/1373] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:10:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:10:47.456197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c867b4-c2be-4db0-af34-2430d521e670 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:47.456809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c867b4-c2be-4db0-af34-2430d521e670 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:47.456809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c867b4-c2be-4db0-af34-2430d521e670 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:47.458534 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 685/1374] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:10:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:10:47.464337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5083df4-189b-4f30-af22-8cb55bb5b450 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:47.464804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5083df4-189b-4f30-af22-8cb55bb5b450 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:47.464896 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5083df4-189b-4f30-af22-8cb55bb5b450 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:47.540161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a5083df4-189b-4f30-af22-8cb55bb5b450 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:47.541309 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a5083df4-189b-4f30-af22-8cb55bb5b450 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:47.671602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 690/1375] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:10:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:47.961105 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c867b4-c2be-4db0-af34-2430d521e670 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:10:47.963123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-83c867b4-c2be-4db0-af34-2430d521e670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:48.060717 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:48.133108 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c867b4-c2be-4db0-af34-2430d521e670 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:10:48.266791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbad1296-8d6d-43f1-8440-70a8f6f9027f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:10:48.267410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad1296-8d6d-43f1-8440-70a8f6f9027f service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:48.267684 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad1296-8d6d-43f1-8440-70a8f6f9027f service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:48.267953 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbad1296-8d6d-43f1-8440-70a8f6f9027f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:48.269614 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fbad1296-8d6d-43f1-8440-70a8f6f9027f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:48.335615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:48.379773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad1296-8d6d-43f1-8440-70a8f6f9027f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:10:48.381373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbad1296-8d6d-43f1-8440-70a8f6f9027f service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:10:48.400436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 686/1376] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:10:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:10:50.721975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da077a-fc95-447f-80d2-bff1925553c9 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:50.722601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da077a-fc95-447f-80d2-bff1925553c9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:50.722601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da077a-fc95-447f-80d2-bff1925553c9 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:50.724248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 691/1377] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:10:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:10:50.729640 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369ffb-4c1f-4673-bb16-32a6c0aa3163 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:50.730142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369ffb-4c1f-4673-bb16-32a6c0aa3163 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:50.730220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d369ffb-4c1f-4673-bb16-32a6c0aa3163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:50.802377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6d369ffb-4c1f-4673-bb16-32a6c0aa3163 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:50.803612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6d369ffb-4c1f-4673-bb16-32a6c0aa3163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:50.910355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 687/1378] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:10:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:51.207423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da077a-fc95-447f-80d2-bff1925553c9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:10:51.208943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-41da077a-fc95-447f-80d2-bff1925553c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:51.249580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:51.383418 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da077a-fc95-447f-80d2-bff1925553c9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:10:51.513338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:51.519812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc371f8-8377-46cf-a008-8574ddfc13d5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:10:51.520643 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc371f8-8377-46cf-a008-8574ddfc13d5 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:51.521462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc371f8-8377-46cf-a008-8574ddfc13d5 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:51.522279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc371f8-8377-46cf-a008-8574ddfc13d5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:51.524974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3bc371f8-8377-46cf-a008-8574ddfc13d5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:51.678124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc371f8-8377-46cf-a008-8574ddfc13d5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:10:51.681502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc371f8-8377-46cf-a008-8574ddfc13d5 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:10:51.721236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 692/1379] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:10:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:10:54.041397 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017eaf-f82e-445b-885a-565d4b05c0fd None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:54.042025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017eaf-f82e-445b-885a-565d4b05c0fd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:54.042025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05017eaf-f82e-445b-885a-565d4b05c0fd None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:54.043344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 688/1380] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:10:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:10:54.052217 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605580b-bf72-4678-ae6c-1baca10d9b26 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:54.053072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605580b-bf72-4678-ae6c-1baca10d9b26 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:54.053072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d605580b-bf72-4678-ae6c-1baca10d9b26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:54.147799 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d605580b-bf72-4678-ae6c-1baca10d9b26 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:54.150365 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d605580b-bf72-4678-ae6c-1baca10d9b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:54.245688 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:54.286269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 693/1381] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:10:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:54.656912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05017eaf-f82e-445b-885a-565d4b05c0fd None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:10:54.659021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-05017eaf-f82e-445b-885a-565d4b05c0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:54.698068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:54.840313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05017eaf-f82e-445b-885a-565d4b05c0fd None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:10:54.953399 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:54.970705 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1379232-ef54-46f9-8a38-45fb9768de12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:10:54.971319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1379232-ef54-46f9-8a38-45fb9768de12 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:54.971591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1379232-ef54-46f9-8a38-45fb9768de12 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:54.971860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1379232-ef54-46f9-8a38-45fb9768de12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:54.974336 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e1379232-ef54-46f9-8a38-45fb9768de12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:55.068181 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1379232-ef54-46f9-8a38-45fb9768de12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:10:55.069848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1379232-ef54-46f9-8a38-45fb9768de12 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:10:55.094682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 689/1382] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:10:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:10:57.729045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9329484-eae5-492c-b291-08a17c5bdd61 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:57.729738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9329484-eae5-492c-b291-08a17c5bdd61 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:57.729738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9329484-eae5-492c-b291-08a17c5bdd61 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:57.731002 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 694/1383] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:10:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:10:57.737180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddb281-4bf0-409c-ab00-a4771ef28197 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:57.737732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddb281-4bf0-409c-ab00-a4771ef28197 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:57.737732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ddb281-4bf0-409c-ab00-a4771ef28197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:57.819800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-40ddb281-4bf0-409c-ab00-a4771ef28197 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:10:57.821033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-40ddb281-4bf0-409c-ab00-a4771ef28197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:57.906516 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:57.965032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 690/1384] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:10:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:10:58.267020 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9329484-eae5-492c-b291-08a17c5bdd61 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:10:58.269948 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f9329484-eae5-492c-b291-08a17c5bdd61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:58.461471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9329484-eae5-492c-b291-08a17c5bdd61 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:10:58.523907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:10:58.608445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ad8739-d46f-418a-a672-fe8fd88e353c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:10:58.609096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad8739-d46f-418a-a672-fe8fd88e353c service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:10:58.609386 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad8739-d46f-418a-a672-fe8fd88e353c service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:10:58.609667 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ad8739-d46f-418a-a672-fe8fd88e353c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:10:58.611424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-36ad8739-d46f-418a-a672-fe8fd88e353c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:10:58.726662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad8739-d46f-418a-a672-fe8fd88e353c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:10:58.729008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ad8739-d46f-418a-a672-fe8fd88e353c service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:10:58.753761 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 695/1385] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:10:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:01.102688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda4cfe-2336-4119-9b1f-75a0e1cfce1b None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:01.103279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda4cfe-2336-4119-9b1f-75a0e1cfce1b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:01.103279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdda4cfe-2336-4119-9b1f-75a0e1cfce1b None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:01.104834 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 691/1386] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:01.110394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424a0ba-cc3c-42d4-bef5-f634ab97e3b7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:01.110874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424a0ba-cc3c-42d4-bef5-f634ab97e3b7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:01.110874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424a0ba-cc3c-42d4-bef5-f634ab97e3b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:01.183054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7424a0ba-cc3c-42d4-bef5-f634ab97e3b7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:01.184267 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7424a0ba-cc3c-42d4-bef5-f634ab97e3b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:01.193448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:01.289983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 696/1387] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:01.578923 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda4cfe-2336-4119-9b1f-75a0e1cfce1b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:01.580533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bdda4cfe-2336-4119-9b1f-75a0e1cfce1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:01.635518 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f318-1fe9-4d36-bc88-91777ef01e6d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:01.635917 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f318-1fe9-4d36-bc88-91777ef01e6d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:01.636193 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb4f318-1fe9-4d36-bc88-91777ef01e6d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:01.637683 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 697/1388] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:11:01.643536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2090d-04f3-4718-a8ae-8520622e00af None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:01.643813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2090d-04f3-4718-a8ae-8520622e00af None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:01.644078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b2090d-04f3-4718-a8ae-8520622e00af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:01.724570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c4b2090d-04f3-4718-a8ae-8520622e00af None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:01.725801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c4b2090d-04f3-4718-a8ae-8520622e00af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:01.756864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdda4cfe-2336-4119-9b1f-75a0e1cfce1b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:01.806145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:01.817316 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:01.829584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 698/1389] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:11:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:11:01.886096 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370d1428-7973-4737-8ac3-5a4bb806b38e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:01.886724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d1428-7973-4737-8ac3-5a4bb806b38e service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:01.887005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d1428-7973-4737-8ac3-5a4bb806b38e service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:01.887277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370d1428-7973-4737-8ac3-5a4bb806b38e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:01.888926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-370d1428-7973-4737-8ac3-5a4bb806b38e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:01.983796 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d1428-7973-4737-8ac3-5a4bb806b38e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:01.985461 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370d1428-7973-4737-8ac3-5a4bb806b38e service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:02.005214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 692/1390] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:02.150500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b8105-bb81-485f-900b-955145eca3ff None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:02.151196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b8105-bb81-485f-900b-955145eca3ff None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:02.151196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155b8105-bb81-485f-900b-955145eca3ff None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:02.152646 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 699/1391] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 15 19:11:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:11:02.159427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d99a5-8598-4654-bead-e7c3b0f40df8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:02.160185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d99a5-8598-4654-bead-e7c3b0f40df8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:02.160361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d99a5-8598-4654-bead-e7c3b0f40df8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:02.232385 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:02.260519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b50d99a5-8598-4654-bead-e7c3b0f40df8 None None] MFA Rules not processed for user `b06d8a144ecf43fc8de82346758b6065`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:02.262638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b50d99a5-8598-4654-bead-e7c3b0f40df8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:02.370675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 693/1392] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 15 19:11:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:02.380259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b8105-bb81-485f-900b-955145eca3ff None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:02.381897 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-155b8105-bb81-485f-900b-955145eca3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:02.519918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155b8105-bb81-485f-900b-955145eca3ff None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:02.607538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f74440-7252-4561-9961-6d2ab60dffa2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06d8a144ecf43fc8de82346758b6065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:02.608157 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f74440-7252-4561-9961-6d2ab60dffa2 service glance] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:02.608435 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f74440-7252-4561-9961-6d2ab60dffa2 service glance] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:02.608704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f74440-7252-4561-9961-6d2ab60dffa2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:02.610364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e4f74440-7252-4561-9961-6d2ab60dffa2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:02.662903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:02.732146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f74440-7252-4561-9961-6d2ab60dffa2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:02.733584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f74440-7252-4561-9961-6d2ab60dffa2 service glance] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:02.752406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 700/1393] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:03.540215 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60be1e-a6c6-4e70-9996-5599eca8d52b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:03.540829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60be1e-a6c6-4e70-9996-5599eca8d52b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:03.540829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca60be1e-a6c6-4e70-9996-5599eca8d52b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:03.621394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ca60be1e-a6c6-4e70-9996-5599eca8d52b None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:03.622656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ca60be1e-a6c6-4e70-9996-5599eca8d52b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:03.715883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 694/1394] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:11:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:03.761835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fea91f-3b77-45d5-a657-50fca2350047 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:03.762463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fea91f-3b77-45d5-a657-50fca2350047 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:03.762463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fea91f-3b77-45d5-a657-50fca2350047 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:03.763756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 701/1395] 10.222.0.25 () {54 vars in 943 bytes} [Thu Sep 15 19:11:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:03.771250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbef61-9456-4d56-85c3-b36358488e52 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:03.771523 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbef61-9456-4d56-85c3-b36358488e52 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:03.771789 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbbef61-9456-4d56-85c3-b36358488e52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:03.782252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:03.860162 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-abbbef61-9456-4d56-85c3-b36358488e52 None None] MFA Rules not processed for user `3940f3578cc44d4d8ebe074216a65f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:03.861389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-abbbef61-9456-4d56-85c3-b36358488e52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:03.989517 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 695/1396] 10.222.0.25 () {58 vars in 1040 bytes} [Thu Sep 15 19:11:03 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:03.997991 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fea91f-3b77-45d5-a657-50fca2350047 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:03.999532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-26fea91f-3b77-45d5-a657-50fca2350047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:04.196406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fea91f-3b77-45d5-a657-50fca2350047 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:04.223740 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:04.322273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125953a-3184-4343-ad90-1fc350af21ad None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:04.322584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125953a-3184-4343-ad90-1fc350af21ad None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:04.323037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d125953a-3184-4343-ad90-1fc350af21ad None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:04.324850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 696/1397] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:11:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:11:04.330492 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb66426-878a-4591-ae90-d33f0b306b29 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:04.330770 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb66426-878a-4591-ae90-d33f0b306b29 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:04.331118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb66426-878a-4591-ae90-d33f0b306b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:04.343166 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd91a0c-2808-4534-94a3-eab3344a9956 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:04.343799 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd91a0c-2808-4534-94a3-eab3344a9956 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:04.344080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd91a0c-2808-4534-94a3-eab3344a9956 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:04.344351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd91a0c-2808-4534-94a3-eab3344a9956 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:04.346069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9bd91a0c-2808-4534-94a3-eab3344a9956 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:04.414183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-cdb66426-878a-4591-ae90-d33f0b306b29 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:04.415426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cdb66426-878a-4591-ae90-d33f0b306b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:04.434587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:04.454499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd91a0c-2808-4534-94a3-eab3344a9956 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:04.456144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd91a0c-2808-4534-94a3-eab3344a9956 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:04.466405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 702/1398] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:11:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 19:11:04.542076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 697/1399] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:11:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:11:04.842394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd91a0c-2808-4534-94a3-eab3344a9956 service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:04.844627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9bd91a0c-2808-4534-94a3-eab3344a9956 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:04.930031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:05.001893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd91a0c-2808-4534-94a3-eab3344a9956 service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:05.157523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe782d2-c770-4884-9036-35c0c073e677 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:05.158146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe782d2-c770-4884-9036-35c0c073e677 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:05.159546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe782d2-c770-4884-9036-35c0c073e677 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:05.159835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe782d2-c770-4884-9036-35c0c073e677 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:05.161589 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ebe782d2-c770-4884-9036-35c0c073e677 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:05.264818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:05.297886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe782d2-c770-4884-9036-35c0c073e677 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:05.299951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe782d2-c770-4884-9036-35c0c073e677 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:05.325680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 703/1400] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:08.065968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239741-3c86-4894-9af0-ddb0cf2da911 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:08.066692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239741-3c86-4894-9af0-ddb0cf2da911 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:08.066692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39239741-3c86-4894-9af0-ddb0cf2da911 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:08.068306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 698/1401] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:11:08.074360 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44390f86-fa70-4b34-9bc9-00ea6efe080b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:08.074936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44390f86-fa70-4b34-9bc9-00ea6efe080b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:08.074936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44390f86-fa70-4b34-9bc9-00ea6efe080b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:08.177481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-44390f86-fa70-4b34-9bc9-00ea6efe080b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:08.179122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-44390f86-fa70-4b34-9bc9-00ea6efe080b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:08.327870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 704/1402] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:11:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:08.875283 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39239741-3c86-4894-9af0-ddb0cf2da911 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:08.877048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-39239741-3c86-4894-9af0-ddb0cf2da911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:09.157043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:09.160786 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39239741-3c86-4894-9af0-ddb0cf2da911 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:09.395868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012fa1df-0dc6-401b-b08c-befb35c677d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:09.396702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fa1df-0dc6-401b-b08c-befb35c677d0 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:09.397114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fa1df-0dc6-401b-b08c-befb35c677d0 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:09.397537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fa1df-0dc6-401b-b08c-befb35c677d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:09.399794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-012fa1df-0dc6-401b-b08c-befb35c677d0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:09.560923 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fa1df-0dc6-401b-b08c-befb35c677d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:09.563384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012fa1df-0dc6-401b-b08c-befb35c677d0 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:09.597827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 699/1403] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 724 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:11:12.504629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d91df8-5109-4de7-82c3-11ae7e2bb65b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:12.505235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d91df8-5109-4de7-82c3-11ae7e2bb65b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:12.505603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d91df8-5109-4de7-82c3-11ae7e2bb65b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:12.508282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 705/1404] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:11:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:12.516032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6994dc-0480-49d8-89f6-a0b14d013678 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:12.516914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6994dc-0480-49d8-89f6-a0b14d013678 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:12.516914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6994dc-0480-49d8-89f6-a0b14d013678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:12.531895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:12.660032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1c6994dc-0480-49d8-89f6-a0b14d013678 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:12.663356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1c6994dc-0480-49d8-89f6-a0b14d013678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:12.861212 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 700/1405] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:11:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 347 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:13.222861 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d91df8-5109-4de7-82c3-11ae7e2bb65b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:13.230151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-68d91df8-5109-4de7-82c3-11ae7e2bb65b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:13.332786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:13.542070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d91df8-5109-4de7-82c3-11ae7e2bb65b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:13.802605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2dfc0d-bfc7-4708-b5d3-cfba49b4cc88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:13.803509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dfc0d-bfc7-4708-b5d3-cfba49b4cc88 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:13.803850 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dfc0d-bfc7-4708-b5d3-cfba49b4cc88 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:13.804172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2dfc0d-bfc7-4708-b5d3-cfba49b4cc88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:13.806023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5b2dfc0d-bfc7-4708-b5d3-cfba49b4cc88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:13.808856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:13.965604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dfc0d-bfc7-4708-b5d3-cfba49b4cc88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:13.968834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2dfc0d-bfc7-4708-b5d3-cfba49b4cc88 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:13.997404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 706/1406] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 776 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:16.349797 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c0abb-cc09-4387-a1c8-c926c3e1243a None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:16.350669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c0abb-cc09-4387-a1c8-c926c3e1243a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:16.350669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c0abb-cc09-4387-a1c8-c926c3e1243a None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:16.355414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 701/1407] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:11:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:11:16.357803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27b1e-ce0b-409a-acc1-5ca673da1126 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:16.358632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27b1e-ce0b-409a-acc1-5ca673da1126 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:16.358632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c27b1e-ce0b-409a-acc1-5ca673da1126 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:16.447178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b2c27b1e-ce0b-409a-acc1-5ca673da1126 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:16.448535 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b2c27b1e-ce0b-409a-acc1-5ca673da1126 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:16.572912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:16.633815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 707/1408] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:11:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:11:16.927419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c0abb-cc09-4387-a1c8-c926c3e1243a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:16.928987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c77c0abb-cc09-4387-a1c8-c926c3e1243a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:17.071841 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:17.200946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c0abb-cc09-4387-a1c8-c926c3e1243a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:17.413043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89d0ab3-4813-4d29-bf34-f9defb9eb5b0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:17.414242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d0ab3-4813-4d29-bf34-f9defb9eb5b0 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:17.414242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d0ab3-4813-4d29-bf34-f9defb9eb5b0 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:17.414242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89d0ab3-4813-4d29-bf34-f9defb9eb5b0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:17.416078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d89d0ab3-4813-4d29-bf34-f9defb9eb5b0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:17.487085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:17.543087 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d0ab3-4813-4d29-bf34-f9defb9eb5b0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:17.544846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d89d0ab3-4813-4d29-bf34-f9defb9eb5b0 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:17.592586 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 702/1409] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 665 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:26.617046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=9 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:27.566133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=25 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:28.945740 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b4171-974a-4d02-aad3-a4cce92582d7 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:28.947026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b4171-974a-4d02-aad3-a4cce92582d7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:28.947026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b4171-974a-4d02-aad3-a4cce92582d7 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:28.948745 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 708/1410] 10.222.0.25 () {54 vars in 918 bytes} [Thu Sep 15 19:11:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:28.955266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8969e-db94-4fff-aa96-5ce7106241a2 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:28.955909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8969e-db94-4fff-aa96-5ce7106241a2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:28.955909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e8969e-db94-4fff-aa96-5ce7106241a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:29.074165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b7e8969e-db94-4fff-aa96-5ce7106241a2 None None] MFA Rules not processed for user `35d5f3ec00844cf28c01a14f8a071a69`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:29.075729 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b7e8969e-db94-4fff-aa96-5ce7106241a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:29.200043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 703/1411] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Sep 15 19:11:28 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:29.216461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c0e51-a42c-4168-aec4-d066eb363e91 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:29.216798 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c0e51-a42c-4168-aec4-d066eb363e91 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:29.217101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a4c0e51-a42c-4168-aec4-d066eb363e91 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:29.218584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 709/1412] 10.222.0.25 () {54 vars in 918 bytes} [Thu Sep 15 19:11:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:29.225720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c03b7-a2f2-4716-b154-e89cce3028bf None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:29.226156 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c03b7-a2f2-4716-b154-e89cce3028bf None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:29.226533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c03b7-a2f2-4716-b154-e89cce3028bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:29.320571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:29.324600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-723c03b7-a2f2-4716-b154-e89cce3028bf None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:29.326770 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-723c03b7-a2f2-4716-b154-e89cce3028bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:29.456965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 704/1413] 10.222.0.25 () {58 vars in 1015 bytes} [Thu Sep 15 19:11:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:32.191500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb09ca3-e99e-46f9-94c1-2577246b4317 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:32.192129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb09ca3-e99e-46f9-94c1-2577246b4317 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:32.192129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb09ca3-e99e-46f9-94c1-2577246b4317 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:32.193624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 710/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:32.200252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209d046-3f7b-48f3-ab2f-5fa1640fb183 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:32.200913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209d046-3f7b-48f3-ab2f-5fa1640fb183 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:32.200913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3209d046-3f7b-48f3-ab2f-5fa1640fb183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:32.282508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-3209d046-3f7b-48f3-ab2f-5fa1640fb183 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:32.283775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3209d046-3f7b-48f3-ab2f-5fa1640fb183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:32.348986 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:32.399466 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 705/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:11:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:32.688748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb09ca3-e99e-46f9-94c1-2577246b4317 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:32.690349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-eeb09ca3-e99e-46f9-94c1-2577246b4317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:32.886848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb09ca3-e99e-46f9-94c1-2577246b4317 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:32.974811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:33.041293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eafa5-5e35-405c-8144-36cac8adabb0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:33.042148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eafa5-5e35-405c-8144-36cac8adabb0 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:33.042555 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eafa5-5e35-405c-8144-36cac8adabb0 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:33.042878 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eafa5-5e35-405c-8144-36cac8adabb0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:33.045053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c57eafa5-5e35-405c-8144-36cac8adabb0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:33.164288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57eafa5-5e35-405c-8144-36cac8adabb0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:33.165964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57eafa5-5e35-405c-8144-36cac8adabb0 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:33.186873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 711/1416] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:11:34.397910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94021c19-dbcf-40a8-a6eb-c7bdfb3adb60 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:34.398561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94021c19-dbcf-40a8-a6eb-c7bdfb3adb60 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:34.398738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94021c19-dbcf-40a8-a6eb-c7bdfb3adb60 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:34.401443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 706/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 19:11:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:34.409082 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1c6ee-4d53-4785-80d9-88b3ead393d4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:34.409752 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1c6ee-4d53-4785-80d9-88b3ead393d4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:34.409752 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae1c6ee-4d53-4785-80d9-88b3ead393d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:34.503496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1ae1c6ee-4d53-4785-80d9-88b3ead393d4 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:34.504843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1ae1c6ee-4d53-4785-80d9-88b3ead393d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:34.536933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:34.618435 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 712/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 19:11:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:34.774631 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94021c19-dbcf-40a8-a6eb-c7bdfb3adb60 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:34.776289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-94021c19-dbcf-40a8-a6eb-c7bdfb3adb60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:34.958753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94021c19-dbcf-40a8-a6eb-c7bdfb3adb60 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:35.007776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:35.098053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afa295a-ecf7-480c-9b7f-49927fbf1ac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:35.099147 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa295a-ecf7-480c-9b7f-49927fbf1ac5 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:35.099147 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa295a-ecf7-480c-9b7f-49927fbf1ac5 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:35.099147 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afa295a-ecf7-480c-9b7f-49927fbf1ac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:35.101081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9afa295a-ecf7-480c-9b7f-49927fbf1ac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:35.203197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa295a-ecf7-480c-9b7f-49927fbf1ac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:35.204888 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afa295a-ecf7-480c-9b7f-49927fbf1ac5 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:35.228966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 707/1419] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:36.514162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495c9e-b50a-4219-a3a9-afb62e41ddf5 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:36.515032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495c9e-b50a-4219-a3a9-afb62e41ddf5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:36.515225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f495c9e-b50a-4219-a3a9-afb62e41ddf5 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:36.516670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 713/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 19:11:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:36.524221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec6029-81d8-467e-8315-4556ea07dab0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:36.524770 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec6029-81d8-467e-8315-4556ea07dab0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:36.524943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec6029-81d8-467e-8315-4556ea07dab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:36.590013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:36.619223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1eec6029-81d8-467e-8315-4556ea07dab0 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:36.620467 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1eec6029-81d8-467e-8315-4556ea07dab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:36.762311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 708/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 19:11:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:37.042109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f495c9e-b50a-4219-a3a9-afb62e41ddf5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:37.043968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6f495c9e-b50a-4219-a3a9-afb62e41ddf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:37.229149 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f495c9e-b50a-4219-a3a9-afb62e41ddf5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:37.244826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:37.395895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff87c53b-31b4-4147-932e-d63a8e8ce6a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:37.396915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87c53b-31b4-4147-932e-d63a8e8ce6a6 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:37.397397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87c53b-31b4-4147-932e-d63a8e8ce6a6 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:37.397889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff87c53b-31b4-4147-932e-d63a8e8ce6a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:37.400953 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ff87c53b-31b4-4147-932e-d63a8e8ce6a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:37.570223 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87c53b-31b4-4147-932e-d63a8e8ce6a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:37.573000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff87c53b-31b4-4147-932e-d63a8e8ce6a6 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:37.610308 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 714/1422] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 569 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:38.834701 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dc870-205f-4f4d-9054-d4b7e8ade759 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:38.835656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dc870-205f-4f4d-9054-d4b7e8ade759 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:38.835656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560dc870-205f-4f4d-9054-d4b7e8ade759 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:38.837295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 709/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 19:11:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:38.845028 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdabdf-832a-49f1-b455-af54d0e0ed32 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:38.845678 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdabdf-832a-49f1-b455-af54d0e0ed32 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:38.845678 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9fdabdf-832a-49f1-b455-af54d0e0ed32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:38.869341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:38.940741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e9fdabdf-832a-49f1-b455-af54d0e0ed32 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:38.942964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e9fdabdf-832a-49f1-b455-af54d0e0ed32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:39.061285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 715/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 19:11:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:39.216753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dc870-205f-4f4d-9054-d4b7e8ade759 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:39.218402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-560dc870-205f-4f4d-9054-d4b7e8ade759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:39.355224 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:39.423286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560dc870-205f-4f4d-9054-d4b7e8ade759 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:39.581744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab23933-4c8c-408a-90d9-1e2393a37705 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:39.582399 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23933-4c8c-408a-90d9-1e2393a37705 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:39.582739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23933-4c8c-408a-90d9-1e2393a37705 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:39.583012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab23933-4c8c-408a-90d9-1e2393a37705 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:39.584905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0ab23933-4c8c-408a-90d9-1e2393a37705 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:39.675083 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:39.691219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab23933-4c8c-408a-90d9-1e2393a37705 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:39.693057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab23933-4c8c-408a-90d9-1e2393a37705 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:39.714334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 710/1425] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:40.925810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce898e-024a-4462-adba-6cb5aaceea4a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:40.926511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce898e-024a-4462-adba-6cb5aaceea4a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:40.926511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce898e-024a-4462-adba-6cb5aaceea4a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:40.927795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 716/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 19:11:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:11:40.935651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd55e92-2f43-43ea-8cef-b6d7526a12bb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:40.936206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd55e92-2f43-43ea-8cef-b6d7526a12bb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:40.937422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd55e92-2f43-43ea-8cef-b6d7526a12bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:41.035297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7dd55e92-2f43-43ea-8cef-b6d7526a12bb None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:41.036626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7dd55e92-2f43-43ea-8cef-b6d7526a12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:41.144399 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 711/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 19:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:41.299876 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce898e-024a-4462-adba-6cb5aaceea4a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:41.301409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c8ce898e-024a-4462-adba-6cb5aaceea4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:41.399682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:41.472666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce898e-024a-4462-adba-6cb5aaceea4a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:41.659669 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c960474c-2967-4a0e-90f7-96796f0f427c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:41.660612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960474c-2967-4a0e-90f7-96796f0f427c service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:41.661270 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960474c-2967-4a0e-90f7-96796f0f427c service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:41.661816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c960474c-2967-4a0e-90f7-96796f0f427c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:41.664966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c960474c-2967-4a0e-90f7-96796f0f427c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:41.748545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:41.795207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960474c-2967-4a0e-90f7-96796f0f427c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:41.796838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c960474c-2967-4a0e-90f7-96796f0f427c service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:41.823619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 717/1428] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:42.957996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799308d-ce2b-4173-ae41-9c36416413bc None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:42.959027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799308d-ce2b-4173-ae41-9c36416413bc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:42.959315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0799308d-ce2b-4173-ae41-9c36416413bc None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:42.960857 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 712/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 19:11:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:42.969859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0bc6a-0489-4485-ad2a-86b8a7efb0a9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:42.970494 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0bc6a-0489-4485-ad2a-86b8a7efb0a9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:42.970775 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b0bc6a-0489-4485-ad2a-86b8a7efb0a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:43.073638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-69b0bc6a-0489-4485-ad2a-86b8a7efb0a9 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:43.074968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-69b0bc6a-0489-4485-ad2a-86b8a7efb0a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:43.198613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 718/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 19:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:43.352324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799308d-ce2b-4173-ae41-9c36416413bc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:43.353946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0799308d-ce2b-4173-ae41-9c36416413bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:43.411776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:43.525836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0799308d-ce2b-4173-ae41-9c36416413bc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:43.655153 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51afc14-eeb6-4e13-a29a-dfd50931fac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:43.655673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51afc14-eeb6-4e13-a29a-dfd50931fac1 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:43.655952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51afc14-eeb6-4e13-a29a-dfd50931fac1 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:43.656221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51afc14-eeb6-4e13-a29a-dfd50931fac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:43.657921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e51afc14-eeb6-4e13-a29a-dfd50931fac1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:43.666121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:43.758690 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51afc14-eeb6-4e13-a29a-dfd50931fac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:43.760647 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51afc14-eeb6-4e13-a29a-dfd50931fac1 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:43.780956 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 713/1431] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:44.897942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07a35-8b93-4516-9c88-df447d40dcff None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:44.898838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07a35-8b93-4516-9c88-df447d40dcff None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:44.898838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f07a35-8b93-4516-9c88-df447d40dcff None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:44.900386 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 719/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 19:11:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:44.907775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1ab04-5bdc-44c1-a4b8-9485f43e3ecb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:44.908376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1ab04-5bdc-44c1-a4b8-9485f43e3ecb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:44.908376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1ab04-5bdc-44c1-a4b8-9485f43e3ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:44.997715 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-23d1ab04-5bdc-44c1-a4b8-9485f43e3ecb None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:44.999062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-23d1ab04-5bdc-44c1-a4b8-9485f43e3ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:45.076385 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:45.108976 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 714/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 19:11:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:45.262724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07a35-8b93-4516-9c88-df447d40dcff None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:45.264385 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-04f07a35-8b93-4516-9c88-df447d40dcff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:45.284844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:45.447476 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f07a35-8b93-4516-9c88-df447d40dcff None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:45.555177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:45.599746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286d28d6-894b-4f8f-afcc-c31d732ce78a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:45.600384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d28d6-894b-4f8f-afcc-c31d732ce78a service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:45.600663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d28d6-894b-4f8f-afcc-c31d732ce78a service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:45.600927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286d28d6-894b-4f8f-afcc-c31d732ce78a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:45.602826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-286d28d6-894b-4f8f-afcc-c31d732ce78a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:45.718267 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d28d6-894b-4f8f-afcc-c31d732ce78a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:45.719980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286d28d6-894b-4f8f-afcc-c31d732ce78a service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:45.740353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 720/1434] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:11:46.878926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0703ae0-24c4-451f-bfe1-85a73342ffda None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:46.880299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0703ae0-24c4-451f-bfe1-85a73342ffda None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:46.880299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0703ae0-24c4-451f-bfe1-85a73342ffda None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:46.882698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 715/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 19:11:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:46.893010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c48f9-2f68-408a-a53c-bbe4d5d8247b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:46.893645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c48f9-2f68-408a-a53c-bbe4d5d8247b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:46.893645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c48f9-2f68-408a-a53c-bbe4d5d8247b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:46.985939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-786c48f9-2f68-408a-a53c-bbe4d5d8247b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:46.987300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-786c48f9-2f68-408a-a53c-bbe4d5d8247b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:47.038581 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:47.108644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 721/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 19:11:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:47.261322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0703ae0-24c4-451f-bfe1-85a73342ffda None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:47.262840 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d0703ae0-24c4-451f-bfe1-85a73342ffda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:47.433608 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0703ae0-24c4-451f-bfe1-85a73342ffda None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:47.502271 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:47.581970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bea479-f981-41f6-86f3-5022cde3cac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:47.582568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea479-f981-41f6-86f3-5022cde3cac5 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:47.582908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea479-f981-41f6-86f3-5022cde3cac5 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:47.583169 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bea479-f981-41f6-86f3-5022cde3cac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:47.584886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-69bea479-f981-41f6-86f3-5022cde3cac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:47.693804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea479-f981-41f6-86f3-5022cde3cac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:47.695500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bea479-f981-41f6-86f3-5022cde3cac5 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:47.721905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 716/1437] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:48.845113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a6f38-01aa-42fb-8d69-9ece8e814570 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:48.845776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a6f38-01aa-42fb-8d69-9ece8e814570 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:48.845776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a6f38-01aa-42fb-8d69-9ece8e814570 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:48.847091 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 722/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 19:11:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:48.854817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd57722-44d7-41b1-8c6b-20fef8141024 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:48.855452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd57722-44d7-41b1-8c6b-20fef8141024 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:48.855452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd57722-44d7-41b1-8c6b-20fef8141024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:48.998256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4bd57722-44d7-41b1-8c6b-20fef8141024 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:49.000343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4bd57722-44d7-41b1-8c6b-20fef8141024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:49.004142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:49.190723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 717/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 19:11:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:11:49.470465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a6f38-01aa-42fb-8d69-9ece8e814570 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:49.472209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a99a6f38-01aa-42fb-8d69-9ece8e814570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:49.650701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a6f38-01aa-42fb-8d69-9ece8e814570 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:49.681491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:49.779344 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb30ab37-2e35-4ee6-868f-cb5a38aba0f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:49.779932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ab37-2e35-4ee6-868f-cb5a38aba0f1 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:49.780226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ab37-2e35-4ee6-868f-cb5a38aba0f1 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:49.780493 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb30ab37-2e35-4ee6-868f-cb5a38aba0f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:49.782140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-eb30ab37-2e35-4ee6-868f-cb5a38aba0f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:49.929557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30ab37-2e35-4ee6-868f-cb5a38aba0f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:49.931698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb30ab37-2e35-4ee6-868f-cb5a38aba0f1 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:49.953698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 723/1440] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:11:52.121982 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c7eee-c668-4d89-87c2-1162838262f5 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:52.122775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c7eee-c668-4d89-87c2-1162838262f5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:52.122775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c7eee-c668-4d89-87c2-1162838262f5 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:52.124184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 718/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:11:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:52.131028 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c760295-8515-42af-a89b-03008f01e180 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:52.131666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c760295-8515-42af-a89b-03008f01e180 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:52.131666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c760295-8515-42af-a89b-03008f01e180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:52.176230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:52.205295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1c760295-8515-42af-a89b-03008f01e180 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:52.206562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1c760295-8515-42af-a89b-03008f01e180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:52.318199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 724/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:11:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:52.605109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c7eee-c668-4d89-87c2-1162838262f5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:52.606875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-875c7eee-c668-4d89-87c2-1162838262f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:52.758345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c7eee-c668-4d89-87c2-1162838262f5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:52.811226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:52.866413 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8b0263-53b8-40d5-a656-cd2ae080f9b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:52.866965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b0263-53b8-40d5-a656-cd2ae080f9b5 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:52.867244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b0263-53b8-40d5-a656-cd2ae080f9b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:52.867516 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8b0263-53b8-40d5-a656-cd2ae080f9b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:52.869255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ab8b0263-53b8-40d5-a656-cd2ae080f9b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:53.002892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b0263-53b8-40d5-a656-cd2ae080f9b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:53.004518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8b0263-53b8-40d5-a656-cd2ae080f9b5 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:53.026686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 719/1443] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:56.270184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9415-313c-4144-96ed-02d2efdf7ee7 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:56.271399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9415-313c-4144-96ed-02d2efdf7ee7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:56.271399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcd9415-313c-4144-96ed-02d2efdf7ee7 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:56.272442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 725/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:56.278812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a5bc-a8f0-43fa-bcc6-e62317f3d4da None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:56.279604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a5bc-a8f0-43fa-bcc6-e62317f3d4da None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:56.279604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2044a5bc-a8f0-43fa-bcc6-e62317f3d4da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:56.359792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2044a5bc-a8f0-43fa-bcc6-e62317f3d4da None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:56.361101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2044a5bc-a8f0-43fa-bcc6-e62317f3d4da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:56.376243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:56.470065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 720/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:11:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:11:56.756131 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9415-313c-4144-96ed-02d2efdf7ee7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:11:56.757776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3bcd9415-313c-4144-96ed-02d2efdf7ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:56.879501 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcd9415-313c-4144-96ed-02d2efdf7ee7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:11:56.894322 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:56.968471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c961247-dbff-4b56-bdb7-41f3bbe685d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:11:56.969399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c961247-dbff-4b56-bdb7-41f3bbe685d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:56.969824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c961247-dbff-4b56-bdb7-41f3bbe685d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:56.970103 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c961247-dbff-4b56-bdb7-41f3bbe685d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:56.972041 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1c961247-dbff-4b56-bdb7-41f3bbe685d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:11:57.133348 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c961247-dbff-4b56-bdb7-41f3bbe685d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:11:57.136105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c961247-dbff-4b56-bdb7-41f3bbe685d2 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:11:57.161207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 726/1446] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:11:59.843895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb3a07-bcbb-4d52-af4c-b29459b5fe6b None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:59.844519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb3a07-bcbb-4d52-af4c-b29459b5fe6b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:59.844519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fb3a07-bcbb-4d52-af4c-b29459b5fe6b None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:59.845812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 721/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:11:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:11:59.852113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294aaea-7212-44ea-8a69-28d9020b21dc None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:11:59.852798 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294aaea-7212-44ea-8a69-28d9020b21dc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:11:59.852798 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4294aaea-7212-44ea-8a69-28d9020b21dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:11:59.905967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:11:59.928054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4294aaea-7212-44ea-8a69-28d9020b21dc None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:11:59.929305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4294aaea-7212-44ea-8a69-28d9020b21dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:00.040601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 727/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:11:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:12:00.339213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb3a07-bcbb-4d52-af4c-b29459b5fe6b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:12:00.341296 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b1fb3a07-bcbb-4d52-af4c-b29459b5fe6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:00.481868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fb3a07-bcbb-4d52-af4c-b29459b5fe6b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:12:00.533860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:00.580696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff46616-13bd-42c0-854c-7c7b228d9576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:12:00.581639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff46616-13bd-42c0-854c-7c7b228d9576 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:00.582112 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff46616-13bd-42c0-854c-7c7b228d9576 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:00.582550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff46616-13bd-42c0-854c-7c7b228d9576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:00.585219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4ff46616-13bd-42c0-854c-7c7b228d9576 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:00.744810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff46616-13bd-42c0-854c-7c7b228d9576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:12:00.746333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff46616-13bd-42c0-854c-7c7b228d9576 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:12:00.766637 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 722/1449] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:12:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:12:03.163650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5a912-8858-431a-b174-549a1bca2a54 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:03.164286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5a912-8858-431a-b174-549a1bca2a54 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:03.164286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff5a912-8858-431a-b174-549a1bca2a54 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:03.165596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 728/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:12:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:12:03.171693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9bd5-816a-4ede-a7e6-8aee38e9fd86 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:03.172266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9bd5-816a-4ede-a7e6-8aee38e9fd86 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:03.172266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbe9bd5-816a-4ede-a7e6-8aee38e9fd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:03.261384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4fbe9bd5-816a-4ede-a7e6-8aee38e9fd86 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:12:03.262672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4fbe9bd5-816a-4ede-a7e6-8aee38e9fd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:03.289247 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:03.380403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 723/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:12:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:12:03.681366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5a912-8858-431a-b174-549a1bca2a54 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:12:03.683040 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8ff5a912-8858-431a-b174-549a1bca2a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:03.813800 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff5a912-8858-431a-b174-549a1bca2a54 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:12:03.838956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:03.904870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146b4ef-9494-4ce7-81cb-f377bdb8e70f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:12:03.905750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146b4ef-9494-4ce7-81cb-f377bdb8e70f service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:03.906197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146b4ef-9494-4ce7-81cb-f377bdb8e70f service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:03.906595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146b4ef-9494-4ce7-81cb-f377bdb8e70f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:03.909075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0146b4ef-9494-4ce7-81cb-f377bdb8e70f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:04.050159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146b4ef-9494-4ce7-81cb-f377bdb8e70f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:12:04.051690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146b4ef-9494-4ce7-81cb-f377bdb8e70f service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:12:04.072957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 729/1452] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:12:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:12:06.420766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49e07a-36b4-4c9e-9814-ebbca305ed77 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:06.421370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49e07a-36b4-4c9e-9814-ebbca305ed77 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:06.421370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de49e07a-36b4-4c9e-9814-ebbca305ed77 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:06.422753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 724/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:12:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:12:06.429292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dee72-673e-40d1-bbd4-66e785fb8b54 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:06.429972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dee72-673e-40d1-bbd4-66e785fb8b54 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:06.429972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dee72-673e-40d1-bbd4-66e785fb8b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:06.506130 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:06.509833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ec2dee72-673e-40d1-bbd4-66e785fb8b54 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:12:06.511649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ec2dee72-673e-40d1-bbd4-66e785fb8b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:06.620809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 730/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:12:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:12:06.902056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49e07a-36b4-4c9e-9814-ebbca305ed77 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:12:06.903673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-de49e07a-36b4-4c9e-9814-ebbca305ed77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:07.023216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de49e07a-36b4-4c9e-9814-ebbca305ed77 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:12:07.080317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:07.110528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea57647-cf7e-4667-a941-70e460bbd2fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:12:07.111179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea57647-cf7e-4667-a941-70e460bbd2fa service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:07.111451 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea57647-cf7e-4667-a941-70e460bbd2fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:07.111703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea57647-cf7e-4667-a941-70e460bbd2fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:07.113383 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-aea57647-cf7e-4667-a941-70e460bbd2fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:07.234122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea57647-cf7e-4667-a941-70e460bbd2fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:12:07.235474 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea57647-cf7e-4667-a941-70e460bbd2fa service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:12:07.256282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 725/1455] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:12:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:12:09.575776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132f787-11d0-4376-9252-1c5db569798d None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:09.576406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132f787-11d0-4376-9252-1c5db569798d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:09.576592 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9132f787-11d0-4376-9252-1c5db569798d None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:09.578877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 731/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:12:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:12:09.585658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3e451-005c-434e-86e4-20e81c6ce6f7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:09.586338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3e451-005c-434e-86e4-20e81c6ce6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:09.586538 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab3e451-005c-434e-86e4-20e81c6ce6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:09.667057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6ab3e451-005c-434e-86e4-20e81c6ce6f7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:12:09.668311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6ab3e451-005c-434e-86e4-20e81c6ce6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:09.714488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:09.793225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 726/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:12:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:12:10.080440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132f787-11d0-4376-9252-1c5db569798d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:12:10.082124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9132f787-11d0-4376-9252-1c5db569798d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:10.198945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9132f787-11d0-4376-9252-1c5db569798d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:12:10.230513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:10.294235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecb3db9-1d10-4416-b757-03f03b3bf91e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:12:10.294890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb3db9-1d10-4416-b757-03f03b3bf91e service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:10.295176 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb3db9-1d10-4416-b757-03f03b3bf91e service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:10.295452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecb3db9-1d10-4416-b757-03f03b3bf91e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:10.297258 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3ecb3db9-1d10-4416-b757-03f03b3bf91e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:10.442731 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb3db9-1d10-4416-b757-03f03b3bf91e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:12:10.444857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecb3db9-1d10-4416-b757-03f03b3bf91e service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:12:10.476178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 732/1458] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:12:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:12:12.897622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50e738-1aec-41d4-9adf-a08124a0b929 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:12.898303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50e738-1aec-41d4-9adf-a08124a0b929 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:12.898303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d50e738-1aec-41d4-9adf-a08124a0b929 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:12.899620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 727/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:12:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:12:12.906996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3430626-6efc-47eb-b1d2-d3a3afc07025 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:12.907599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3430626-6efc-47eb-b1d2-d3a3afc07025 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:12.907936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3430626-6efc-47eb-b1d2-d3a3afc07025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:13.027147 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a3430626-6efc-47eb-b1d2-d3a3afc07025 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:12:13.029272 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a3430626-6efc-47eb-b1d2-d3a3afc07025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:13.043940 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:13.148840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 733/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:12:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:12:13.433311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50e738-1aec-41d4-9adf-a08124a0b929 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:12:13.435103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4d50e738-1aec-41d4-9adf-a08124a0b929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:13.573479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d50e738-1aec-41d4-9adf-a08124a0b929 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:12:13.665367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:13.686755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5bde1a-65ac-46e4-ba53-6cd887731dfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:12:13.687436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bde1a-65ac-46e4-ba53-6cd887731dfa service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:13.687759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bde1a-65ac-46e4-ba53-6cd887731dfa service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:13.688067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5bde1a-65ac-46e4-ba53-6cd887731dfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:13.689875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fb5bde1a-65ac-46e4-ba53-6cd887731dfa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:13.850898 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bde1a-65ac-46e4-ba53-6cd887731dfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:12:13.852428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5bde1a-65ac-46e4-ba53-6cd887731dfa service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:12:13.873593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 728/1461] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:12:16.258647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91cab9-5bc7-4ad3-87dc-7ebe67065d7c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:16.259236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91cab9-5bc7-4ad3-87dc-7ebe67065d7c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:16.259236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e91cab9-5bc7-4ad3-87dc-7ebe67065d7c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:16.260737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 734/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:12:16.267073 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17ea3-395c-4f3b-9c68-2761e0b31b7e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:16.267814 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17ea3-395c-4f3b-9c68-2761e0b31b7e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:16.267814 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c17ea3-395c-4f3b-9c68-2761e0b31b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:16.383249 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f9c17ea3-395c-4f3b-9c68-2761e0b31b7e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:12:16.385246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f9c17ea3-395c-4f3b-9c68-2761e0b31b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:16.445868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:16.553738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 729/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:12:17.080388 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91cab9-5bc7-4ad3-87dc-7ebe67065d7c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:12:17.081994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0e91cab9-5bc7-4ad3-87dc-7ebe67065d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:17.211411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e91cab9-5bc7-4ad3-87dc-7ebe67065d7c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:12:17.268604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:17.325831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246dcad2-2038-4e49-a5bc-8330e157ea30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:12:17.326887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dcad2-2038-4e49-a5bc-8330e157ea30 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:17.327390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dcad2-2038-4e49-a5bc-8330e157ea30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:17.327871 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246dcad2-2038-4e49-a5bc-8330e157ea30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:17.331175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-246dcad2-2038-4e49-a5bc-8330e157ea30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:17.470489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dcad2-2038-4e49-a5bc-8330e157ea30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:12:17.471945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-246dcad2-2038-4e49-a5bc-8330e157ea30 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:12:17.494549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 735/1464] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:12:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:12:19.860400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a221ca-9af2-4ea2-ab5a-7a77d5fb389f None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:19.860963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a221ca-9af2-4ea2-ab5a-7a77d5fb389f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:19.860963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a221ca-9af2-4ea2-ab5a-7a77d5fb389f None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:19.862358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 730/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:12:19.868872 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4946d6-843c-4f3b-bcb5-971015e82927 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:19.869405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4946d6-843c-4f3b-bcb5-971015e82927 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:19.869405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4946d6-843c-4f3b-bcb5-971015e82927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:19.943684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3d4946d6-843c-4f3b-bcb5-971015e82927 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:12:19.944942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3d4946d6-843c-4f3b-bcb5-971015e82927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:19.968377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:20.069213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 736/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:12:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:12:20.356041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a221ca-9af2-4ea2-ab5a-7a77d5fb389f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:12:20.357918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-98a221ca-9af2-4ea2-ab5a-7a77d5fb389f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:20.473509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a221ca-9af2-4ea2-ab5a-7a77d5fb389f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:12:20.548069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:20.556141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11ca85-ff88-46c7-ae8b-2311b04fc299 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:12:20.556680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11ca85-ff88-46c7-ae8b-2311b04fc299 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:20.556955 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11ca85-ff88-46c7-ae8b-2311b04fc299 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:20.557447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11ca85-ff88-46c7-ae8b-2311b04fc299 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:20.558913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8e11ca85-ff88-46c7-ae8b-2311b04fc299 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:20.689441 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11ca85-ff88-46c7-ae8b-2311b04fc299 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:12:20.691010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11ca85-ff88-46c7-ae8b-2311b04fc299 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:12:20.712712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 731/1467] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:12:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:12:22.981803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ce17a-ca4c-4b52-8ab9-3a60fa4a3233 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:22.982410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ce17a-ca4c-4b52-8ab9-3a60fa4a3233 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:22.982595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ce17a-ca4c-4b52-8ab9-3a60fa4a3233 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:22.983963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 737/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:12:22.990907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960d159-bf26-471e-8819-3c916cfe7a65 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:22.991740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960d159-bf26-471e-8819-3c916cfe7a65 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:22.991740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960d159-bf26-471e-8819-3c916cfe7a65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:23.066130 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f960d159-bf26-471e-8819-3c916cfe7a65 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:12:23.067769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f960d159-bf26-471e-8819-3c916cfe7a65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:23.121406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:23.173675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 732/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:12:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:12:23.467253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ce17a-ca4c-4b52-8ab9-3a60fa4a3233 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:12:23.468813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8d8ce17a-ca4c-4b52-8ab9-3a60fa4a3233 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:23.625205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ce17a-ca4c-4b52-8ab9-3a60fa4a3233 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:12:23.714550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:23.764431 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2683372-7b82-4a4a-860b-4cb89f2854ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:12:23.765448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683372-7b82-4a4a-860b-4cb89f2854ad service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:23.765960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683372-7b82-4a4a-860b-4cb89f2854ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:23.766454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2683372-7b82-4a4a-860b-4cb89f2854ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:23.769364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d2683372-7b82-4a4a-860b-4cb89f2854ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:23.964130 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2683372-7b82-4a4a-860b-4cb89f2854ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:12:23.967176 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2683372-7b82-4a4a-860b-4cb89f2854ad service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:12:24.003042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 738/1470] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:12:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:12:33.172108 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=22 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:33.998732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=66 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:44.808321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816986-0504-43d1-9025-af905600b8aa None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:44.809014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816986-0504-43d1-9025-af905600b8aa None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:44.809014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d816986-0504-43d1-9025-af905600b8aa None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:44.810251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 733/1471] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:12:44.818762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb0aa7-de28-4463-a475-9e1c69921c14 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:44.819337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb0aa7-de28-4463-a475-9e1c69921c14 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:44.819337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7afb0aa7-de28-4463-a475-9e1c69921c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:44.895067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7afb0aa7-de28-4463-a475-9e1c69921c14 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:12:44.896603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7afb0aa7-de28-4463-a475-9e1c69921c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:45.004009 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 739/1472] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:12:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:12:45.316480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9655e3-6556-4241-8db8-bfc744e27277 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:45.316757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9655e3-6556-4241-8db8-bfc744e27277 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:45.317024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9655e3-6556-4241-8db8-bfc744e27277 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:45.319375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 734/1473] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 15 19:12:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:12:45.325679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e054fec-079e-463f-b4c7-641d93dc7b44 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:45.325990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e054fec-079e-463f-b4c7-641d93dc7b44 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:45.326262 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e054fec-079e-463f-b4c7-641d93dc7b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:45.412151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2e054fec-079e-463f-b4c7-641d93dc7b44 None None] MFA Rules not processed for user `b06d8a144ecf43fc8de82346758b6065`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:12:45.413404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2e054fec-079e-463f-b4c7-641d93dc7b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:45.436584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:45.498289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 740/1474] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 15 19:12:45 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:12:45.507121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9655e3-6556-4241-8db8-bfc744e27277 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:12:45.508792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-be9655e3-6556-4241-8db8-bfc744e27277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:45.627012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9655e3-6556-4241-8db8-bfc744e27277 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:12:45.713250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2426ff48-b289-4fff-89f6-9de18d96c23d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06d8a144ecf43fc8de82346758b6065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:12:45.713940 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426ff48-b289-4fff-89f6-9de18d96c23d service glance] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:45.714215 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426ff48-b289-4fff-89f6-9de18d96c23d service glance] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:45.714483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2426ff48-b289-4fff-89f6-9de18d96c23d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:45.716147 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2426ff48-b289-4fff-89f6-9de18d96c23d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:45.778486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:45.844042 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426ff48-b289-4fff-89f6-9de18d96c23d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:12:45.845508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2426ff48-b289-4fff-89f6-9de18d96c23d service glance] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:12:45.866973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 735/1475] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:12:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:12:48.221667 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d08c-3f1d-4e79-a949-77ff0e6afbb1 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:48.222332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d08c-3f1d-4e79-a949-77ff0e6afbb1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:48.222443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570d08c-3f1d-4e79-a949-77ff0e6afbb1 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:48.223859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 741/1476] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:12:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:12:48.230154 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab027b-261a-4781-8358-1de21855d1ed None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:48.230702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab027b-261a-4781-8358-1de21855d1ed None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:48.230702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ab027b-261a-4781-8358-1de21855d1ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:48.319571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-36ab027b-261a-4781-8358-1de21855d1ed None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:12:48.320836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-36ab027b-261a-4781-8358-1de21855d1ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:48.445836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 736/1477] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:12:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:12:48.783134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570d08c-3f1d-4e79-a949-77ff0e6afbb1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:12:48.784706 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2570d08c-3f1d-4e79-a949-77ff0e6afbb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:49.043737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2570d08c-3f1d-4e79-a949-77ff0e6afbb1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:12:49.096641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:49.153759 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c737a387-d9df-40a4-8771-cd451e4d1a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:12:49.154451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a387-d9df-40a4-8771-cd451e4d1a26 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:49.154723 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a387-d9df-40a4-8771-cd451e4d1a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:49.154993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c737a387-d9df-40a4-8771-cd451e4d1a26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:49.155644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737a387-d9df-40a4-8771-cd451e4d1a26 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:12:49.157472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-c737a387-d9df-40a4-8771-cd451e4d1a26 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:12:49.157472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 15 19:12:49.157472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: Sep 15 19:12:49.158677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c737a387-d9df-40a4-8771-cd451e4d1a26 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:12:49.179976 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 742/1478] 10.222.0.25 () {56 vars in 1108 bytes} [Thu Sep 15 19:12:48 2022] GET /identity/v3/projects => generated 2553 bytes in 397 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:12:51.468445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a82a3-82b8-4050-9848-638781b8a31a None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:51.469110 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a82a3-82b8-4050-9848-638781b8a31a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:51.469110 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61a82a3-82b8-4050-9848-638781b8a31a None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:51.470384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 737/1479] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:12:51.477205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f4284-1a3f-4355-83b7-162a3e4e59b7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:51.477877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f4284-1a3f-4355-83b7-162a3e4e59b7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:51.477877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f4284-1a3f-4355-83b7-162a3e4e59b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:51.552954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-074f4284-1a3f-4355-83b7-162a3e4e59b7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:12:51.554134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-074f4284-1a3f-4355-83b7-162a3e4e59b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:51.679364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 743/1480] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:12:51.983951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a82a3-82b8-4050-9848-638781b8a31a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:12:51.985493 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c61a82a3-82b8-4050-9848-638781b8a31a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:51.997351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:52.168423 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61a82a3-82b8-4050-9848-638781b8a31a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:12:52.259605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:52.312386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8527fd2a-930f-4c54-87bb-00af433ae645 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:12:52.313424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527fd2a-930f-4c54-87bb-00af433ae645 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:52.313942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527fd2a-930f-4c54-87bb-00af433ae645 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:52.314426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8527fd2a-930f-4c54-87bb-00af433ae645 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:52.317498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8527fd2a-930f-4c54-87bb-00af433ae645 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:52.661434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527fd2a-930f-4c54-87bb-00af433ae645 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:12:52.663119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8527fd2a-930f-4c54-87bb-00af433ae645 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:12:52.685085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 738/1481] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 702 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:12:55.167633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2486a-b924-4f12-be1b-7ede354540aa None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:55.168376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2486a-b924-4f12-be1b-7ede354540aa None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:55.168376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc2486a-b924-4f12-be1b-7ede354540aa None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:55.169606 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 744/1482] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:12:55.175689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaccc2-a1e3-4055-9a56-b63c41cd81b8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:55.176280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaccc2-a1e3-4055-9a56-b63c41cd81b8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:55.176280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceaccc2-a1e3-4055-9a56-b63c41cd81b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:55.252670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-dceaccc2-a1e3-4055-9a56-b63c41cd81b8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:12:55.254013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dceaccc2-a1e3-4055-9a56-b63c41cd81b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:55.310499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:55.379063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 739/1483] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:12:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:12:55.911144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2486a-b924-4f12-be1b-7ede354540aa None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:12:55.913030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-afc2486a-b924-4f12-be1b-7ede354540aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:55.941476 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:56.035332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc2486a-b924-4f12-be1b-7ede354540aa None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:12:56.132765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48112361-6139-4ab0-af67-593090a4a956 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:12:56.133464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48112361-6139-4ab0-af67-593090a4a956 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:56.133776 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48112361-6139-4ab0-af67-593090a4a956 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:56.134133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48112361-6139-4ab0-af67-593090a4a956 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:56.136102 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-48112361-6139-4ab0-af67-593090a4a956 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:56.225280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:56.267314 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48112361-6139-4ab0-af67-593090a4a956 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:12:56.268783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48112361-6139-4ab0-af67-593090a4a956 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:12:56.289220 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 745/1484] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:12:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:12:58.614293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2915ae6-c721-41ff-a15e-f14288817661 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:58.614950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2915ae6-c721-41ff-a15e-f14288817661 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:58.615179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2915ae6-c721-41ff-a15e-f14288817661 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:58.617806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 740/1485] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:12:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:12:58.624301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f15990-b243-4762-9ff3-03e99a06b9c5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:58.625129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f15990-b243-4762-9ff3-03e99a06b9c5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:58.625129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f15990-b243-4762-9ff3-03e99a06b9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:58.704016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-64f15990-b243-4762-9ff3-03e99a06b9c5 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:12:58.705257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-64f15990-b243-4762-9ff3-03e99a06b9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:58.821457 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 746/1486] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:12:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:12:59.119636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2915ae6-c721-41ff-a15e-f14288817661 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:12:59.121820 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f2915ae6-c721-41ff-a15e-f14288817661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:59.246967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2915ae6-c721-41ff-a15e-f14288817661 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:12:59.348170 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:12:59.350740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6890ef-8047-444f-b363-a0a64eff7ab9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:12:59.351512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6890ef-8047-444f-b363-a0a64eff7ab9 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:12:59.351879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6890ef-8047-444f-b363-a0a64eff7ab9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:12:59.352569 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6890ef-8047-444f-b363-a0a64eff7ab9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:12:59.355516 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8e6890ef-8047-444f-b363-a0a64eff7ab9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:12:59.502633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6890ef-8047-444f-b363-a0a64eff7ab9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:12:59.505228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6890ef-8047-444f-b363-a0a64eff7ab9 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:12:59.542078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 741/1487] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:12:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:13:02.296308 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e88a4-2692-4855-8b46-89d3974d460a None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:13:02.297187 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e88a4-2692-4855-8b46-89d3974d460a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:13:02.297187 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19e88a4-2692-4855-8b46-89d3974d460a None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:13:02.299521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 747/1488] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:13:02 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:13:02.307546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf8448-47ab-492a-860b-6df6dd6fbdc2 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:13:02.308174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf8448-47ab-492a-860b-6df6dd6fbdc2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:13:02.308492 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf8448-47ab-492a-860b-6df6dd6fbdc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:13:02.416586 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9faf8448-47ab-492a-860b-6df6dd6fbdc2 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:13:02.417828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9faf8448-47ab-492a-860b-6df6dd6fbdc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:13:02.505040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:13:02.571510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 742/1489] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:13:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:13:02.876905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e88a4-2692-4855-8b46-89d3974d460a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:13:02.878573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e19e88a4-2692-4855-8b46-89d3974d460a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:13:02.919433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:13:03.003220 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19e88a4-2692-4855-8b46-89d3974d460a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:13:03.100971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6a5817-b007-4f11-a0a9-fc62b70a6019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:13:03.101479 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a5817-b007-4f11-a0a9-fc62b70a6019 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:13:03.101759 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a5817-b007-4f11-a0a9-fc62b70a6019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:13:03.102065 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6a5817-b007-4f11-a0a9-fc62b70a6019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:13:03.103781 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7b6a5817-b007-4f11-a0a9-fc62b70a6019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:13:03.204547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:13:03.239803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a5817-b007-4f11-a0a9-fc62b70a6019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:13:03.241391 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6a5817-b007-4f11-a0a9-fc62b70a6019 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:13:03.262584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 748/1490] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:13:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:13:05.770400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22489c3-8a12-4a56-96bd-8589e2196755 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:13:05.771295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22489c3-8a12-4a56-96bd-8589e2196755 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:13:05.771295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22489c3-8a12-4a56-96bd-8589e2196755 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:13:05.773580 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 743/1491] 10.222.0.25 () {54 vars in 927 bytes} [Thu Sep 15 19:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:13:05.781224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43337-9915-4715-bc16-3734503e3c2a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:13:05.782115 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43337-9915-4715-bc16-3734503e3c2a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:13:05.782276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b43337-9915-4715-bc16-3734503e3c2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:13:05.870985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c7b43337-9915-4715-bc16-3734503e3c2a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:13:05.872124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c7b43337-9915-4715-bc16-3734503e3c2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:13:05.985949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 749/1492] 10.222.0.25 () {58 vars in 1024 bytes} [Thu Sep 15 19:13:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:13:06.299267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22489c3-8a12-4a56-96bd-8589e2196755 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:13:06.302655 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a22489c3-8a12-4a56-96bd-8589e2196755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:13:06.459074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22489c3-8a12-4a56-96bd-8589e2196755 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:13:06.547968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daae83e-7565-41f2-a564-156a4862787f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:13:06.548515 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daae83e-7565-41f2-a564-156a4862787f service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:13:06.548794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daae83e-7565-41f2-a564-156a4862787f service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:13:06.549044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daae83e-7565-41f2-a564-156a4862787f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:13:06.550868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2daae83e-7565-41f2-a564-156a4862787f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:13:06.561619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:13:06.705285 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daae83e-7565-41f2-a564-156a4862787f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:13:06.706885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daae83e-7565-41f2-a564-156a4862787f service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:13:06.728367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 744/1493] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:13:15.984265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=82 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:13:16.725810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=50 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:14:30.314639 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d522d-7cf6-4b14-a292-7ff3f718ef60 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:30.315236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d522d-7cf6-4b14-a292-7ff3f718ef60 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:30.315236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59d522d-7cf6-4b14-a292-7ff3f718ef60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:30.393545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d59d522d-7cf6-4b14-a292-7ff3f718ef60 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:14:30.395044 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d59d522d-7cf6-4b14-a292-7ff3f718ef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:30.513174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 750/1494] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:14:30.521708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065b75-04b2-42ac-a0b1-3da6bd4bd456 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:30.522297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065b75-04b2-42ac-a0b1-3da6bd4bd456 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:30.522461 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9065b75-04b2-42ac-a0b1-3da6bd4bd456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:30.623996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e9065b75-04b2-42ac-a0b1-3da6bd4bd456 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:14:30.626121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e9065b75-04b2-42ac-a0b1-3da6bd4bd456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:30.742261 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 745/1495] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:14:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:14:30.747367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d522d-7cf6-4b14-a292-7ff3f718ef60 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:14:30.749440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d59d522d-7cf6-4b14-a292-7ff3f718ef60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:30.767353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59d522d-7cf6-4b14-a292-7ff3f718ef60 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:14:30.834522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:14:30.874342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec862873-0b6b-4d45-8eee-fc07542b99ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:14:30.874961 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec862873-0b6b-4d45-8eee-fc07542b99ee admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:30.875239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec862873-0b6b-4d45-8eee-fc07542b99ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:30.875506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec862873-0b6b-4d45-8eee-fc07542b99ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:30.876160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec862873-0b6b-4d45-8eee-fc07542b99ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:14:30.876443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec862873-0b6b-4d45-8eee-fc07542b99ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:14:30.877466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-ec862873-0b6b-4d45-8eee-fc07542b99ee admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:14:30.877466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 15 19:14:30.877466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: Sep 15 19:14:30.878498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec862873-0b6b-4d45-8eee-fc07542b99ee admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:14:30.890992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 751/1496] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:14:30.900559 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9065b75-04b2-42ac-a0b1-3da6bd4bd456 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:14:30.910432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9065b75-04b2-42ac-a0b1-3da6bd4bd456 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:14:30.978348 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:14:31.017545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac29b4-4cff-4a78-a6d1-b705ede62ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:14:31.018233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac29b4-4cff-4a78-a6d1-b705ede62ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:31.018451 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac29b4-4cff-4a78-a6d1-b705ede62ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:31.018738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ac29b4-4cff-4a78-a6d1-b705ede62ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:31.019365 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac29b4-4cff-4a78-a6d1-b705ede62ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:14:31.021139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-62ac29b4-4cff-4a78-a6d1-b705ede62ef5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:14:31.021139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 15 19:14:31.021139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: Sep 15 19:14:31.022340 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ac29b4-4cff-4a78-a6d1-b705ede62ef5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:14:31.086893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 746/1497] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:14:30 2022] POST /identity/v3/projects => generated 379 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:14:31.092208 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec862873-0b6b-4d45-8eee-fc07542b99ee admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:14:31.094860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ec862873-0b6b-4d45-8eee-fc07542b99ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:31.135780 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec862873-0b6b-4d45-8eee-fc07542b99ee admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:14:31.235118 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942aa634-9c4a-4bd2-b057-8c428494bcc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:14:31.235728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aa634-9c4a-4bd2-b057-8c428494bcc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:31.236004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aa634-9c4a-4bd2-b057-8c428494bcc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:31.236274 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942aa634-9c4a-4bd2-b057-8c428494bcc7 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:31.236885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942aa634-9c4a-4bd2-b057-8c428494bcc7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:14:31.237963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-942aa634-9c4a-4bd2-b057-8c428494bcc7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:14:31.237963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 15 19:14:31.237963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: Sep 15 19:14:31.239159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942aa634-9c4a-4bd2-b057-8c428494bcc7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:14:31.285703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 752/1498] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:14:31 2022] POST /identity/v3/users => generated 290 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:14:31.290211 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac29b4-4cff-4a78-a6d1-b705ede62ef5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:14:31.292042 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-62ac29b4-4cff-4a78-a6d1-b705ede62ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:31.359788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ac29b4-4cff-4a78-a6d1-b705ede62ef5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:14:31.456284 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:14:31.470795 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd285b0-793e-4706-82e1-905159b1716e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:14:31.471420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd285b0-793e-4706-82e1-905159b1716e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:31.471693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd285b0-793e-4706-82e1-905159b1716e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:31.471958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd285b0-793e-4706-82e1-905159b1716e admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:31.472958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd285b0-793e-4706-82e1-905159b1716e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:14:31.474031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-edd285b0-793e-4706-82e1-905159b1716e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:14:31.474031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 15 19:14:31.474031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: Sep 15 19:14:31.474976 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd285b0-793e-4706-82e1-905159b1716e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:14:31.489408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 747/1499] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:14:31.493764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942aa634-9c4a-4bd2-b057-8c428494bcc7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:14:31.495322 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-942aa634-9c4a-4bd2-b057-8c428494bcc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:31.507159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942aa634-9c4a-4bd2-b057-8c428494bcc7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:14:31.535901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:14:31.617409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4e6503-0c28-4a05-b1e8-e9dc06022666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:14:31.617963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e6503-0c28-4a05-b1e8-e9dc06022666 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:31.618235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e6503-0c28-4a05-b1e8-e9dc06022666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:31.618504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4e6503-0c28-4a05-b1e8-e9dc06022666 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:31.619154 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e6503-0c28-4a05-b1e8-e9dc06022666 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:14:31.620151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-8e4e6503-0c28-4a05-b1e8-e9dc06022666 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:14:31.620151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 15 19:14:31.620151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: Sep 15 19:14:31.621070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4e6503-0c28-4a05-b1e8-e9dc06022666 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:14:31.634014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 753/1500] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:14:31 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:14:31.638386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd285b0-793e-4706-82e1-905159b1716e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:14:31.639935 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-edd285b0-793e-4706-82e1-905159b1716e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:31.674506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd285b0-793e-4706-82e1-905159b1716e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:14:31.772543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03422978-8804-429d-a4ff-8323a10f2769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:14:31.773215 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422978-8804-429d-a4ff-8323a10f2769 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:31.773489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422978-8804-429d-a4ff-8323a10f2769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:31.773757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03422978-8804-429d-a4ff-8323a10f2769 admin admin] PATH_INFO: `/v3/projects/d861b3a40f5742e08d0d0ab740bd9289/users/2681a25c20ff44cda59e22662a927da9/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:31.798465 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03422978-8804-429d-a4ff-8323a10f2769 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d861b3a40f5742e08d0d0ab740bd9289, user_id=2681a25c20ff44cda59e22662a927da9, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:14:31.799507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-03422978-8804-429d-a4ff-8323a10f2769 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:14:31.799507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 15 19:14:31.799507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: Sep 15 19:14:31.801412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03422978-8804-429d-a4ff-8323a10f2769 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:14:31.827484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 748/1501] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:14:31 2022] PUT /identity/v3/projects/d861b3a40f5742e08d0d0ab740bd9289/users/2681a25c20ff44cda59e22662a927da9/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:14:31.839944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37a881-f640-4499-92d8-d83af7f8e2e1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:31.840223 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37a881-f640-4499-92d8-d83af7f8e2e1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:31.840475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c37a881-f640-4499-92d8-d83af7f8e2e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:31.902032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3c37a881-f640-4499-92d8-d83af7f8e2e1 None None] MFA Rules not processed for user `2681a25c20ff44cda59e22662a927da9`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:14:31.903228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3c37a881-f640-4499-92d8-d83af7f8e2e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:31.986104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 754/1502] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:14:31 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:14:32.000078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e26c1-6844-42c9-8f42-c949c5e3f26d None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:32.000361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e26c1-6844-42c9-8f42-c949c5e3f26d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:32.000633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90e26c1-6844-42c9-8f42-c949c5e3f26d None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:32.002029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 749/1503] 10.222.0.25 () {54 vars in 964 bytes} [Thu Sep 15 19:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:14:32.007100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59569c-b90f-48e7-97b6-c1f6b9a3c376 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:32.007398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59569c-b90f-48e7-97b6-c1f6b9a3c376 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:32.007640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b59569c-b90f-48e7-97b6-c1f6b9a3c376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:32.042704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:14:32.090473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9b59569c-b90f-48e7-97b6-c1f6b9a3c376 None None] MFA Rules not processed for user `677623b8ea5042ffa0169be83a7205d4`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:14:32.091714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9b59569c-b90f-48e7-97b6-c1f6b9a3c376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:32.172316 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 755/1504] 10.222.0.25 () {58 vars in 1061 bytes} [Thu Sep 15 19:14:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:14:32.181069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e26c1-6844-42c9-8f42-c949c5e3f26d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:14:32.182655 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e90e26c1-6844-42c9-8f42-c949c5e3f26d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:32.238804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:14:32.295017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90e26c1-6844-42c9-8f42-c949c5e3f26d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:14:32.376229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7bae-981d-4473-a7f3-0e14bc237f04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:14:32.376854 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7bae-981d-4473-a7f3-0e14bc237f04 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:32.377126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7bae-981d-4473-a7f3-0e14bc237f04 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:32.377396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfac7bae-981d-4473-a7f3-0e14bc237f04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:32.379334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cfac7bae-981d-4473-a7f3-0e14bc237f04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:32.487690 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac7bae-981d-4473-a7f3-0e14bc237f04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:14:32.489182 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfac7bae-981d-4473-a7f3-0e14bc237f04 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:14:32.492662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:14:32.508662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 750/1505] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:14:32 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:14:32.562220 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bd0de-e912-4aa7-872b-81b1892a3104 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:32.562687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bd0de-e912-4aa7-872b-81b1892a3104 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:32.562797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bd0de-e912-4aa7-872b-81b1892a3104 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:32.564030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 756/1506] 10.222.0.25 () {52 vars in 830 bytes} [Thu Sep 15 19:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:14:32.568098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7bae-981d-4473-a7f3-0e14bc237f04 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:14:32.569328 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cfac7bae-981d-4473-a7f3-0e14bc237f04 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:32.674818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfac7bae-981d-4473-a7f3-0e14bc237f04 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:14:32.773352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:14:32.774019 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:32.774314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:32.774579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] PATH_INFO: `/v3/users/2681a25c20ff44cda59e22662a927da9` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:32.788368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2681a25c20ff44cda59e22662a927da9)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:14:32.789406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:14:32.789406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 15 19:14:32.789406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: Sep 15 19:14:32.790649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:14:32.800692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:14:32.866454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2681a25c20ff44cda59e22662a927da9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:14:32.879174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2681a25c20ff44cda59e22662a927da9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:14:32.879618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2681a25c20ff44cda59e22662a927da9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:14:32.880067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2681a25c20ff44cda59e22662a927da9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:14:32.895730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2681a25c20ff44cda59e22662a927da9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:14:32.926147 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 751/1507] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:14:32 2022] DELETE /identity/v3/users/2681a25c20ff44cda59e22662a927da9 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:14:32.930814 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dd86c-400a-4dfc-b002-0d06e2733f42 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:32.931113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dd86c-400a-4dfc-b002-0d06e2733f42 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:32.931372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8dd86c-400a-4dfc-b002-0d06e2733f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:32.993096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5a8dd86c-400a-4dfc-b002-0d06e2733f42 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:14:32.994281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5a8dd86c-400a-4dfc-b002-0d06e2733f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:33.074911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:14:33.094874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 757/1508] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:14:33.105759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:14:33.107057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:33.216151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c591e5b0-d6cb-4f9f-8475-56351f83cec0 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:14:33.275593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:14:33.298330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d13481-cfc3-443b-9645-3bc67bd0d612 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:14:33.298955 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d13481-cfc3-443b-9645-3bc67bd0d612 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:33.299228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d13481-cfc3-443b-9645-3bc67bd0d612 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:33.299476 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d13481-cfc3-443b-9645-3bc67bd0d612 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:33.301226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f0d13481-cfc3-443b-9645-3bc67bd0d612 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:33.421185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d13481-cfc3-443b-9645-3bc67bd0d612 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:14:33.422658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d13481-cfc3-443b-9645-3bc67bd0d612 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:14:33.441296 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 752/1509] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:14:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:14:33.806448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dd86c-400a-4dfc-b002-0d06e2733f42 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:14:33.807824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5a8dd86c-400a-4dfc-b002-0d06e2733f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:14:33.819708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a8dd86c-400a-4dfc-b002-0d06e2733f42 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:14:33.931505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:14:33.932153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:14:33.932426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:14:33.932695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3 admin admin] PATH_INFO: `/v3/projects/d861b3a40f5742e08d0d0ab740bd9289` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:14:33.943831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d861b3a40f5742e08d0d0ab740bd9289)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:14:33.944866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:14:33.944866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 15 19:14:33.944866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: Sep 15 19:14:33.946113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:14:34.015969 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd861b3a40f5742e08d0d0ab740bd9289', 'request_id': 'req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:14:34.030522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd861b3a40f5742e08d0d0ab740bd9289', 'request_id': 'req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:14:34.040935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd861b3a40f5742e08d0d0ab740bd9289', 'request_id': 'req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:14:34.069526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3 admin admin] The token cache is being invalidate because project d861b3a40f5742e08d0d0ab740bd9289 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:14:34.069763 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:14:34.070837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-52ad52e3-3f4f-4371-a302-fc15ce9e7cf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:14:34.073321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 758/1510] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:14:33 2022] DELETE /identity/v3/projects/d861b3a40f5742e08d0d0ab740bd9289 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:14:43.438888 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=62 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:14:44.065268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:16:07.330992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdc1c-4e01-4147-b292-fdcd57601fc6 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:07.331608 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdc1c-4e01-4147-b292-fdcd57601fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:07.331608 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0bdc1c-4e01-4147-b292-fdcd57601fc6 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:07.333000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 753/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 19:16:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:16:07.338418 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a43b39-2df7-418a-9ab9-cdbdc4283909 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:07.338907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a43b39-2df7-418a-9ab9-cdbdc4283909 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:07.339018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a43b39-2df7-418a-9ab9-cdbdc4283909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:07.428999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-22a43b39-2df7-418a-9ab9-cdbdc4283909 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:16:07.430319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-22a43b39-2df7-418a-9ab9-cdbdc4283909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:07.557758 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 759/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 19:16:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:16:07.718222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bdc1c-4e01-4147-b292-fdcd57601fc6 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:16:07.720577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7f0bdc1c-4e01-4147-b292-fdcd57601fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:07.863542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0bdc1c-4e01-4147-b292-fdcd57601fc6 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:16:07.870868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce9bc33-54df-4de5-ba95-47ac66ea7540 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:16:07.871505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9bc33-54df-4de5-ba95-47ac66ea7540 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:07.871787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9bc33-54df-4de5-ba95-47ac66ea7540 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:07.872085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce9bc33-54df-4de5-ba95-47ac66ea7540 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:07.882174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9bc33-54df-4de5-ba95-47ac66ea7540 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:16:07.883835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce9bc33-54df-4de5-ba95-47ac66ea7540 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:16:07.896050 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 754/1513] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:16:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:16:08.999375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0cfa4-02db-45fa-8954-241338f9fc4b None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:08.999951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0cfa4-02db-45fa-8954-241338f9fc4b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:08.999951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff0cfa4-02db-45fa-8954-241338f9fc4b None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:09.001314 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 760/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 19:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:16:09.007896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ef349-5775-4ac6-b727-360561318378 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:09.008446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ef349-5775-4ac6-b727-360561318378 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:09.008446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715ef349-5775-4ac6-b727-360561318378 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:09.031311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-715ef349-5775-4ac6-b727-360561318378 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:16:09.032648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-715ef349-5775-4ac6-b727-360561318378 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:09.042488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 755/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 19:16:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:16:09.195128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0cfa4-02db-45fa-8954-241338f9fc4b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:16:09.211812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff0cfa4-02db-45fa-8954-241338f9fc4b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:16:09.219293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8662bd-e9a4-48a4-a662-3bfa3ef6049b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:16:09.219907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8662bd-e9a4-48a4-a662-3bfa3ef6049b service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:09.220829 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8662bd-e9a4-48a4-a662-3bfa3ef6049b service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:09.221112 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8662bd-e9a4-48a4-a662-3bfa3ef6049b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:09.229970 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8662bd-e9a4-48a4-a662-3bfa3ef6049b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:16:09.231787 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8662bd-e9a4-48a4-a662-3bfa3ef6049b service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:16:09.242350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 761/1516] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:16:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:16:09.456111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21b52-1cd3-45ea-bf75-bc9a49de07df None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:09.456353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21b52-1cd3-45ea-bf75-bc9a49de07df None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:09.456627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b21b52-1cd3-45ea-bf75-bc9a49de07df None None] PATH_INFO: `/v3` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:09.458031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 756/1517] 10.222.0.16 () {54 vars in 925 bytes} [Thu Sep 15 19:16:09 2022] GET /identity/v3 => generated 255 bytes in 4 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:16:09.465543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f6332-fe83-4bc0-9dc1-6c267a7df845 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:09.465832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f6332-fe83-4bc0-9dc1-6c267a7df845 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:09.466141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29f6332-fe83-4bc0-9dc1-6c267a7df845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:09.530599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d29f6332-fe83-4bc0-9dc1-6c267a7df845 None None] MFA Rules not processed for user `35d5f3ec00844cf28c01a14f8a071a69`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:16:09.531837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d29f6332-fe83-4bc0-9dc1-6c267a7df845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:09.551109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:16:09.612985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 762/1518] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Sep 15 19:16:09 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:16:13.182783 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1d073-9160-412f-96d9-70a03df57ad9 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:13.183330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1d073-9160-412f-96d9-70a03df57ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:13.183330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e1d073-9160-412f-96d9-70a03df57ad9 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:13.184642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 757/1519] 10.222.0.25 () {54 vars in 961 bytes} [Thu Sep 15 19:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:16:13.190942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98978c-918e-4da3-978d-89510819a8cb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:13.191595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98978c-918e-4da3-978d-89510819a8cb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:13.191867 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a98978c-918e-4da3-978d-89510819a8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:13.213695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3a98978c-918e-4da3-978d-89510819a8cb None None] MFA Rules not processed for user `35d5f3ec00844cf28c01a14f8a071a69`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:16:13.214962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3a98978c-918e-4da3-978d-89510819a8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:13.224525 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 763/1520] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Sep 15 19:16:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:16:13.232455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1d073-9160-412f-96d9-70a03df57ad9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:16:13.247258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e1d073-9160-412f-96d9-70a03df57ad9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:16:13.253063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc573c5f-4a6e-4e5f-a762-52b660f3ec7f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d5f3ec00844cf28c01a14f8a071a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:16:13.253672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc573c5f-4a6e-4e5f-a762-52b660f3ec7f service placement] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:13.253983 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc573c5f-4a6e-4e5f-a762-52b660f3ec7f service placement] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:13.254257 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc573c5f-4a6e-4e5f-a762-52b660f3ec7f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:13.263185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc573c5f-4a6e-4e5f-a762-52b660f3ec7f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:16:13.264809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc573c5f-4a6e-4e5f-a762-52b660f3ec7f service placement] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:16:13.275727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 758/1521] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:16:13 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:16:20.744300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220c68e-7c19-4585-82f4-caeaf176c986 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:20.745079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220c68e-7c19-4585-82f4-caeaf176c986 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:20.745079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9220c68e-7c19-4585-82f4-caeaf176c986 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:20.746427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 764/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 19:16:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:16:20.753857 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e5c9a-1321-4a32-afcb-10c943d61897 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:20.754388 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e5c9a-1321-4a32-afcb-10c943d61897 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:20.754388 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e5c9a-1321-4a32-afcb-10c943d61897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:20.776561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4b7e5c9a-1321-4a32-afcb-10c943d61897 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:16:20.777767 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4b7e5c9a-1321-4a32-afcb-10c943d61897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:20.786938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 759/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 19:16:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:16:20.941236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220c68e-7c19-4585-82f4-caeaf176c986 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:16:20.957062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9220c68e-7c19-4585-82f4-caeaf176c986 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:16:20.964306 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca0f9109-5fc2-471c-aae6-81176af5b1fa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:16:20.964993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f9109-5fc2-471c-aae6-81176af5b1fa service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:20.965298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f9109-5fc2-471c-aae6-81176af5b1fa service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:20.965552 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca0f9109-5fc2-471c-aae6-81176af5b1fa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:20.975609 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f9109-5fc2-471c-aae6-81176af5b1fa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:16:20.977161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca0f9109-5fc2-471c-aae6-81176af5b1fa service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:16:20.987984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 765/1524] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:16:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:16:22.080081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305748c-9806-4409-873b-67d2d4cd7816 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:22.080714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305748c-9806-4409-873b-67d2d4cd7816 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:22.080714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e305748c-9806-4409-873b-67d2d4cd7816 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:22.082002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 760/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Sep 15 19:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:16:22.088478 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dc093-5cba-49a6-8881-bf13dda1810d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:22.088957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dc093-5cba-49a6-8881-bf13dda1810d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:22.089060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214dc093-5cba-49a6-8881-bf13dda1810d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:22.109389 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-214dc093-5cba-49a6-8881-bf13dda1810d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:16:22.111228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-214dc093-5cba-49a6-8881-bf13dda1810d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:22.119286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 766/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Sep 15 19:16:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:16:22.271966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305748c-9806-4409-873b-67d2d4cd7816 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:16:22.288189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e305748c-9806-4409-873b-67d2d4cd7816 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:16:22.294066 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440a86d3-818a-4c94-81f8-0b5b0387e419 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:16:22.294681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a86d3-818a-4c94-81f8-0b5b0387e419 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:22.294960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a86d3-818a-4c94-81f8-0b5b0387e419 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:22.295231 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440a86d3-818a-4c94-81f8-0b5b0387e419 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:22.305102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a86d3-818a-4c94-81f8-0b5b0387e419 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:16:22.306749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440a86d3-818a-4c94-81f8-0b5b0387e419 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:16:22.317277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 761/1527] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:16:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:16:26.375596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43738c6c-6630-4821-a749-2611b10d752c None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:26.376179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43738c6c-6630-4821-a749-2611b10d752c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:26.376179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43738c6c-6630-4821-a749-2611b10d752c None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:26.377576 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 767/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:16:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:16:26.383941 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4a139-303c-4156-9e27-8a9d9dc43ced None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:26.384520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4a139-303c-4156-9e27-8a9d9dc43ced None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:26.384520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e4a139-303c-4156-9e27-8a9d9dc43ced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:26.404950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-31e4a139-303c-4156-9e27-8a9d9dc43ced None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:16:26.406216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-31e4a139-303c-4156-9e27-8a9d9dc43ced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:26.414774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 762/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:16:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:16:26.700072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43738c6c-6630-4821-a749-2611b10d752c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:16:26.702156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-43738c6c-6630-4821-a749-2611b10d752c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:26.787683 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43738c6c-6630-4821-a749-2611b10d752c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:16:26.792205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0442c439-894a-43bc-8cc4-fcfe4d884b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:16:26.792826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442c439-894a-43bc-8cc4-fcfe4d884b7b service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:26.793105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442c439-894a-43bc-8cc4-fcfe4d884b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:26.793374 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0442c439-894a-43bc-8cc4-fcfe4d884b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:26.803684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442c439-894a-43bc-8cc4-fcfe4d884b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:16:26.805134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0442c439-894a-43bc-8cc4-fcfe4d884b7b service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:16:26.815720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 768/1530] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:16:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:16:29.062833 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303645a0-c062-41da-8841-b3f53d6ab5f2 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:29.063463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303645a0-c062-41da-8841-b3f53d6ab5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:29.063605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303645a0-c062-41da-8841-b3f53d6ab5f2 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:29.065847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 763/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:16:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:16:29.071186 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c9595-cfda-436e-846a-432f92bbc06e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:29.071789 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c9595-cfda-436e-846a-432f92bbc06e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:29.071789 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5c9595-cfda-436e-846a-432f92bbc06e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:29.093934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7d5c9595-cfda-436e-846a-432f92bbc06e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:16:29.095109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7d5c9595-cfda-436e-846a-432f92bbc06e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:29.104003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 769/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:16:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:16:29.393243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303645a0-c062-41da-8841-b3f53d6ab5f2 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:16:29.406431 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303645a0-c062-41da-8841-b3f53d6ab5f2 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:16:29.411553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76323ed-4b98-44da-b449-464009421e56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:16:29.412198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76323ed-4b98-44da-b449-464009421e56 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:29.412480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76323ed-4b98-44da-b449-464009421e56 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:29.412743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76323ed-4b98-44da-b449-464009421e56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:29.423314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76323ed-4b98-44da-b449-464009421e56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:16:29.425592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76323ed-4b98-44da-b449-464009421e56 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:16:29.436457 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 764/1533] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:16:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:16:33.574790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f531ba1-4062-4f34-8a86-f91e95ce14a3 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:33.575436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f531ba1-4062-4f34-8a86-f91e95ce14a3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:33.575436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f531ba1-4062-4f34-8a86-f91e95ce14a3 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:33.576696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 770/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:16:33.583527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7c8f3-923c-4122-b89a-45dfc5a80458 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:33.584088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7c8f3-923c-4122-b89a-45dfc5a80458 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:33.584438 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a7c8f3-923c-4122-b89a-45dfc5a80458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:33.595589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=81 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:16:33.613228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-87a7c8f3-923c-4122-b89a-45dfc5a80458 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:16:33.614491 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-87a7c8f3-923c-4122-b89a-45dfc5a80458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:33.622795 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 765/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:16:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:16:33.952883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f531ba1-4062-4f34-8a86-f91e95ce14a3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:16:33.954691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6f531ba1-4062-4f34-8a86-f91e95ce14a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:34.039734 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:16:34.058128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f531ba1-4062-4f34-8a86-f91e95ce14a3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:16:34.062634 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae627adc-6142-4585-a218-a86587a204a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:16:34.063353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae627adc-6142-4585-a218-a86587a204a8 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:34.063651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae627adc-6142-4585-a218-a86587a204a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:34.063887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae627adc-6142-4585-a218-a86587a204a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:34.075787 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae627adc-6142-4585-a218-a86587a204a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:16:34.077544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae627adc-6142-4585-a218-a86587a204a8 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:16:34.090604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 771/1536] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:16:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:16:36.359859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd2fd0-dcd8-4fd9-a82d-14a97ad2f7bd None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:36.360460 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd2fd0-dcd8-4fd9-a82d-14a97ad2f7bd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:36.360669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09cd2fd0-dcd8-4fd9-a82d-14a97ad2f7bd None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:36.362706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 766/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Sep 15 19:16:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:16:36.369075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c3a2-a505-45d5-80ea-6751d0625505 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:36.369647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c3a2-a505-45d5-80ea-6751d0625505 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:36.369647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae61c3a2-a505-45d5-80ea-6751d0625505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:36.393827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ae61c3a2-a505-45d5-80ea-6751d0625505 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:16:36.395069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ae61c3a2-a505-45d5-80ea-6751d0625505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:36.404679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 772/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Sep 15 19:16:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:16:36.723604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd2fd0-dcd8-4fd9-a82d-14a97ad2f7bd None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:16:36.726488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-09cd2fd0-dcd8-4fd9-a82d-14a97ad2f7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:16:36.743890 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09cd2fd0-dcd8-4fd9-a82d-14a97ad2f7bd None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:16:36.747679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5751e4fd-f698-415c-857f-82feb8612ef1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:16:36.748324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e4fd-f698-415c-857f-82feb8612ef1 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:16:36.748598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e4fd-f698-415c-857f-82feb8612ef1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:16:36.748866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5751e4fd-f698-415c-857f-82feb8612ef1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:16:36.759065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751e4fd-f698-415c-857f-82feb8612ef1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:16:36.760551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5751e4fd-f698-415c-857f-82feb8612ef1 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:16:36.772281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 767/1539] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:16:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:16:46.387335 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=11 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:16:46.766686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=8 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:05.294571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a847a55-2eaf-4be7-a574-1773a1049689 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:05.296724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a847a55-2eaf-4be7-a574-1773a1049689 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:05.297816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a847a55-2eaf-4be7-a574-1773a1049689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:05.325602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925a7c1-8ad7-4089-b09e-c0162ae71466 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:05.326561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925a7c1-8ad7-4089-b09e-c0162ae71466 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:05.326561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4925a7c1-8ad7-4089-b09e-c0162ae71466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:05.347378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9a847a55-2eaf-4be7-a574-1773a1049689 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:05.350453 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9a847a55-2eaf-4be7-a574-1773a1049689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:05.366805 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4925a7c1-8ad7-4089-b09e-c0162ae71466 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:05.368030 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4925a7c1-8ad7-4089-b09e-c0162ae71466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:05.377930 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 773/1540] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:05.381806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 768/1541] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:05.394337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399f7f-5c1a-43f7-94c4-d8f9c081f1e3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:05.395062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399f7f-5c1a-43f7-94c4-d8f9c081f1e3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:05.395606 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12399f7f-5c1a-43f7-94c4-d8f9c081f1e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:05.397709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb01b1-58ec-4940-8d4b-a04d0c96e839 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:05.398021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb01b1-58ec-4940-8d4b-a04d0c96e839 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:05.398291 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07eb01b1-58ec-4940-8d4b-a04d0c96e839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:05.424330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-12399f7f-5c1a-43f7-94c4-d8f9c081f1e3 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:05.429871 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-12399f7f-5c1a-43f7-94c4-d8f9c081f1e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:05.431665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-07eb01b1-58ec-4940-8d4b-a04d0c96e839 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:05.432821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-07eb01b1-58ec-4940-8d4b-a04d0c96e839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:05.447447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 769/1542] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:18:05.447644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 774/1543] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:05.452151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb01b1-58ec-4940-8d4b-a04d0c96e839 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:05.461533 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12399f7f-5c1a-43f7-94c4-d8f9c081f1e3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:05.479588 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07eb01b1-58ec-4940-8d4b-a04d0c96e839 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:05.480822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12399f7f-5c1a-43f7-94c4-d8f9c081f1e3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:05.489171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc748e-29e9-4848-a03f-49cbea3b1ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:05.489817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc748e-29e9-4848-a03f-49cbea3b1ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:05.490102 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc748e-29e9-4848-a03f-49cbea3b1ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:05.490371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc748e-29e9-4848-a03f-49cbea3b1ed1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:05.491035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc748e-29e9-4848-a03f-49cbea3b1ed1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:18:05.491342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc748e-29e9-4848-a03f-49cbea3b1ed1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:05.492942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc748e-29e9-4848-a03f-49cbea3b1ed1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:05.495991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0ade42-d74a-4b89-9c91-1e98f3189148 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:05.496618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ade42-d74a-4b89-9c91-1e98f3189148 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:05.496888 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ade42-d74a-4b89-9c91-1e98f3189148 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:05.497315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0ade42-d74a-4b89-9c91-1e98f3189148 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:05.497998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ade42-d74a-4b89-9c91-1e98f3189148 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:18:05.498297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ade42-d74a-4b89-9c91-1e98f3189148 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:05.499384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-bc0ade42-d74a-4b89-9c91-1e98f3189148 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:18:05.499384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 15 19:18:05.499384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: Sep 15 19:18:05.500262 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0ade42-d74a-4b89-9c91-1e98f3189148 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:05.521550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 770/1544] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:18:05.523069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037304ea-c36e-4982-a6a1-e9b7f76ab2c0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:05.523270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037304ea-c36e-4982-a6a1-e9b7f76ab2c0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:05.523541 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037304ea-c36e-4982-a6a1-e9b7f76ab2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:05.528367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 775/1545] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:18:05.537739 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc748e-29e9-4848-a03f-49cbea3b1ed1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:05.554661 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc748e-29e9-4848-a03f-49cbea3b1ed1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:05.556952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-037304ea-c36e-4982-a6a1-e9b7f76ab2c0 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:05.558372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-037304ea-c36e-4982-a6a1-e9b7f76ab2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:05.571117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 771/1546] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:05.572083 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037304ea-c36e-4982-a6a1-e9b7f76ab2c0 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:05.574495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e60d15-7985-4a87-8ce6-4e01b1e35257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:05.575126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60d15-7985-4a87-8ce6-4e01b1e35257 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:05.575401 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60d15-7985-4a87-8ce6-4e01b1e35257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:05.575670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e60d15-7985-4a87-8ce6-4e01b1e35257 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:05.576312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e60d15-7985-4a87-8ce6-4e01b1e35257 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:05.577332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-26e60d15-7985-4a87-8ce6-4e01b1e35257 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:18:05.577332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 15 19:18:05.577332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: Sep 15 19:18:05.578549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e60d15-7985-4a87-8ce6-4e01b1e35257 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:05.612014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037304ea-c36e-4982-a6a1-e9b7f76ab2c0 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:05.625604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0e70b-e53a-4f41-9847-22a99ba9b237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:05.626840 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0e70b-e53a-4f41-9847-22a99ba9b237 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:05.627119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0e70b-e53a-4f41-9847-22a99ba9b237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:05.627386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c0e70b-e53a-4f41-9847-22a99ba9b237 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:05.628225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0e70b-e53a-4f41-9847-22a99ba9b237 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:05.630278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c0e70b-e53a-4f41-9847-22a99ba9b237 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:05.682765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 776/1547] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:05 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:05.684247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66907f20-b225-42fb-a1d7-30cd2cf875d2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:05.684525 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66907f20-b225-42fb-a1d7-30cd2cf875d2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:05.684799 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66907f20-b225-42fb-a1d7-30cd2cf875d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:05.694829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 772/1548] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:05 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:05.695733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0e70b-e53a-4f41-9847-22a99ba9b237 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:05.736869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-66907f20-b225-42fb-a1d7-30cd2cf875d2 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:05.740669 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-66907f20-b225-42fb-a1d7-30cd2cf875d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:05.833384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c0e70b-e53a-4f41-9847-22a99ba9b237 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:05.844085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c44433-a117-42dc-a755-e3289885379c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:05.845072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c44433-a117-42dc-a755-e3289885379c admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:05.845829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c44433-a117-42dc-a755-e3289885379c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:05.846142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c44433-a117-42dc-a755-e3289885379c admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:05.848806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c44433-a117-42dc-a755-e3289885379c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:05.849883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-28c44433-a117-42dc-a755-e3289885379c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:18:05.849883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 15 19:18:05.849883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: Sep 15 19:18:05.852416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c44433-a117-42dc-a755-e3289885379c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:05.881601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 777/1549] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:05.887694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b62e5e-86af-497c-8729-2ffbf3a6cc6a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:05.888059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b62e5e-86af-497c-8729-2ffbf3a6cc6a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:05.888331 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b62e5e-86af-497c-8729-2ffbf3a6cc6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:05.911518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 773/1550] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:05 2022] POST /identity/v3/users => generated 286 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:05.915334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c44433-a117-42dc-a755-e3289885379c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:05.941047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c44433-a117-42dc-a755-e3289885379c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:05.942938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-92b62e5e-86af-497c-8729-2ffbf3a6cc6a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:05.944509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-92b62e5e-86af-497c-8729-2ffbf3a6cc6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:05.948565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fbffb-ab83-4553-a144-14924a676d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:05.948565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fbffb-ab83-4553-a144-14924a676d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:05.948565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fbffb-ab83-4553-a144-14924a676d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:05.948565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8fbffb-ab83-4553-a144-14924a676d37 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:05.949097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fbffb-ab83-4553-a144-14924a676d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:05.955622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8fbffb-ab83-4553-a144-14924a676d37 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:05.968058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 778/1551] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:05.969292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b62e5e-86af-497c-8729-2ffbf3a6cc6a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:05.993519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b62e5e-86af-497c-8729-2ffbf3a6cc6a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.001928 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b948b51a-c773-4774-81a3-695ea1e0a63d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.003117 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948b51a-c773-4774-81a3-695ea1e0a63d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.003930 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948b51a-c773-4774-81a3-695ea1e0a63d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.004432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948b51a-c773-4774-81a3-695ea1e0a63d admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.005697 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948b51a-c773-4774-81a3-695ea1e0a63d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:18:06.006295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948b51a-c773-4774-81a3-695ea1e0a63d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.008230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b948b51a-c773-4774-81a3-695ea1e0a63d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.017870 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 774/1552] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:05 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:06.017870 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fbffb-ab83-4553-a144-14924a676d37 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.032469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8fbffb-ab83-4553-a144-14924a676d37 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.042443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14d142-e06f-427e-b73b-df331fd4a360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.043116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14d142-e06f-427e-b73b-df331fd4a360 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.043392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14d142-e06f-427e-b73b-df331fd4a360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.043661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df14d142-e06f-427e-b73b-df331fd4a360 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.044336 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14d142-e06f-427e-b73b-df331fd4a360 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.047325 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df14d142-e06f-427e-b73b-df331fd4a360 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.048745 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 779/1553] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:18:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:18:06.051363 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce896e45-cf4b-4a74-91d0-739debee9eaf None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.052098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce896e45-cf4b-4a74-91d0-739debee9eaf None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.052645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce896e45-cf4b-4a74-91d0-739debee9eaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.084514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 775/1554] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:06.085825 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14d142-e06f-427e-b73b-df331fd4a360 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.100582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ce896e45-cf4b-4a74-91d0-739debee9eaf None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:06.101815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ce896e45-cf4b-4a74-91d0-739debee9eaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:06.108871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df14d142-e06f-427e-b73b-df331fd4a360 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.119346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 780/1555] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:06.120617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8d5b3-43f3-42b3-8d8f-31871929b91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.121248 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8d5b3-43f3-42b3-8d8f-31871929b91d admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.121523 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8d5b3-43f3-42b3-8d8f-31871929b91d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.121814 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b8d5b3-43f3-42b3-8d8f-31871929b91d admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.127123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31963142-4562-49a2-81b6-e9b259199073 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.127408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31963142-4562-49a2-81b6-e9b259199073 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.127680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31963142-4562-49a2-81b6-e9b259199073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.130999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8d5b3-43f3-42b3-8d8f-31871929b91d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.132642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b8d5b3-43f3-42b3-8d8f-31871929b91d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.148890 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 776/1556] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:06.149905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8d5b3-43f3-42b3-8d8f-31871929b91d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.163224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-31963142-4562-49a2-81b6-e9b259199073 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:06.164913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-31963142-4562-49a2-81b6-e9b259199073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:06.172876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b8d5b3-43f3-42b3-8d8f-31871929b91d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.188414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bcb958b-c696-47a3-9ba1-567bdeee433e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.189073 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb958b-c696-47a3-9ba1-567bdeee433e admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.189354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb958b-c696-47a3-9ba1-567bdeee433e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.189616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bcb958b-c696-47a3-9ba1-567bdeee433e admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.191860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 781/1557] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:06.192667 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31963142-4562-49a2-81b6-e9b259199073 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.193207 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb958b-c696-47a3-9ba1-567bdeee433e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.199088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bcb958b-c696-47a3-9ba1-567bdeee433e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.209239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31963142-4562-49a2-81b6-e9b259199073 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.214391 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af70495-3801-4ff2-ad15-b3636f251820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.215016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af70495-3801-4ff2-ad15-b3636f251820 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.215298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af70495-3801-4ff2-ad15-b3636f251820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.215913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af70495-3801-4ff2-ad15-b3636f251820 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.217377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af70495-3801-4ff2-ad15-b3636f251820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.219068 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af70495-3801-4ff2-ad15-b3636f251820 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.232473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 782/1558] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:06.233999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af70495-3801-4ff2-ad15-b3636f251820 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.243158 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 777/1559] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/projects => generated 393 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:06.248918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a5567-673d-4ebc-aa8d-1a7c56365860 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.249731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a5567-673d-4ebc-aa8d-1a7c56365860 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.251009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a5567-673d-4ebc-aa8d-1a7c56365860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.254697 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af70495-3801-4ff2-ad15-b3636f251820 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.273274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5e5a5567-673d-4ebc-aa8d-1a7c56365860 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:06.274511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5e5a5567-673d-4ebc-aa8d-1a7c56365860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:06.312360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:06.314848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ebe7e-3fc5-4d4c-b76c-9ee6e0860073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.315464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ebe7e-3fc5-4d4c-b76c-9ee6e0860073 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.315696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ebe7e-3fc5-4d4c-b76c-9ee6e0860073 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.315985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053ebe7e-3fc5-4d4c-b76c-9ee6e0860073 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.316635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ebe7e-3fc5-4d4c-b76c-9ee6e0860073 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:18:06.316960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ebe7e-3fc5-4d4c-b76c-9ee6e0860073 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.318679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053ebe7e-3fc5-4d4c-b76c-9ee6e0860073 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.320381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:06.333596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 783/1560] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:18:06.334440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ebe7e-3fc5-4d4c-b76c-9ee6e0860073 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.346789 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053ebe7e-3fc5-4d4c-b76c-9ee6e0860073 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.351503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17b362-5257-40f3-a08a-2957e565c1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.352277 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b362-5257-40f3-a08a-2957e565c1b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.352555 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b362-5257-40f3-a08a-2957e565c1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.352820 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b17b362-5257-40f3-a08a-2957e565c1b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.353472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17b362-5257-40f3-a08a-2957e565c1b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.354714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 778/1561] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:06.355469 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b17b362-5257-40f3-a08a-2957e565c1b8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.356034 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7a3de-006f-439d-8999-30f7a3bab080 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.356316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7a3de-006f-439d-8999-30f7a3bab080 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.356585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c7a3de-006f-439d-8999-30f7a3bab080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.367298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 784/1562] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:06.368140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17b362-5257-40f3-a08a-2957e565c1b8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.377509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f3c7a3de-006f-439d-8999-30f7a3bab080 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:06.378755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f3c7a3de-006f-439d-8999-30f7a3bab080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:06.378932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b17b362-5257-40f3-a08a-2957e565c1b8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.383928 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c62de013-7e4b-4dae-9b18-c130a873c6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.384607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62de013-7e4b-4dae-9b18-c130a873c6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.384885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62de013-7e4b-4dae-9b18-c130a873c6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.385158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c62de013-7e4b-4dae-9b18-c130a873c6c9 admin admin] PATH_INFO: `/v3/projects/fe7f5b5a571843b69a553c668ae8e7a3/users/1d81232bd8534879b74df60287a0933b/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.386646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 779/1563] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:06.387433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7a3de-006f-439d-8999-30f7a3bab080 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.397340 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c7a3de-006f-439d-8999-30f7a3bab080 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.402436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62de013-7e4b-4dae-9b18-c130a873c6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe7f5b5a571843b69a553c668ae8e7a3, user_id=1d81232bd8534879b74df60287a0933b, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.402688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3085b4c3-6c9a-4046-82fc-61dd95b72b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.403496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-c62de013-7e4b-4dae-9b18-c130a873c6c9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:18:06.403496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 15 19:18:06.403496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: Sep 15 19:18:06.403812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085b4c3-6c9a-4046-82fc-61dd95b72b88 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.403905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085b4c3-6c9a-4046-82fc-61dd95b72b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.404119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3085b4c3-6c9a-4046-82fc-61dd95b72b88 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.404760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085b4c3-6c9a-4046-82fc-61dd95b72b88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.405424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c62de013-7e4b-4dae-9b18-c130a873c6c9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.406714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3085b4c3-6c9a-4046-82fc-61dd95b72b88 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.421511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 785/1564] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:06 2022] PUT /identity/v3/projects/fe7f5b5a571843b69a553c668ae8e7a3/users/1d81232bd8534879b74df60287a0933b/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:06.423043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad93fbe-743b-45f5-8e58-f548fea6ecb6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.423346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad93fbe-743b-45f5-8e58-f548fea6ecb6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.423723 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad93fbe-743b-45f5-8e58-f548fea6ecb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.431726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 780/1565] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/users => generated 297 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:06.432761 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c1f4-40a4-4a53-a619-7a3386fe4493 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.433053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c1f4-40a4-4a53-a619-7a3386fe4493 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.433327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202c1f4-40a4-4a53-a619-7a3386fe4493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.447243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2ad93fbe-743b-45f5-8e58-f548fea6ecb6 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:06.448588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2ad93fbe-743b-45f5-8e58-f548fea6ecb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:06.453085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d202c1f4-40a4-4a53-a619-7a3386fe4493 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:06.454307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d202c1f4-40a4-4a53-a619-7a3386fe4493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:06.510859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 786/1566] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:06.511973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad93fbe-743b-45f5-8e58-f548fea6ecb6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.521879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad93fbe-743b-45f5-8e58-f548fea6ecb6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.522669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 781/1567] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:06.526547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db414f-cbca-4074-9db1-1fd788d05871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.527163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db414f-cbca-4074-9db1-1fd788d05871 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.527267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396bc5-7d55-44d3-ae38-bc28d8bf6715 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.527438 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db414f-cbca-4074-9db1-1fd788d05871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.527611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396bc5-7d55-44d3-ae38-bc28d8bf6715 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.527705 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73db414f-cbca-4074-9db1-1fd788d05871 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.527943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5396bc5-7d55-44d3-ae38-bc28d8bf6715 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.528325 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db414f-cbca-4074-9db1-1fd788d05871 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.530349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73db414f-cbca-4074-9db1-1fd788d05871 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.549075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d5396bc5-7d55-44d3-ae38-bc28d8bf6715 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:06.550448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d5396bc5-7d55-44d3-ae38-bc28d8bf6715 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:06.559077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 782/1568] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:06.562970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396bc5-7d55-44d3-ae38-bc28d8bf6715 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.566255 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 787/1569] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:06.567276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db414f-cbca-4074-9db1-1fd788d05871 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.573024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5396bc5-7d55-44d3-ae38-bc28d8bf6715 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.633297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73db414f-cbca-4074-9db1-1fd788d05871 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.637399 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818ac0b-1db2-4778-a9ad-f057a8246915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.638106 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818ac0b-1db2-4778-a9ad-f057a8246915 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.638372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871d9116-aced-46f4-addd-1aa528af3182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.638523 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818ac0b-1db2-4778-a9ad-f057a8246915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.638630 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9818ac0b-1db2-4778-a9ad-f057a8246915 admin admin] PATH_INFO: `/v3/projects/0c06f7617b8a4254a752d8652ab91e48/users/a5a8b4618308488dabdef27763f291e9/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.639170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d9116-aced-46f4-addd-1aa528af3182 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.639449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d9116-aced-46f4-addd-1aa528af3182 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.639725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871d9116-aced-46f4-addd-1aa528af3182 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.640378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d9116-aced-46f4-addd-1aa528af3182 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:18:06.640843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d9116-aced-46f4-addd-1aa528af3182 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.642452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871d9116-aced-46f4-addd-1aa528af3182 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.653614 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818ac0b-1db2-4778-a9ad-f057a8246915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0c06f7617b8a4254a752d8652ab91e48, user_id=a5a8b4618308488dabdef27763f291e9, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.654378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 788/1570] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:18:06.655652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1741323-5983-42e7-8c01-3b09c480724f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.655937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1741323-5983-42e7-8c01-3b09c480724f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.656542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1741323-5983-42e7-8c01-3b09c480724f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.656686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9818ac0b-1db2-4778-a9ad-f057a8246915 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.671879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 783/1571] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:06 2022] PUT /identity/v3/projects/0c06f7617b8a4254a752d8652ab91e48/users/a5a8b4618308488dabdef27763f291e9/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:06.672803 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818ac0b-1db2-4778-a9ad-f057a8246915 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.691387 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c1741323-5983-42e7-8c01-3b09c480724f None None] MFA Rules not processed for user `1d81232bd8534879b74df60287a0933b`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:06.692638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c1741323-5983-42e7-8c01-3b09c480724f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:06.704352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:06.713299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:06.742556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9818ac0b-1db2-4778-a9ad-f057a8246915 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.747402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86d10c3-83ee-4b88-a85a-748bd76b39b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.748102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d10c3-83ee-4b88-a85a-748bd76b39b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.748518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d10c3-83ee-4b88-a85a-748bd76b39b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.748713 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86d10c3-83ee-4b88-a85a-748bd76b39b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.749362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d10c3-83ee-4b88-a85a-748bd76b39b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.751141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86d10c3-83ee-4b88-a85a-748bd76b39b8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.762241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 784/1572] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:06.763353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f0c33-b067-4eec-858f-3e1e85e8c29f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.763633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f0c33-b067-4eec-858f-3e1e85e8c29f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.763893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521f0c33-b067-4eec-858f-3e1e85e8c29f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.768173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 789/1573] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:06.769472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9dbaf-b8c3-4fd5-b759-c45babc14df1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.769831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9dbaf-b8c3-4fd5-b759-c45babc14df1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.770124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9dbaf-b8c3-4fd5-b759-c45babc14df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.784396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-521f0c33-b067-4eec-858f-3e1e85e8c29f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:06.785381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-521f0c33-b067-4eec-858f-3e1e85e8c29f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:06.791384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-93a9dbaf-b8c3-4fd5-b759-c45babc14df1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:06.792574 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-93a9dbaf-b8c3-4fd5-b759-c45babc14df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:06.794671 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 785/1574] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:06.795726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f0c33-b067-4eec-858f-3e1e85e8c29f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.802008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 790/1575] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:06.802833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9dbaf-b8c3-4fd5-b759-c45babc14df1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.811019 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521f0c33-b067-4eec-858f-3e1e85e8c29f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.812390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9dbaf-b8c3-4fd5-b759-c45babc14df1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.816343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a194a41-cb7b-4fbf-bfd5-54c59de5c4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.816973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194a41-cb7b-4fbf-bfd5-54c59de5c4e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.817254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194a41-cb7b-4fbf-bfd5-54c59de5c4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.817518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194a41-cb7b-4fbf-bfd5-54c59de5c4e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.817812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b48438-9158-42a5-a685-2c948c71cb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.818221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a194a41-cb7b-4fbf-bfd5-54c59de5c4e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:18:06.818520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a194a41-cb7b-4fbf-bfd5-54c59de5c4e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.818639 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b48438-9158-42a5-a685-2c948c71cb9c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.818841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b48438-9158-42a5-a685-2c948c71cb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.819141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b48438-9158-42a5-a685-2c948c71cb9c admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.819807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b48438-9158-42a5-a685-2c948c71cb9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.820551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a194a41-cb7b-4fbf-bfd5-54c59de5c4e7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.821682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b48438-9158-42a5-a685-2c948c71cb9c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.835409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 786/1576] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:18:06.836256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a194a41-cb7b-4fbf-bfd5-54c59de5c4e7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.848084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a194a41-cb7b-4fbf-bfd5-54c59de5c4e7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.852888 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab447ea-d647-4cf5-9805-a994b3f00567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.857591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 791/1577] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/users => generated 287 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:06.857727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab447ea-d647-4cf5-9805-a994b3f00567 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.857727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab447ea-d647-4cf5-9805-a994b3f00567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.857727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab447ea-d647-4cf5-9805-a994b3f00567 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.857727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab447ea-d647-4cf5-9805-a994b3f00567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.858075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5282d0-f3b3-454f-a1cb-b51d75813aad None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.858075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5282d0-f3b3-454f-a1cb-b51d75813aad None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.858075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5282d0-f3b3-454f-a1cb-b51d75813aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.858335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab447ea-d647-4cf5-9805-a994b3f00567 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.877357 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-cf5282d0-f3b3-454f-a1cb-b51d75813aad None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:06.878616 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cf5282d0-f3b3-454f-a1cb-b51d75813aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:06.886835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 792/1578] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:06.887626 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5282d0-f3b3-454f-a1cb-b51d75813aad None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.889849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 787/1579] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:06.891123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab447ea-d647-4cf5-9805-a994b3f00567 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.907469 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5282d0-f3b3-454f-a1cb-b51d75813aad None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.960280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab447ea-d647-4cf5-9805-a994b3f00567 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:06.965895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d2119-cf35-4280-90bd-fa5aea807325 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.966517 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d2119-cf35-4280-90bd-fa5aea807325 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.966951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d2119-cf35-4280-90bd-fa5aea807325 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.967221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006d2119-cf35-4280-90bd-fa5aea807325 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.967892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d2119-cf35-4280-90bd-fa5aea807325 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.969534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab15f1-a589-4c14-ae58-d33770037b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:06.970027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006d2119-cf35-4280-90bd-fa5aea807325 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.970591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab15f1-a589-4c14-ae58-d33770037b2d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:06.970591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab15f1-a589-4c14-ae58-d33770037b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:06.970784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ab15f1-a589-4c14-ae58-d33770037b2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:06.971392 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab15f1-a589-4c14-ae58-d33770037b2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:06.972992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ab15f1-a589-4c14-ae58-d33770037b2d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:06.984006 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 793/1580] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:06 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:06.984593 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab15f1-a589-4c14-ae58-d33770037b2d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:06.995112 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ab15f1-a589-4c14-ae58-d33770037b2d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.000006 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea6e4f-96ac-4bcc-bc33-fc6eda336a5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.000673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea6e4f-96ac-4bcc-bc33-fc6eda336a5d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.001093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea6e4f-96ac-4bcc-bc33-fc6eda336a5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.001652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bea6e4f-96ac-4bcc-bc33-fc6eda336a5d admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.002129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea6e4f-96ac-4bcc-bc33-fc6eda336a5d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:18:07.002462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea6e4f-96ac-4bcc-bc33-fc6eda336a5d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.002643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 788/1581] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:06 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:07.003525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d2119-cf35-4280-90bd-fa5aea807325 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.004045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bea6e4f-96ac-4bcc-bc33-fc6eda336a5d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.017675 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 794/1582] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:18:07.018499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea6e4f-96ac-4bcc-bc33-fc6eda336a5d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.028783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bea6e4f-96ac-4bcc-bc33-fc6eda336a5d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.071809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006d2119-cf35-4280-90bd-fa5aea807325 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.076530 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aaefa7-c758-4f66-b508-729ebd17e2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.077156 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaefa7-c758-4f66-b508-729ebd17e2b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.077444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaefa7-c758-4f66-b508-729ebd17e2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.077713 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aaefa7-c758-4f66-b508-729ebd17e2b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.078549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aaefa7-c758-4f66-b508-729ebd17e2b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:18:07.078839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aaefa7-c758-4f66-b508-729ebd17e2b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.080519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aaefa7-c758-4f66-b508-729ebd17e2b8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.088636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2808f0-08a3-4352-886d-78e8e459556d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.089032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2808f0-08a3-4352-886d-78e8e459556d admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.089311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2808f0-08a3-4352-886d-78e8e459556d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.089635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2808f0-08a3-4352-886d-78e8e459556d admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.090112 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:07.090378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2808f0-08a3-4352-886d-78e8e459556d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.092598 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2808f0-08a3-4352-886d-78e8e459556d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.102023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 789/1583] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:18:07.102023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aaefa7-c758-4f66-b508-729ebd17e2b8 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.107393 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aaefa7-c758-4f66-b508-729ebd17e2b8 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.113364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ad046-c305-406e-96b5-7b7f08265d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.114019 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ad046-c305-406e-96b5-7b7f08265d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.114311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ad046-c305-406e-96b5-7b7f08265d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.114575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ad046-c305-406e-96b5-7b7f08265d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.115230 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ad046-c305-406e-96b5-7b7f08265d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.115410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:07.116840 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ad046-c305-406e-96b5-7b7f08265d56 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.124591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 795/1584] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:07 2022] POST /identity/v3/projects => generated 379 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:07.125771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2808f0-08a3-4352-886d-78e8e459556d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.129027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 790/1585] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:07.130116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ad046-c305-406e-96b5-7b7f08265d56 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.197030 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ad046-c305-406e-96b5-7b7f08265d56 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.207865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2808f0-08a3-4352-886d-78e8e459556d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.212962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af4be1-1f0d-4fa7-9d07-b19081ab1938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.213606 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af4be1-1f0d-4fa7-9d07-b19081ab1938 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.214041 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af4be1-1f0d-4fa7-9d07-b19081ab1938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.214321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56af4be1-1f0d-4fa7-9d07-b19081ab1938 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.214982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af4be1-1f0d-4fa7-9d07-b19081ab1938 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.217259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56af4be1-1f0d-4fa7-9d07-b19081ab1938 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.245568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 796/1586] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:07 2022] POST /identity/v3/users => generated 292 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:07.245568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af4be1-1f0d-4fa7-9d07-b19081ab1938 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.253184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56af4be1-1f0d-4fa7-9d07-b19081ab1938 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.253433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e1e35-e994-40ea-9d28-6108720756fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.253983 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e1e35-e994-40ea-9d28-6108720756fd service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.254257 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e1e35-e994-40ea-9d28-6108720756fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.254522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9e1e35-e994-40ea-9d28-6108720756fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.257807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841605b-9c1d-4282-8ad1-48217daccaa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.258485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841605b-9c1d-4282-8ad1-48217daccaa9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.258761 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841605b-9c1d-4282-8ad1-48217daccaa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.259035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841605b-9c1d-4282-8ad1-48217daccaa9 admin admin] PATH_INFO: `/v3/projects/7c59cc347b2a427f8eda457aba90cdf5/users/6a7f1fb1137c4fa7aa572631db1b00ac/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.263996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e1e35-e994-40ea-9d28-6108720756fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.265496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9e1e35-e994-40ea-9d28-6108720756fd service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.275089 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841605b-9c1d-4282-8ad1-48217daccaa9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c59cc347b2a427f8eda457aba90cdf5, user_id=6a7f1fb1137c4fa7aa572631db1b00ac, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.276410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 791/1587] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:07.277239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e1e35-e994-40ea-9d28-6108720756fd service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.277949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841605b-9c1d-4282-8ad1-48217daccaa9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.287172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9e1e35-e994-40ea-9d28-6108720756fd service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.294583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d4018-c94b-4dce-8000-a8c4b87ad6d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.295309 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d4018-c94b-4dce-8000-a8c4b87ad6d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.295794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d4018-c94b-4dce-8000-a8c4b87ad6d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.296436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4d4018-c94b-4dce-8000-a8c4b87ad6d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.297161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d4018-c94b-4dce-8000-a8c4b87ad6d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.297949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 797/1588] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:07 2022] PUT /identity/v3/projects/7c59cc347b2a427f8eda457aba90cdf5/users/6a7f1fb1137c4fa7aa572631db1b00ac/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:07.299970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4d4018-c94b-4dce-8000-a8c4b87ad6d6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.300437 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841605b-9c1d-4282-8ad1-48217daccaa9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.327107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 792/1589] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:07 2022] POST /identity/v3/users => generated 293 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:07.328718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d4018-c94b-4dce-8000-a8c4b87ad6d6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.341139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4d4018-c94b-4dce-8000-a8c4b87ad6d6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.377042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841605b-9c1d-4282-8ad1-48217daccaa9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.383327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b6bc-aaa8-4c00-9c91-b63b38df57dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.384095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b6bc-aaa8-4c00-9c91-b63b38df57dd admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.384438 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b6bc-aaa8-4c00-9c91-b63b38df57dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.384771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea4b6bc-aaa8-4c00-9c91-b63b38df57dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.385498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4b6bc-aaa8-4c00-9c91-b63b38df57dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.387999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea4b6bc-aaa8-4c00-9c91-b63b38df57dd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.408066 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baad13f-fde2-4bc1-8d9e-cb8995069282 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.408956 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baad13f-fde2-4bc1-8d9e-cb8995069282 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.409280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baad13f-fde2-4bc1-8d9e-cb8995069282 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.409667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baad13f-fde2-4bc1-8d9e-cb8995069282 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.410460 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baad13f-fde2-4bc1-8d9e-cb8995069282 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.412487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2baad13f-fde2-4bc1-8d9e-cb8995069282 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.419048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 798/1590] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:07 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:07.420069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b6bc-aaa8-4c00-9c91-b63b38df57dd admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.449968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 793/1591] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:07 2022] POST /identity/v3/projects => generated 389 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:07.449968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baad13f-fde2-4bc1-8d9e-cb8995069282 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.472535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:07.477382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:07.495568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea4b6bc-aaa8-4c00-9c91-b63b38df57dd admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.531502 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baad13f-fde2-4bc1-8d9e-cb8995069282 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.538657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c83a5b-0954-4c2b-87c5-648ac9d51a90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.539395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c83a5b-0954-4c2b-87c5-648ac9d51a90 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.539682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c83a5b-0954-4c2b-87c5-648ac9d51a90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.539959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c83a5b-0954-4c2b-87c5-648ac9d51a90 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.540593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c83a5b-0954-4c2b-87c5-648ac9d51a90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.542923 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c83a5b-0954-4c2b-87c5-648ac9d51a90 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.556082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 794/1592] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:07.556782 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c83a5b-0954-4c2b-87c5-648ac9d51a90 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.566714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f21eb1-8d44-434f-ac75-38382ffe9d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.567718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f21eb1-8d44-434f-ac75-38382ffe9d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.567908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c83a5b-0954-4c2b-87c5-648ac9d51a90 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.568281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f21eb1-8d44-434f-ac75-38382ffe9d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.568496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f21eb1-8d44-434f-ac75-38382ffe9d37 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.569202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f21eb1-8d44-434f-ac75-38382ffe9d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.571202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f21eb1-8d44-434f-ac75-38382ffe9d37 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.573285 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133fab4d-8e30-4fd8-b3fe-29c9e0217cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.574265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fab4d-8e30-4fd8-b3fe-29c9e0217cb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.574796 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fab4d-8e30-4fd8-b3fe-29c9e0217cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.575117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133fab4d-8e30-4fd8-b3fe-29c9e0217cb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.575790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fab4d-8e30-4fd8-b3fe-29c9e0217cb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.577912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133fab4d-8e30-4fd8-b3fe-29c9e0217cb6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.590925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 795/1593] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:07.596606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa946bd6-11b3-4c8f-ad35-06dc54049735 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.596706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa946bd6-11b3-4c8f-ad35-06dc54049735 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.597003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa946bd6-11b3-4c8f-ad35-06dc54049735 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.609831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 799/1594] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:07 2022] POST /identity/v3/users => generated 290 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:07.611492 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f21eb1-8d44-434f-ac75-38382ffe9d37 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.630094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f21eb1-8d44-434f-ac75-38382ffe9d37 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.633921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fa946bd6-11b3-4c8f-ad35-06dc54049735 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:07.635440 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fa946bd6-11b3-4c8f-ad35-06dc54049735 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:07.635883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da225b-c912-43b6-9611-3c5c6ae48993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.636519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da225b-c912-43b6-9611-3c5c6ae48993 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.636856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da225b-c912-43b6-9611-3c5c6ae48993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.637130 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8da225b-c912-43b6-9611-3c5c6ae48993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.637816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da225b-c912-43b6-9611-3c5c6ae48993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.639434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8da225b-c912-43b6-9611-3c5c6ae48993 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.650555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 796/1595] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:07.650555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa946bd6-11b3-4c8f-ad35-06dc54049735 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.651035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 800/1596] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:07.654912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da225b-c912-43b6-9611-3c5c6ae48993 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.657550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa946bd6-11b3-4c8f-ad35-06dc54049735 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.663257 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0285ea-fe69-47f2-b26b-c949c6dbf3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.664052 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0285ea-fe69-47f2-b26b-c949c6dbf3ea admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.664910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0285ea-fe69-47f2-b26b-c949c6dbf3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.665216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0285ea-fe69-47f2-b26b-c949c6dbf3ea admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.665833 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0285ea-fe69-47f2-b26b-c949c6dbf3ea admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.665994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8da225b-c912-43b6-9611-3c5c6ae48993 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.668040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0285ea-fe69-47f2-b26b-c949c6dbf3ea admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.671233 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfd43b-44d9-4b8e-90ed-9bbbb31082e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.671939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfd43b-44d9-4b8e-90ed-9bbbb31082e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.672305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfd43b-44d9-4b8e-90ed-9bbbb31082e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.672678 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cfd43b-44d9-4b8e-90ed-9bbbb31082e7 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.673228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfd43b-44d9-4b8e-90ed-9bbbb31082e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.675282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cfd43b-44d9-4b8e-90ed-9bbbb31082e7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.703251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 801/1597] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:07 2022] POST /identity/v3/users => generated 295 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:07.704166 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfd43b-44d9-4b8e-90ed-9bbbb31082e7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.706258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 797/1598] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:07 2022] POST /identity/v3/users => generated 288 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:07.707238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0285ea-fe69-47f2-b26b-c949c6dbf3ea admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.720214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cfd43b-44d9-4b8e-90ed-9bbbb31082e7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.720498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0285ea-fe69-47f2-b26b-c949c6dbf3ea admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.726834 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61328d0b-7cf1-4ede-8501-9b31b953208b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.727111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa190e5-2811-4ca5-8256-629e72fe4b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.727556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61328d0b-7cf1-4ede-8501-9b31b953208b admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.727734 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa190e5-2811-4ca5-8256-629e72fe4b20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.727892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61328d0b-7cf1-4ede-8501-9b31b953208b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.728044 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa190e5-2811-4ca5-8256-629e72fe4b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.728207 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61328d0b-7cf1-4ede-8501-9b31b953208b admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.728357 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa190e5-2811-4ca5-8256-629e72fe4b20 admin admin] PATH_INFO: `/v3/projects/1ca39aedf9274f3bb4e996fe39bae300/users/7b7a860ab49f4b69a1df9bc4fb7ec61c/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.729268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61328d0b-7cf1-4ede-8501-9b31b953208b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.731070 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61328d0b-7cf1-4ede-8501-9b31b953208b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.744213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 798/1599] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:07.745139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61328d0b-7cf1-4ede-8501-9b31b953208b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.748964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa190e5-2811-4ca5-8256-629e72fe4b20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ca39aedf9274f3bb4e996fe39bae300, user_id=7b7a860ab49f4b69a1df9bc4fb7ec61c, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.752119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa190e5-2811-4ca5-8256-629e72fe4b20 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.758266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61328d0b-7cf1-4ede-8501-9b31b953208b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.763921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce957a01-cf6b-4fca-a115-28952b097bcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.764550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce957a01-cf6b-4fca-a115-28952b097bcc admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.764828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce957a01-cf6b-4fca-a115-28952b097bcc admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.765086 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce957a01-cf6b-4fca-a115-28952b097bcc admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.765725 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce957a01-cf6b-4fca-a115-28952b097bcc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.767987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce957a01-cf6b-4fca-a115-28952b097bcc admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.770192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 802/1600] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:07 2022] PUT /identity/v3/projects/1ca39aedf9274f3bb4e996fe39bae300/users/7b7a860ab49f4b69a1df9bc4fb7ec61c/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:07.771050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa190e5-2811-4ca5-8256-629e72fe4b20 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.794049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 799/1601] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:07.795285 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce957a01-cf6b-4fca-a115-28952b097bcc admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.798068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ce957a01-cf6b-4fca-a115-28952b097bcc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:07.850685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa190e5-2811-4ca5-8256-629e72fe4b20 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.856653 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf59d82-e068-4970-bea1-3821fc39acf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.857419 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf59d82-e068-4970-bea1-3821fc39acf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.857908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf59d82-e068-4970-bea1-3821fc39acf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.858185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf59d82-e068-4970-bea1-3821fc39acf0 admin admin] PATH_INFO: `/v3/projects/115eb62cc93d422c8e004b2df22f0a77/users/196c4700e2a44d2e8bc763ada47a8006/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.869407 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce957a01-cf6b-4fca-a115-28952b097bcc admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:07.882869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf59d82-e068-4970-bea1-3821fc39acf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=115eb62cc93d422c8e004b2df22f0a77, user_id=196c4700e2a44d2e8bc763ada47a8006, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.887368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbf59d82-e068-4970-bea1-3821fc39acf0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.914630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 803/1602] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:07 2022] PUT /identity/v3/projects/115eb62cc93d422c8e004b2df22f0a77/users/196c4700e2a44d2e8bc763ada47a8006/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:07.916185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf59d82-e068-4970-bea1-3821fc39acf0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:07.937653 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:07.961903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892a9da-fa0d-4e51-bf98-272f5de203e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:07.963321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892a9da-fa0d-4e51-bf98-272f5de203e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:07.963809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892a9da-fa0d-4e51-bf98-272f5de203e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:07.964302 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892a9da-fa0d-4e51-bf98-272f5de203e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:07.986464 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892a9da-fa0d-4e51-bf98-272f5de203e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:07.987843 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892a9da-fa0d-4e51-bf98-272f5de203e0 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:07.996029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf59d82-e068-4970-bea1-3821fc39acf0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:08.004230 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 800/1603] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:08.005395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892a9da-fa0d-4e51-bf98-272f5de203e0 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:08.005636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750ce7-353e-4bea-b723-c080f22896ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:08.006630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750ce7-353e-4bea-b723-c080f22896ab admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.006630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750ce7-353e-4bea-b723-c080f22896ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.006630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12750ce7-353e-4bea-b723-c080f22896ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.007312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750ce7-353e-4bea-b723-c080f22896ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:08.008951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12750ce7-353e-4bea-b723-c080f22896ab admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:08.017109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892a9da-fa0d-4e51-bf98-272f5de203e0 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:08.025909 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 804/1604] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:08.025909 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750ce7-353e-4bea-b723-c080f22896ab admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:08.029461 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2555ae0b-d91e-42c0-9f6e-2535fda17ca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:08.030504 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555ae0b-d91e-42c0-9f6e-2535fda17ca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.030968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555ae0b-d91e-42c0-9f6e-2535fda17ca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.031510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2555ae0b-d91e-42c0-9f6e-2535fda17ca5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.032318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555ae0b-d91e-42c0-9f6e-2535fda17ca5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:08.034519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2555ae0b-d91e-42c0-9f6e-2535fda17ca5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:08.038313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12750ce7-353e-4bea-b723-c080f22896ab admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:08.044539 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fbea2-7bd2-4772-9274-a32e857d285c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:08.045501 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fbea2-7bd2-4772-9274-a32e857d285c admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.045894 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fbea2-7bd2-4772-9274-a32e857d285c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.046228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75fbea2-7bd2-4772-9274-a32e857d285c admin admin] PATH_INFO: `/v3/projects/06163a2e2bcc409ab3ec0f36108c1603/users/8bccd90e3c8c47b9912729da0179dd94/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.054421 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 801/1605] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:08.056953 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d25bf-9d2a-4d46-8341-f478bd672240 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.057515 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d25bf-9d2a-4d46-8341-f478bd672240 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.058277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d25bf-9d2a-4d46-8341-f478bd672240 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.069738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fbea2-7bd2-4772-9274-a32e857d285c admin admin] RBAC: Authorizing `identity:create_grant(project_id=06163a2e2bcc409ab3ec0f36108c1603, user_id=8bccd90e3c8c47b9912729da0179dd94, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:08.071221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:08.074298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75fbea2-7bd2-4772-9274-a32e857d285c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:08.097910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 805/1606] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:08 2022] PUT /identity/v3/projects/06163a2e2bcc409ab3ec0f36108c1603/users/8bccd90e3c8c47b9912729da0179dd94/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:08.099054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fbea2-7bd2-4772-9274-a32e857d285c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:08.125750 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8e0d25bf-9d2a-4d46-8341-f478bd672240 None None] MFA Rules not processed for user `7b7a860ab49f4b69a1df9bc4fb7ec61c`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:08.128583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8e0d25bf-9d2a-4d46-8341-f478bd672240 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:08.181181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75fbea2-7bd2-4772-9274-a32e857d285c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:08.188336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929e9c9-8aa4-40ae-8fd1-b8b9a33a2f03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:08.188918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929e9c9-8aa4-40ae-8fd1-b8b9a33a2f03 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.189195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929e9c9-8aa4-40ae-8fd1-b8b9a33a2f03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.189474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f929e9c9-8aa4-40ae-8fd1-b8b9a33a2f03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.190169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929e9c9-8aa4-40ae-8fd1-b8b9a33a2f03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:08.192065 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f929e9c9-8aa4-40ae-8fd1-b8b9a33a2f03 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:08.205146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 806/1607] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:08.206058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929e9c9-8aa4-40ae-8fd1-b8b9a33a2f03 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:08.218238 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f929e9c9-8aa4-40ae-8fd1-b8b9a33a2f03 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:08.221437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 802/1608] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:08.222585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d25bf-9d2a-4d46-8341-f478bd672240 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:08.223834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d80ab-d5cc-4933-b710-58c69ae529dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:08.224563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d80ab-d5cc-4933-b710-58c69ae529dc admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.224846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d80ab-d5cc-4933-b710-58c69ae529dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.225163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42d80ab-d5cc-4933-b710-58c69ae529dc admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.225841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d80ab-d5cc-4933-b710-58c69ae529dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:08.227503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42d80ab-d5cc-4933-b710-58c69ae529dc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:08.235711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d25bf-9d2a-4d46-8341-f478bd672240 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:08.239960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 807/1609] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:08.240877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d80ab-d5cc-4933-b710-58c69ae529dc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:08.244817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c5cd55-e4db-4718-9bd1-f0ebb31180a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:08.245585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5cd55-e4db-4718-9bd1-f0ebb31180a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.246006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5cd55-e4db-4718-9bd1-f0ebb31180a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.246367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c5cd55-e4db-4718-9bd1-f0ebb31180a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.247370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5cd55-e4db-4718-9bd1-f0ebb31180a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:08.249377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c5cd55-e4db-4718-9bd1-f0ebb31180a3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:08.255236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42d80ab-d5cc-4933-b710-58c69ae529dc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:08.260945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34cbe1-7017-4943-bd55-cffd2aa669cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:08.261677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34cbe1-7017-4943-bd55-cffd2aa669cb admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.262049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34cbe1-7017-4943-bd55-cffd2aa669cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.262397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da34cbe1-7017-4943-bd55-cffd2aa669cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.267227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34cbe1-7017-4943-bd55-cffd2aa669cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:08.267429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 803/1610] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:08.267533 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da34cbe1-7017-4943-bd55-cffd2aa669cb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:08.267640 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab15997-1ac2-4e35-8c0e-29951a3cf8f9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.267640 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab15997-1ac2-4e35-8c0e-29951a3cf8f9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.267640 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab15997-1ac2-4e35-8c0e-29951a3cf8f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.280577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 808/1611] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:08.281459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34cbe1-7017-4943-bd55-cffd2aa669cb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:08.294671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da34cbe1-7017-4943-bd55-cffd2aa669cb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:08.301262 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ad975-f3b3-4f0a-909e-60dfaafa65ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:08.301262 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ad975-f3b3-4f0a-909e-60dfaafa65ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.301262 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ad975-f3b3-4f0a-909e-60dfaafa65ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.302844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497ad975-f3b3-4f0a-909e-60dfaafa65ff admin admin] PATH_INFO: `/v3/projects/e84c69851ae748f78d67331b22af84b8/users/0e1fee2d310542a2aa47bd33d769e42d/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.304237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-cab15997-1ac2-4e35-8c0e-29951a3cf8f9 None None] MFA Rules not processed for user `8bccd90e3c8c47b9912729da0179dd94`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:08.305589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cab15997-1ac2-4e35-8c0e-29951a3cf8f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:08.329934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ad975-f3b3-4f0a-909e-60dfaafa65ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=e84c69851ae748f78d67331b22af84b8, user_id=0e1fee2d310542a2aa47bd33d769e42d, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:08.332685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497ad975-f3b3-4f0a-909e-60dfaafa65ff admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:08.350537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 809/1612] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:08 2022] PUT /identity/v3/projects/e84c69851ae748f78d67331b22af84b8/users/0e1fee2d310542a2aa47bd33d769e42d/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:08.359104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ad975-f3b3-4f0a-909e-60dfaafa65ff admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:08.399935 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 804/1613] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:08 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:08.400972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab15997-1ac2-4e35-8c0e-29951a3cf8f9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:08.414580 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab15997-1ac2-4e35-8c0e-29951a3cf8f9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:08.427371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:08.460046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497ad975-f3b3-4f0a-909e-60dfaafa65ff admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:08.466566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e6cfa-b3c0-40ce-ac9d-d95d11c5cdd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:08.467412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e6cfa-b3c0-40ce-ac9d-d95d11c5cdd1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.467823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e6cfa-b3c0-40ce-ac9d-d95d11c5cdd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.468168 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e6cfa-b3c0-40ce-ac9d-d95d11c5cdd1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.468931 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e6cfa-b3c0-40ce-ac9d-d95d11c5cdd1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:08.472066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e6cfa-b3c0-40ce-ac9d-d95d11c5cdd1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:08.501676 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec235e0-c10c-4d8e-890c-239b47227791 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:08.502782 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec235e0-c10c-4d8e-890c-239b47227791 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.503083 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec235e0-c10c-4d8e-890c-239b47227791 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.503345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec235e0-c10c-4d8e-890c-239b47227791 admin admin] PATH_INFO: `/v3/projects/115eb62cc93d422c8e004b2df22f0a77/users/196c4700e2a44d2e8bc763ada47a8006/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.506294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec235e0-c10c-4d8e-890c-239b47227791 admin admin] RBAC: Authorizing `identity:create_grant(project_id=115eb62cc93d422c8e004b2df22f0a77, user_id=196c4700e2a44d2e8bc763ada47a8006, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:08.511660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec235e0-c10c-4d8e-890c-239b47227791 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:08.515024 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 810/1614] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:08 2022] POST /identity/v3/projects => generated 371 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:08.521833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e6cfa-b3c0-40ce-ac9d-d95d11c5cdd1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:08.533835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 805/1615] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:08 2022] PUT /identity/v3/projects/115eb62cc93d422c8e004b2df22f0a77/users/196c4700e2a44d2e8bc763ada47a8006/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:08.533835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec235e0-c10c-4d8e-890c-239b47227791 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:08.545257 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:08.630645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e6cfa-b3c0-40ce-ac9d-d95d11c5cdd1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:08.685500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec235e0-c10c-4d8e-890c-239b47227791 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:08.702811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa4d39c-b385-40af-963a-da3c73d6dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:08.704007 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4d39c-b385-40af-963a-da3c73d6dc57 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.704727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4d39c-b385-40af-963a-da3c73d6dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.706829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4d39c-b385-40af-963a-da3c73d6dc57 admin admin] PATH_INFO: `/v3/projects/45a89c6c4dbc489fa8fd54290c97c88e/users/4e5cb514da72438ab36c05399083f109/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.741523 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4d39c-b385-40af-963a-da3c73d6dc57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45a89c6c4dbc489fa8fd54290c97c88e, user_id=4e5cb514da72438ab36c05399083f109, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:08.746238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa4d39c-b385-40af-963a-da3c73d6dc57 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:08.774361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 806/1616] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:08 2022] PUT /identity/v3/projects/45a89c6c4dbc489fa8fd54290c97c88e/users/4e5cb514da72438ab36c05399083f109/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:08.776320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c705-b176-4420-b52f-60780026becc None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.776980 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c705-b176-4420-b52f-60780026becc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.777415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0698c705-b176-4420-b52f-60780026becc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.814522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e1880b-ea9f-4ef5-85d1-8c5d104e4f8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:08.815407 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1880b-ea9f-4ef5-85d1-8c5d104e4f8b admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.815777 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1880b-ea9f-4ef5-85d1-8c5d104e4f8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.816145 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e1880b-ea9f-4ef5-85d1-8c5d104e4f8b admin admin] PATH_INFO: `/v3/projects/04b611fba1c44d49a99a341ad96f4581/users/45156089d449401abc9a163bf1e15d32/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.840316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0698c705-b176-4420-b52f-60780026becc None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:08.842427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0698c705-b176-4420-b52f-60780026becc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:08.844808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1880b-ea9f-4ef5-85d1-8c5d104e4f8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=04b611fba1c44d49a99a341ad96f4581, user_id=45156089d449401abc9a163bf1e15d32, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:08.848616 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e1880b-ea9f-4ef5-85d1-8c5d104e4f8b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:08.876459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 811/1617] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:08 2022] PUT /identity/v3/projects/04b611fba1c44d49a99a341ad96f4581/users/45156089d449401abc9a163bf1e15d32/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:08.880431 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acaf05-39e1-44cb-9eeb-76b5a0854d70 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.880661 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acaf05-39e1-44cb-9eeb-76b5a0854d70 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.882318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69acaf05-39e1-44cb-9eeb-76b5a0854d70 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.886100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 812/1618] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 15 19:18:08 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:18:08.887030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acaf05-39e1-44cb-9eeb-76b5a0854d70 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:08.932792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 807/1619] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:08.934918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7a249-1fdc-4e91-8a8a-fb6ab32e472e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:08.935207 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7a249-1fdc-4e91-8a8a-fb6ab32e472e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:08.935482 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d7a249-1fdc-4e91-8a8a-fb6ab32e472e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:08.968942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-85d7a249-1fdc-4e91-8a8a-fb6ab32e472e None None] MFA Rules not processed for user `196c4700e2a44d2e8bc763ada47a8006`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:08.970879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-85d7a249-1fdc-4e91-8a8a-fb6ab32e472e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:09.003346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:09.036450 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69acaf05-39e1-44cb-9eeb-76b5a0854d70 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:09.054206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6de625d-0cd7-4dc4-aea4-dec6f4a33b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:09.055161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de625d-0cd7-4dc4-aea4-dec6f4a33b43 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:09.055568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de625d-0cd7-4dc4-aea4-dec6f4a33b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:09.055974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6de625d-0cd7-4dc4-aea4-dec6f4a33b43 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:09.056944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de625d-0cd7-4dc4-aea4-dec6f4a33b43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:09.064207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6de625d-0cd7-4dc4-aea4-dec6f4a33b43 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:09.107353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 813/1620] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:08 2022] POST /identity/v3/users => generated 292 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:09.112459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649142d-d59b-4d36-80f1-048a48ff3de0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:09.112691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649142d-d59b-4d36-80f1-048a48ff3de0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:09.113052 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7649142d-d59b-4d36-80f1-048a48ff3de0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:09.137352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 808/1621] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:09.137352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac46d7-3653-4629-a317-b312c574bcdb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:09.137352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac46d7-3653-4629-a317-b312c574bcdb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:09.137352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fac46d7-3653-4629-a317-b312c574bcdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:09.143275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7649142d-d59b-4d36-80f1-048a48ff3de0 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:09.145035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7649142d-d59b-4d36-80f1-048a48ff3de0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:09.154232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 814/1622] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:09.155909 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac80b4-fd72-42c0-8cd0-d2af73ae4be9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:09.156255 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac80b4-fd72-42c0-8cd0-d2af73ae4be9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:09.156560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac80b4-fd72-42c0-8cd0-d2af73ae4be9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:09.158770 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0fac46d7-3653-4629-a317-b312c574bcdb None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:09.160177 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0fac46d7-3653-4629-a317-b312c574bcdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:09.172705 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 809/1623] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:09.172705 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac46d7-3653-4629-a317-b312c574bcdb None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:09.191176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:09.263137 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-53ac80b4-fd72-42c0-8cd0-d2af73ae4be9 None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:09.264295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-53ac80b4-fd72-42c0-8cd0-d2af73ae4be9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:09.315119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fac46d7-3653-4629-a317-b312c574bcdb None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:09.328341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b0af4-fe3b-4ba8-a924-a1a146daffca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:09.330790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b0af4-fe3b-4ba8-a924-a1a146daffca service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:09.330790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b0af4-fe3b-4ba8-a924-a1a146daffca service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:09.330790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1b0af4-fe3b-4ba8-a924-a1a146daffca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:09.357104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b0af4-fe3b-4ba8-a924-a1a146daffca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:09.362511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1b0af4-fe3b-4ba8-a924-a1a146daffca service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:09.385998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 810/1624] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:09.387829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b0af4-fe3b-4ba8-a924-a1a146daffca service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:09.423145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1b0af4-fe3b-4ba8-a924-a1a146daffca service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:09.429767 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c881f0-f2f8-4ab5-b448-69952e20dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:09.430570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c881f0-f2f8-4ab5-b448-69952e20dd24 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:09.430976 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c881f0-f2f8-4ab5-b448-69952e20dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:09.432259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c881f0-f2f8-4ab5-b448-69952e20dd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:09.433341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c881f0-f2f8-4ab5-b448-69952e20dd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:09.437852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c881f0-f2f8-4ab5-b448-69952e20dd24 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:09.439998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 815/1625] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 15 19:18:09 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:09.441046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac80b4-fd72-42c0-8cd0-d2af73ae4be9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:09.471756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 811/1626] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:09.475920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c881f0-f2f8-4ab5-b448-69952e20dd24 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:09.500229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c881f0-f2f8-4ab5-b448-69952e20dd24 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:09.510116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd6720-fc47-41dd-8a5b-06c861a0e088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:09.510768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd6720-fc47-41dd-8a5b-06c861a0e088 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:09.511047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd6720-fc47-41dd-8a5b-06c861a0e088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:09.511323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2cd6720-fc47-41dd-8a5b-06c861a0e088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:09.511428 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac80b4-fd72-42c0-8cd0-d2af73ae4be9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:09.516917 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a49283-bf02-4352-8fbd-b7acd832525d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:09.517632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a49283-bf02-4352-8fbd-b7acd832525d service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:09.518285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a49283-bf02-4352-8fbd-b7acd832525d service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:09.518558 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a49283-bf02-4352-8fbd-b7acd832525d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:09.531247 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd6720-fc47-41dd-8a5b-06c861a0e088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:09.532780 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2cd6720-fc47-41dd-8a5b-06c861a0e088 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:09.532982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a49283-bf02-4352-8fbd-b7acd832525d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:09.538771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a49283-bf02-4352-8fbd-b7acd832525d service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:09.544659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 812/1627] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:09.545866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd6720-fc47-41dd-8a5b-06c861a0e088 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:09.558148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2cd6720-fc47-41dd-8a5b-06c861a0e088 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:09.563766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129601d3-8164-486b-b75c-a6b250f63b0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:09.565704 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129601d3-8164-486b-b75c-a6b250f63b0a service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:09.566257 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129601d3-8164-486b-b75c-a6b250f63b0a service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:09.566727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129601d3-8164-486b-b75c-a6b250f63b0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:09.577390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 816/1628] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:09.578498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a49283-bf02-4352-8fbd-b7acd832525d service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:09.581652 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129601d3-8164-486b-b75c-a6b250f63b0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:09.583662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129601d3-8164-486b-b75c-a6b250f63b0a service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:09.601093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 813/1629] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:09.602624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129601d3-8164-486b-b75c-a6b250f63b0a service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:09.605930 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a49283-bf02-4352-8fbd-b7acd832525d service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:09.616191 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129601d3-8164-486b-b75c-a6b250f63b0a service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:09.621551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7b1e0-71f4-45b0-b2f4-61f094ee76ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:09.622320 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7b1e0-71f4-45b0-b2f4-61f094ee76ca service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:09.622603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7b1e0-71f4-45b0-b2f4-61f094ee76ca service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:09.622882 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7b1e0-71f4-45b0-b2f4-61f094ee76ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:09.623354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211afc2-75ea-4ad4-8357-31d2fc7762a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:09.624342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211afc2-75ea-4ad4-8357-31d2fc7762a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:09.624973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211afc2-75ea-4ad4-8357-31d2fc7762a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:09.626059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1211afc2-75ea-4ad4-8357-31d2fc7762a5 admin admin] PATH_INFO: `/v3/projects/97a987360a4d49a888f8f8b4e523f826/users/05b6a54e7777487697c9cd36e792ad6b/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:09.655683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211afc2-75ea-4ad4-8357-31d2fc7762a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a987360a4d49a888f8f8b4e523f826, user_id=05b6a54e7777487697c9cd36e792ad6b, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:09.660568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1211afc2-75ea-4ad4-8357-31d2fc7762a5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:09.690746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 814/1630] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:09 2022] PUT /identity/v3/projects/97a987360a4d49a888f8f8b4e523f826/users/05b6a54e7777487697c9cd36e792ad6b/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:09.696095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211afc2-75ea-4ad4-8357-31d2fc7762a5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:09.777044 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:09.781228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7b1e0-71f4-45b0-b2f4-61f094ee76ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:09.783810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7b1e0-71f4-45b0-b2f4-61f094ee76ca service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:09.799898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 817/1631] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:09 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:10.023645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1211afc2-75ea-4ad4-8357-31d2fc7762a5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:10.075579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1b9de4-6d3a-46d7-8822-c87fdea19fc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:10.077973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b9de4-6d3a-46d7-8822-c87fdea19fc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:10.078419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b9de4-6d3a-46d7-8822-c87fdea19fc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:10.079303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1b9de4-6d3a-46d7-8822-c87fdea19fc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:10.082637 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b9de4-6d3a-46d7-8822-c87fdea19fc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:10.088684 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1b9de4-6d3a-46d7-8822-c87fdea19fc0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:10.116656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 815/1632] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:09 2022] GET /identity/v3/roles => generated 1420 bytes in 417 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:10.117354 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7b1e0-71f4-45b0-b2f4-61f094ee76ca service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:10.154789 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7b1e0-71f4-45b0-b2f4-61f094ee76ca service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:10.185074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f68a-da97-43ba-8fe1-f88594152a89 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:10.185369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f68a-da97-43ba-8fe1-f88594152a89 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:10.185627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f68a-da97-43ba-8fe1-f88594152a89 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:10.186480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fdd7e7e-2274-4bb8-a440-4099787211e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:10.187347 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 816/1633] 10.222.0.25 () {54 vars in 912 bytes} [Thu Sep 15 19:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:18:10.191455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd7e7e-2274-4bb8-a440-4099787211e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:10.192172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd7e7e-2274-4bb8-a440-4099787211e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:10.192666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fdd7e7e-2274-4bb8-a440-4099787211e2 admin admin] PATH_INFO: `/v3/projects/97a987360a4d49a888f8f8b4e523f826/users/05b6a54e7777487697c9cd36e792ad6b/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:10.198529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d57349-6c92-4293-81f9-2cb672f6ec59 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:10.198815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d57349-6c92-4293-81f9-2cb672f6ec59 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:10.199098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d57349-6c92-4293-81f9-2cb672f6ec59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:10.200090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd7e7e-2274-4bb8-a440-4099787211e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97a987360a4d49a888f8f8b4e523f826, user_id=05b6a54e7777487697c9cd36e792ad6b, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:10.220152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fdd7e7e-2274-4bb8-a440-4099787211e2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:10.238798 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f5d57349-6c92-4293-81f9-2cb672f6ec59 None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:10.240512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f5d57349-6c92-4293-81f9-2cb672f6ec59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:10.250128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 818/1634] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:10 2022] PUT /identity/v3/projects/97a987360a4d49a888f8f8b4e523f826/users/05b6a54e7777487697c9cd36e792ad6b/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:10.251987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81417648-b49e-4d21-a7f9-0986fdcaab6f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:10.255811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81417648-b49e-4d21-a7f9-0986fdcaab6f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:10.256242 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81417648-b49e-4d21-a7f9-0986fdcaab6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:10.336815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:10.347994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-81417648-b49e-4d21-a7f9-0986fdcaab6f None None] MFA Rules not processed for user `05b6a54e7777487697c9cd36e792ad6b`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:10.354097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-81417648-b49e-4d21-a7f9-0986fdcaab6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:10.402093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 817/1635] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:18:10.413762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d57349-6c92-4293-81f9-2cb672f6ec59 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:10.540230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 819/1636] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:10 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:10.575549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d57349-6c92-4293-81f9-2cb672f6ec59 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:10.589323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cf14c-dc8a-41c8-be14-2601a0d285e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:10.592037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cf14c-dc8a-41c8-be14-2601a0d285e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:10.592467 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cf14c-dc8a-41c8-be14-2601a0d285e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:10.592847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992cf14c-dc8a-41c8-be14-2601a0d285e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:10.606760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81417648-b49e-4d21-a7f9-0986fdcaab6f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:10.623610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cf14c-dc8a-41c8-be14-2601a0d285e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:10.625755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992cf14c-dc8a-41c8-be14-2601a0d285e7 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:10.629698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81417648-b49e-4d21-a7f9-0986fdcaab6f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:10.634473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacfb96-1dab-4d92-8c91-185ea4c0deff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:10.635288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacfb96-1dab-4d92-8c91-185ea4c0deff service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:10.636011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacfb96-1dab-4d92-8c91-185ea4c0deff service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:10.636011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aacfb96-1dab-4d92-8c91-185ea4c0deff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:10.652910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacfb96-1dab-4d92-8c91-185ea4c0deff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:10.654573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aacfb96-1dab-4d92-8c91-185ea4c0deff service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:10.657904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 818/1637] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:18:10.676305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 820/1638] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:18:11.107412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cf14c-dc8a-41c8-be14-2601a0d285e7 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:11.108305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacfb96-1dab-4d92-8c91-185ea4c0deff service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:11.128718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aacfb96-1dab-4d92-8c91-185ea4c0deff service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:11.151343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a390818-ba25-4b6f-80d5-6093d18428d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:11.151987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a390818-ba25-4b6f-80d5-6093d18428d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:11.152281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a390818-ba25-4b6f-80d5-6093d18428d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:11.153045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a390818-ba25-4b6f-80d5-6093d18428d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:11.309046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a390818-ba25-4b6f-80d5-6093d18428d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:11.311015 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a390818-ba25-4b6f-80d5-6093d18428d3 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:11.323545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 821/1639] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:11 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:11.353084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992cf14c-dc8a-41c8-be14-2601a0d285e7 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:11.371719 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:11.373384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:11.373910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:11.374384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] PATH_INFO: `/v3/users/1d81232bd8534879b74df60287a0933b` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:11.376553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d81232bd8534879b74df60287a0933b)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:11.385609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:11.497320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d81232bd8534879b74df60287a0933b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:11.519228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d81232bd8534879b74df60287a0933b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:11.520071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d81232bd8534879b74df60287a0933b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:11.520773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d81232bd8534879b74df60287a0933b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:11.538256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d81232bd8534879b74df60287a0933b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:11.579720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:11.590000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 819/1640] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:18:11 2022] DELETE /identity/v3/users/1d81232bd8534879b74df60287a0933b => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:11.595036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9413a-13f1-4ca9-a382-0da1ec529267 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:11.596418 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9413a-13f1-4ca9-a382-0da1ec529267 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:11.596418 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9413a-13f1-4ca9-a382-0da1ec529267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:11.639881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-13e9413a-13f1-4ca9-a382-0da1ec529267 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:11.647903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-13e9413a-13f1-4ca9-a382-0da1ec529267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:11.813519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:11.844602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 822/1641] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:11.902264 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:11.903873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:12.120000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c7f356-4cae-4b3c-bf5b-c7fc058d5975 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:12.138594 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c4d655-6a74-4fab-bfd9-fbf2fcc13d78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:12.140513 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d655-6a74-4fab-bfd9-fbf2fcc13d78 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:12.140742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d655-6a74-4fab-bfd9-fbf2fcc13d78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:12.140934 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c4d655-6a74-4fab-bfd9-fbf2fcc13d78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:12.195414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4d655-6a74-4fab-bfd9-fbf2fcc13d78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:12.195414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c4d655-6a74-4fab-bfd9-fbf2fcc13d78 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:12.211052 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 820/1642] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:13.028633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2aa246-44a1-451a-8aa2-e7b5692b6c74 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:13.029520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2aa246-44a1-451a-8aa2-e7b5692b6c74 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:13.030020 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2aa246-44a1-451a-8aa2-e7b5692b6c74 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:13.031651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 823/1643] 10.222.0.25 () {54 vars in 962 bytes} [Thu Sep 15 19:18:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:18:13.043612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f828e-3924-4d66-8d4c-d141322a98c1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:13.044156 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f828e-3924-4d66-8d4c-d141322a98c1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:13.044240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302f828e-3924-4d66-8d4c-d141322a98c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:13.079888 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-302f828e-3924-4d66-8d4c-d141322a98c1 None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:13.081142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-302f828e-3924-4d66-8d4c-d141322a98c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:13.248198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 821/1644] 10.222.0.25 () {58 vars in 1059 bytes} [Thu Sep 15 19:18:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:13.256063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7b85-e15b-4478-bcfd-57f25a4cc64e None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:13.256575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7b85-e15b-4478-bcfd-57f25a4cc64e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:13.257053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452d7b85-e15b-4478-bcfd-57f25a4cc64e None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:13.260113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 824/1645] 10.222.0.25 () {54 vars in 912 bytes} [Thu Sep 15 19:18:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:18:13.266723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f828e-3924-4d66-8d4c-d141322a98c1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:13.274298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7699ed-ea93-40b1-8831-a2e970b37872 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:13.274795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7699ed-ea93-40b1-8831-a2e970b37872 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:13.275290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7699ed-ea93-40b1-8831-a2e970b37872 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:13.278536 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-302f828e-3924-4d66-8d4c-d141322a98c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:13.381089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302f828e-3924-4d66-8d4c-d141322a98c1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:13.400555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:13.402916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ed7699ed-ea93-40b1-8831-a2e970b37872 None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:13.403289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:13.403782 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:13.404313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] PATH_INFO: `/v3/projects/fe7f5b5a571843b69a553c668ae8e7a3` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:13.407192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ed7699ed-ea93-40b1-8831-a2e970b37872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:13.408289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe7f5b5a571843b69a553c668ae8e7a3)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:13.410754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: WARNING py.warnings [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:18:13.410754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: warnings.warn(msg) Sep 15 19:18:13.410754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: Sep 15 19:18:13.414002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:13.434079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 825/1646] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:18:13 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:13.455269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7699ed-ea93-40b1-8831-a2e970b37872 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:13.459321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ed7699ed-ea93-40b1-8831-a2e970b37872 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:13.587002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe7f5b5a571843b69a553c668ae8e7a3', 'request_id': 'req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:13.618131 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe7f5b5a571843b69a553c668ae8e7a3', 'request_id': 'req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:13.636258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe7f5b5a571843b69a553c668ae8e7a3', 'request_id': 'req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:13.667121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] The token cache is being invalidate because project fe7f5b5a571843b69a553c668ae8e7a3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:18:13.667639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:13.669424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:13.674826 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 822/1647] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:18:13 2022] DELETE /identity/v3/projects/fe7f5b5a571843b69a553c668ae8e7a3 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:13.680340 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:13.683995 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:13.693982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7699ed-ea93-40b1-8831-a2e970b37872 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:13.739630 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:13.843616 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce0ad5-b4d6-4830-bad8-7854e1c7c7d3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:13.847204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce0ad5-b4d6-4830-bad8-7854e1c7c7d3 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:13.847794 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce0ad5-b4d6-4830-bad8-7854e1c7c7d3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:13.848074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ce0ad5-b4d6-4830-bad8-7854e1c7c7d3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:13.857421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-74ce0ad5-b4d6-4830-bad8-7854e1c7c7d3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:13.906449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd44d00-4157-4b4c-8fd3-a2c9112aa2ac admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:13.922755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f239cc-ca79-433b-8cb1-6fdbd4db5819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:13.924334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f239cc-ca79-433b-8cb1-6fdbd4db5819 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:13.926528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f239cc-ca79-433b-8cb1-6fdbd4db5819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:13.926528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f239cc-ca79-433b-8cb1-6fdbd4db5819 admin admin] PATH_INFO: `/v3/users/196c4700e2a44d2e8bc763ada47a8006` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:13.929498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f239cc-ca79-433b-8cb1-6fdbd4db5819 admin admin] RBAC: Authorizing `identity:delete_user(user_id=196c4700e2a44d2e8bc763ada47a8006)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:13.941851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f239cc-ca79-433b-8cb1-6fdbd4db5819 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:14.041562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce0ad5-b4d6-4830-bad8-7854e1c7c7d3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:14.044279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ce0ad5-b4d6-4830-bad8-7854e1c7c7d3 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:14.059355 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 826/1648] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:14.078995 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-42f239cc-ca79-433b-8cb1-6fdbd4db5819 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '196c4700e2a44d2e8bc763ada47a8006'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:14.102125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-42f239cc-ca79-433b-8cb1-6fdbd4db5819 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '196c4700e2a44d2e8bc763ada47a8006'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:14.103259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-42f239cc-ca79-433b-8cb1-6fdbd4db5819 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '196c4700e2a44d2e8bc763ada47a8006'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:14.104155 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-42f239cc-ca79-433b-8cb1-6fdbd4db5819 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '196c4700e2a44d2e8bc763ada47a8006'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:14.122519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-42f239cc-ca79-433b-8cb1-6fdbd4db5819 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '196c4700e2a44d2e8bc763ada47a8006'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:14.178017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 823/1649] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:18:13 2022] DELETE /identity/v3/users/196c4700e2a44d2e8bc763ada47a8006 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:16.555366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce0ad5-b4d6-4830-bad8-7854e1c7c7d3 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:16.574131 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ce0ad5-b4d6-4830-bad8-7854e1c7c7d3 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:16.724450 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:16.767226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ae577c-6f70-4f31-a329-2e980faaec3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:16.768403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae577c-6f70-4f31-a329-2e980faaec3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:16.769361 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae577c-6f70-4f31-a329-2e980faaec3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:16.769649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ae577c-6f70-4f31-a329-2e980faaec3d admin admin] PATH_INFO: `/v3/projects/115eb62cc93d422c8e004b2df22f0a77` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:16.773443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae577c-6f70-4f31-a329-2e980faaec3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=115eb62cc93d422c8e004b2df22f0a77)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:16.775965 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ae577c-6f70-4f31-a329-2e980faaec3d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:16.919321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64ae577c-6f70-4f31-a329-2e980faaec3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115eb62cc93d422c8e004b2df22f0a77', 'request_id': 'req-64ae577c-6f70-4f31-a329-2e980faaec3d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:16.930931 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64ae577c-6f70-4f31-a329-2e980faaec3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115eb62cc93d422c8e004b2df22f0a77', 'request_id': 'req-64ae577c-6f70-4f31-a329-2e980faaec3d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:16.969128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64ae577c-6f70-4f31-a329-2e980faaec3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115eb62cc93d422c8e004b2df22f0a77', 'request_id': 'req-64ae577c-6f70-4f31-a329-2e980faaec3d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:17.006102 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64ae577c-6f70-4f31-a329-2e980faaec3d admin admin] The token cache is being invalidate because project 115eb62cc93d422c8e004b2df22f0a77 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:18:17.007681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64ae577c-6f70-4f31-a329-2e980faaec3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:17.010030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-64ae577c-6f70-4f31-a329-2e980faaec3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:17.018507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 827/1650] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:18:16 2022] DELETE /identity/v3/projects/115eb62cc93d422c8e004b2df22f0a77 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:17.019741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2b8c-a2a6-4297-acf5-3bbd0831b1fe None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:17.020450 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2b8c-a2a6-4297-acf5-3bbd0831b1fe None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:17.020450 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ea2b8c-a2a6-4297-acf5-3bbd0831b1fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:17.074985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e5ea2b8c-a2a6-4297-acf5-3bbd0831b1fe None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:17.079229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e5ea2b8c-a2a6-4297-acf5-3bbd0831b1fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:17.240659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 824/1651] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:17.251874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235978f-d330-45d1-8389-6c67eecde95a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:17.252581 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235978f-d330-45d1-8389-6c67eecde95a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:17.253404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4235978f-d330-45d1-8389-6c67eecde95a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:17.292246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4235978f-d330-45d1-8389-6c67eecde95a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:17.295350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4235978f-d330-45d1-8389-6c67eecde95a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:17.312974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 828/1652] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:17.314535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea2b8c-a2a6-4297-acf5-3bbd0831b1fe None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:17.334887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ea2b8c-a2a6-4297-acf5-3bbd0831b1fe None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:17.345987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba5c74-26a5-4946-8f19-b2f62a55a8f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:17.346622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba5c74-26a5-4946-8f19-b2f62a55a8f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:17.346881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba5c74-26a5-4946-8f19-b2f62a55a8f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:17.347174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cba5c74-26a5-4946-8f19-b2f62a55a8f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:17.348003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba5c74-26a5-4946-8f19-b2f62a55a8f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:18:17.349171 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba5c74-26a5-4946-8f19-b2f62a55a8f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:17.351142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cba5c74-26a5-4946-8f19-b2f62a55a8f8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:17.376424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 825/1653] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:18:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:18:17.379467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235978f-d330-45d1-8389-6c67eecde95a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:17.401510 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4235978f-d330-45d1-8389-6c67eecde95a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:17.407707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dd016-50bd-4685-bcaf-0c8e99e38c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:17.409526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dd016-50bd-4685-bcaf-0c8e99e38c9e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:17.410146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dd016-50bd-4685-bcaf-0c8e99e38c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:17.410642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc8dd016-50bd-4685-bcaf-0c8e99e38c9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:17.412340 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dd016-50bd-4685-bcaf-0c8e99e38c9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:17.416180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc8dd016-50bd-4685-bcaf-0c8e99e38c9e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:17.485406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 829/1654] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:17 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:17.486386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba5c74-26a5-4946-8f19-b2f62a55a8f8 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:17.513836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cba5c74-26a5-4946-8f19-b2f62a55a8f8 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:17.566150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:17.676379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086587d-d6e9-4c20-991d-335e46fe0261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:17.677642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086587d-d6e9-4c20-991d-335e46fe0261 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:17.678308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086587d-d6e9-4c20-991d-335e46fe0261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:17.678754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0086587d-d6e9-4c20-991d-335e46fe0261 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:17.680032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086587d-d6e9-4c20-991d-335e46fe0261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:17.690094 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0086587d-d6e9-4c20-991d-335e46fe0261 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:17.751347 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 826/1655] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:17 2022] POST /identity/v3/users => generated 282 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:17.753080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dd016-50bd-4685-bcaf-0c8e99e38c9e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:17.768045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc8dd016-50bd-4685-bcaf-0c8e99e38c9e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:17.775452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e563c-90b4-468d-a607-96a68bc55906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:17.776089 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e563c-90b4-468d-a607-96a68bc55906 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:17.776363 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e563c-90b4-468d-a607-96a68bc55906 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:17.776690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e563c-90b4-468d-a607-96a68bc55906 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:17.777540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e563c-90b4-468d-a607-96a68bc55906 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:17.779454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1e563c-90b4-468d-a607-96a68bc55906 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:17.799921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 830/1656] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:18:17.801271 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086587d-d6e9-4c20-991d-335e46fe0261 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:17.824500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0086587d-d6e9-4c20-991d-335e46fe0261 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:17.834751 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb0e92-81ee-4edd-80b1-8a296a0db81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:17.835401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb0e92-81ee-4edd-80b1-8a296a0db81c admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:17.835680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb0e92-81ee-4edd-80b1-8a296a0db81c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:17.836066 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb0e92-81ee-4edd-80b1-8a296a0db81c admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:17.836786 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb0e92-81ee-4edd-80b1-8a296a0db81c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:17.838760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bb0e92-81ee-4edd-80b1-8a296a0db81c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:17.861812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 827/1657] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:17 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:17.868216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e563c-90b4-468d-a607-96a68bc55906 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:17.881506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e563c-90b4-468d-a607-96a68bc55906 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:17.894064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f983d72-7fbe-4fa2-92b8-c941c1e8362b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:17.894064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f983d72-7fbe-4fa2-92b8-c941c1e8362b admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:17.894064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f983d72-7fbe-4fa2-92b8-c941c1e8362b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:17.894064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f983d72-7fbe-4fa2-92b8-c941c1e8362b admin admin] PATH_INFO: `/v3/projects/a16700e2430d4d04885b9a21881b7c8d/users/2002b1b7b59b4a4e8b44d27b879ae067/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:17.930371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f983d72-7fbe-4fa2-92b8-c941c1e8362b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16700e2430d4d04885b9a21881b7c8d, user_id=2002b1b7b59b4a4e8b44d27b879ae067, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:17.936702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f983d72-7fbe-4fa2-92b8-c941c1e8362b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:17.964236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 831/1658] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:17 2022] PUT /identity/v3/projects/a16700e2430d4d04885b9a21881b7c8d/users/2002b1b7b59b4a4e8b44d27b879ae067/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:17.976284 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e4999-9e85-489b-8fb6-d79d25e8f449 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:17.976732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e4999-9e85-489b-8fb6-d79d25e8f449 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:17.977187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a83e4999-9e85-489b-8fb6-d79d25e8f449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:18.024474 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a83e4999-9e85-489b-8fb6-d79d25e8f449 None None] MFA Rules not processed for user `2002b1b7b59b4a4e8b44d27b879ae067`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:18.026051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a83e4999-9e85-489b-8fb6-d79d25e8f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:18.262867 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 828/1659] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:17 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:18.269097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f983d72-7fbe-4fa2-92b8-c941c1e8362b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:18.431799 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e4999-9e85-489b-8fb6-d79d25e8f449 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:18.433428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a83e4999-9e85-489b-8fb6-d79d25e8f449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:18.507982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f983d72-7fbe-4fa2-92b8-c941c1e8362b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:18.527003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20e036-974e-4e51-aa28-78f947466f96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:18.527649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20e036-974e-4e51-aa28-78f947466f96 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:18.527925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20e036-974e-4e51-aa28-78f947466f96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:18.528193 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f20e036-974e-4e51-aa28-78f947466f96 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:18.528963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20e036-974e-4e51-aa28-78f947466f96 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:18.533699 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f20e036-974e-4e51-aa28-78f947466f96 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:18.568595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:18.597364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 832/1660] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:18 2022] POST /identity/v3/projects => generated 363 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:18.602315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20e036-974e-4e51-aa28-78f947466f96 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:18.647435 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a83e4999-9e85-489b-8fb6-d79d25e8f449 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:18.764425 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:18.833346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f20e036-974e-4e51-aa28-78f947466f96 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:18.846746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5bf9f-8a4c-4b36-81c1-4500741f19de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:18.847451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5bf9f-8a4c-4b36-81c1-4500741f19de admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:18.847755 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5bf9f-8a4c-4b36-81c1-4500741f19de admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:18.847966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5bf9f-8a4c-4b36-81c1-4500741f19de admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:18.850410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5bf9f-8a4c-4b36-81c1-4500741f19de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:18.856690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5bf9f-8a4c-4b36-81c1-4500741f19de admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:18.879974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66efb154-79d0-4f1e-ae2a-2a26cad0c761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:18.880771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efb154-79d0-4f1e-ae2a-2a26cad0c761 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:18.881047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efb154-79d0-4f1e-ae2a-2a26cad0c761 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:18.881316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66efb154-79d0-4f1e-ae2a-2a26cad0c761 admin admin] PATH_INFO: `/v3/users/8bccd90e3c8c47b9912729da0179dd94` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:18.883676 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efb154-79d0-4f1e-ae2a-2a26cad0c761 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bccd90e3c8c47b9912729da0179dd94)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:18.886171 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66efb154-79d0-4f1e-ae2a-2a26cad0c761 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:18.958901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 833/1661] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:18 2022] POST /identity/v3/users => generated 288 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:18.961843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5bf9f-8a4c-4b36-81c1-4500741f19de admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:18.996392 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5bf9f-8a4c-4b36-81c1-4500741f19de admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:19.017366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd20cc-0c6b-4e0d-9f2a-4e0260fe5773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:19.017366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd20cc-0c6b-4e0d-9f2a-4e0260fe5773 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:19.017366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd20cc-0c6b-4e0d-9f2a-4e0260fe5773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:19.018638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6dd20cc-0c6b-4e0d-9f2a-4e0260fe5773 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:19.025704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd20cc-0c6b-4e0d-9f2a-4e0260fe5773 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:19.029759 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6dd20cc-0c6b-4e0d-9f2a-4e0260fe5773 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:19.065015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-66efb154-79d0-4f1e-ae2a-2a26cad0c761 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bccd90e3c8c47b9912729da0179dd94'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:19.078804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 834/1662] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:18 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:19.083062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd20cc-0c6b-4e0d-9f2a-4e0260fe5773 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:19.089652 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-66efb154-79d0-4f1e-ae2a-2a26cad0c761 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bccd90e3c8c47b9912729da0179dd94'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:19.091800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-66efb154-79d0-4f1e-ae2a-2a26cad0c761 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bccd90e3c8c47b9912729da0179dd94'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:19.092988 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-66efb154-79d0-4f1e-ae2a-2a26cad0c761 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bccd90e3c8c47b9912729da0179dd94'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:19.119481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-66efb154-79d0-4f1e-ae2a-2a26cad0c761 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bccd90e3c8c47b9912729da0179dd94'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:19.125395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6dd20cc-0c6b-4e0d-9f2a-4e0260fe5773 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:19.146560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eb244-9960-49f9-86d6-a559af23a053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:19.147279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eb244-9960-49f9-86d6-a559af23a053 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:19.147560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eb244-9960-49f9-86d6-a559af23a053 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:19.147839 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326eb244-9960-49f9-86d6-a559af23a053 admin admin] PATH_INFO: `/v3/projects/b893431677224efd87942627d161b84c/users/cc323fb4c0624dba915b067f113e88bb/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:19.194547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eb244-9960-49f9-86d6-a559af23a053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b893431677224efd87942627d161b84c, user_id=cc323fb4c0624dba915b067f113e88bb, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:19.197918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326eb244-9960-49f9-86d6-a559af23a053 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:19.234503 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 829/1663] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:18:18 2022] DELETE /identity/v3/users/8bccd90e3c8c47b9912729da0179dd94 => generated 0 bytes in 800 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:19.236278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 835/1664] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:19 2022] PUT /identity/v3/projects/b893431677224efd87942627d161b84c/users/cc323fb4c0624dba915b067f113e88bb/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:19.240675 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eb244-9960-49f9-86d6-a559af23a053 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:19.242036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ec7a-1a43-4d6f-8e62-70f334ab61f3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:19.243757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-326eb244-9960-49f9-86d6-a559af23a053 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:19.243898 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ec7a-1a43-4d6f-8e62-70f334ab61f3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:19.244281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ec7a-1a43-4d6f-8e62-70f334ab61f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:19.339794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-8603ec7a-1a43-4d6f-8e62-70f334ab61f3 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:19.348448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8603ec7a-1a43-4d6f-8e62-70f334ab61f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:19.446206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326eb244-9960-49f9-86d6-a559af23a053 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:19.556844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 830/1665] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:19.635820 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:19.661833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2107dd5-93c7-4222-ab18-342c8de5127d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:19.661833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2107dd5-93c7-4222-ab18-342c8de5127d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:19.661833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2107dd5-93c7-4222-ab18-342c8de5127d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:19.661833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2107dd5-93c7-4222-ab18-342c8de5127d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:19.662477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2107dd5-93c7-4222-ab18-342c8de5127d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:19.663292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2107dd5-93c7-4222-ab18-342c8de5127d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:19.676812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ec7a-1a43-4d6f-8e62-70f334ab61f3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:19.679029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8603ec7a-1a43-4d6f-8e62-70f334ab61f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:19.702365 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 836/1666] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:19 2022] GET /identity/v3/roles => generated 1420 bytes in 462 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:19.707326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2107dd5-93c7-4222-ab18-342c8de5127d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:19.743451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2107dd5-93c7-4222-ab18-342c8de5127d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:19.764461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d05fe8-c8f3-4679-b739-c63e18a914c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:19.769901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d05fe8-c8f3-4679-b739-c63e18a914c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:19.770622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d05fe8-c8f3-4679-b739-c63e18a914c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:19.771108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d05fe8-c8f3-4679-b739-c63e18a914c2 admin admin] PATH_INFO: `/v3/projects/b893431677224efd87942627d161b84c/users/cc323fb4c0624dba915b067f113e88bb/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:19.786222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d05fe8-c8f3-4679-b739-c63e18a914c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b893431677224efd87942627d161b84c, user_id=cc323fb4c0624dba915b067f113e88bb, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:19.790428 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d05fe8-c8f3-4679-b739-c63e18a914c2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:19.826696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 837/1667] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:19 2022] PUT /identity/v3/projects/b893431677224efd87942627d161b84c/users/cc323fb4c0624dba915b067f113e88bb/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:19.837128 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ec7a-1a43-4d6f-8e62-70f334ab61f3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:19.838623 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91fec4-e097-439a-bba4-2a2351aa9d7d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:19.839318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91fec4-e097-439a-bba4-2a2351aa9d7d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:19.839318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a91fec4-e097-439a-bba4-2a2351aa9d7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:19.878948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:19.919654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7a91fec4-e097-439a-bba4-2a2351aa9d7d None None] MFA Rules not processed for user `cc323fb4c0624dba915b067f113e88bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:19.920874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7a91fec4-e097-439a-bba4-2a2351aa9d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:19.992975 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cef89-fca9-43ae-8f20-e212e7c84162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:19.992975 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cef89-fca9-43ae-8f20-e212e7c84162 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:19.992975 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cef89-fca9-43ae-8f20-e212e7c84162 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:19.993487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12cef89-fca9-43ae-8f20-e212e7c84162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:20.094543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 838/1668] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:19 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:18:20.108639 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91fec4-e097-439a-bba4-2a2351aa9d7d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:20.117142 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7a91fec4-e097-439a-bba4-2a2351aa9d7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:20.203419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cef89-fca9-43ae-8f20-e212e7c84162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:20.208171 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12cef89-fca9-43ae-8f20-e212e7c84162 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:20.236797 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 831/1669] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:18:20.290586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a91fec4-e097-439a-bba4-2a2351aa9d7d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:20.317061 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45768e-f68a-41b8-a5e6-bb22d8247367 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:20.322092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45768e-f68a-41b8-a5e6-bb22d8247367 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:20.322468 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45768e-f68a-41b8-a5e6-bb22d8247367 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:20.322725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45768e-f68a-41b8-a5e6-bb22d8247367 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:20.368491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45768e-f68a-41b8-a5e6-bb22d8247367 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:20.371381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45768e-f68a-41b8-a5e6-bb22d8247367 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:20.407320 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 839/1670] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:20 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:20.591731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cef89-fca9-43ae-8f20-e212e7c84162 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:20.593566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d12cef89-fca9-43ae-8f20-e212e7c84162 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:20.631707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12cef89-fca9-43ae-8f20-e212e7c84162 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:20.648070 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed9f906-1217-45a7-89bf-794442046121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:20.649224 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9f906-1217-45a7-89bf-794442046121 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:20.649550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9f906-1217-45a7-89bf-794442046121 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:20.649851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed9f906-1217-45a7-89bf-794442046121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:20.655579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7ed9f906-1217-45a7-89bf-794442046121 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:20.823774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9f906-1217-45a7-89bf-794442046121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:20.846892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed9f906-1217-45a7-89bf-794442046121 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:20.870917 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 832/1671] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:23.147731 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45768e-f68a-41b8-a5e6-bb22d8247367 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:23.149421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7c45768e-f68a-41b8-a5e6-bb22d8247367 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:23.182441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45768e-f68a-41b8-a5e6-bb22d8247367 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:23.202973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3daa89-804d-450d-b09b-07b8b76bdcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:23.204189 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3daa89-804d-450d-b09b-07b8b76bdcf1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:23.204626 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3daa89-804d-450d-b09b-07b8b76bdcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:23.205030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3daa89-804d-450d-b09b-07b8b76bdcf1 admin admin] PATH_INFO: `/v3/projects/06163a2e2bcc409ab3ec0f36108c1603` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:23.206950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3daa89-804d-450d-b09b-07b8b76bdcf1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06163a2e2bcc409ab3ec0f36108c1603)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:23.215062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3daa89-804d-450d-b09b-07b8b76bdcf1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:23.417031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fd3daa89-804d-450d-b09b-07b8b76bdcf1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06163a2e2bcc409ab3ec0f36108c1603', 'request_id': 'req-fd3daa89-804d-450d-b09b-07b8b76bdcf1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:23.452712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fd3daa89-804d-450d-b09b-07b8b76bdcf1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06163a2e2bcc409ab3ec0f36108c1603', 'request_id': 'req-fd3daa89-804d-450d-b09b-07b8b76bdcf1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:23.487668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fd3daa89-804d-450d-b09b-07b8b76bdcf1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06163a2e2bcc409ab3ec0f36108c1603', 'request_id': 'req-fd3daa89-804d-450d-b09b-07b8b76bdcf1'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:23.491695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:23.527205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fd3daa89-804d-450d-b09b-07b8b76bdcf1 admin admin] The token cache is being invalidate because project 06163a2e2bcc409ab3ec0f36108c1603 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:18:23.527800 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fd3daa89-804d-450d-b09b-07b8b76bdcf1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:23.528710 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fd3daa89-804d-450d-b09b-07b8b76bdcf1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:23.532337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 840/1672] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:18:23 2022] DELETE /identity/v3/projects/06163a2e2bcc409ab3ec0f36108c1603 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:23.540099 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eca0fd-6c8e-4751-b797-9eee9fd0f37c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:23.541581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eca0fd-6c8e-4751-b797-9eee9fd0f37c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:23.542327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eca0fd-6c8e-4751-b797-9eee9fd0f37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:23.587826 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c7eca0fd-6c8e-4751-b797-9eee9fd0f37c None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:23.589388 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c7eca0fd-6c8e-4751-b797-9eee9fd0f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:23.729246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 833/1673] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:23.737070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f67fd-68d5-4839-a9c4-1a717bc27643 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:23.737700 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f67fd-68d5-4839-a9c4-1a717bc27643 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:23.738209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048f67fd-68d5-4839-a9c4-1a717bc27643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:23.768962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-048f67fd-68d5-4839-a9c4-1a717bc27643 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:23.772249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-048f67fd-68d5-4839-a9c4-1a717bc27643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:23.795524 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 841/1674] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:23.800920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eca0fd-6c8e-4751-b797-9eee9fd0f37c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:23.824227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:23.839242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7eca0fd-6c8e-4751-b797-9eee9fd0f37c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:23.849873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dec1d6-7d5a-4031-9bd2-5619924efff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:23.851313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dec1d6-7d5a-4031-9bd2-5619924efff7 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:23.852029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dec1d6-7d5a-4031-9bd2-5619924efff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:23.852568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2dec1d6-7d5a-4031-9bd2-5619924efff7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:23.855053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dec1d6-7d5a-4031-9bd2-5619924efff7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:18:23.855674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dec1d6-7d5a-4031-9bd2-5619924efff7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:23.859891 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2dec1d6-7d5a-4031-9bd2-5619924efff7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:23.916638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 834/1675] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:18:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:18:23.922000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f67fd-68d5-4839-a9c4-1a717bc27643 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:23.935958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048f67fd-68d5-4839-a9c4-1a717bc27643 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:23.956304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad68a4-a21f-438b-82be-18204abcadc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:23.956588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad68a4-a21f-438b-82be-18204abcadc7 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:23.956866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad68a4-a21f-438b-82be-18204abcadc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:23.957107 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fad68a4-a21f-438b-82be-18204abcadc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:23.957962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad68a4-a21f-438b-82be-18204abcadc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:23.959921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fad68a4-a21f-438b-82be-18204abcadc7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:24.020735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 842/1676] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:23 2022] POST /identity/v3/projects => generated 367 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:24.023416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dec1d6-7d5a-4031-9bd2-5619924efff7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:24.036938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2dec1d6-7d5a-4031-9bd2-5619924efff7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:24.194513 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6a092-75a6-41ec-a0bc-93a069bae258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:24.195787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6a092-75a6-41ec-a0bc-93a069bae258 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:24.196594 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6a092-75a6-41ec-a0bc-93a069bae258 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:24.197260 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a6a092-75a6-41ec-a0bc-93a069bae258 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:24.198692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6a092-75a6-41ec-a0bc-93a069bae258 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:24.208064 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a6a092-75a6-41ec-a0bc-93a069bae258 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:24.327569 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 835/1677] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:24 2022] POST /identity/v3/users => generated 284 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:24.331937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad68a4-a21f-438b-82be-18204abcadc7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:24.348488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fad68a4-a21f-438b-82be-18204abcadc7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:24.363194 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4fa7e-fadb-4365-a3df-204cca2f2018 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:24.363839 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4fa7e-fadb-4365-a3df-204cca2f2018 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:24.364183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4fa7e-fadb-4365-a3df-204cca2f2018 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:24.364464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d4fa7e-fadb-4365-a3df-204cca2f2018 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:24.365127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4fa7e-fadb-4365-a3df-204cca2f2018 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:24.366802 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d4fa7e-fadb-4365-a3df-204cca2f2018 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:24.399696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 843/1678] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:24.401607 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6a092-75a6-41ec-a0bc-93a069bae258 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:24.433910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a6a092-75a6-41ec-a0bc-93a069bae258 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:24.450250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46533f04-6782-44b4-979e-1dedd42994d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:24.451379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46533f04-6782-44b4-979e-1dedd42994d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:24.452749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46533f04-6782-44b4-979e-1dedd42994d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:24.453856 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46533f04-6782-44b4-979e-1dedd42994d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:24.455035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46533f04-6782-44b4-979e-1dedd42994d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:24.459598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46533f04-6782-44b4-979e-1dedd42994d3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:24.517491 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 836/1679] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:24 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:24.521933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4fa7e-fadb-4365-a3df-204cca2f2018 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:24.533916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d4fa7e-fadb-4365-a3df-204cca2f2018 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:24.558594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc1a55c-6cf9-46e1-83fc-41e772ccdbd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:24.559313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a55c-6cf9-46e1-83fc-41e772ccdbd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:24.559594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a55c-6cf9-46e1-83fc-41e772ccdbd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:24.559875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc1a55c-6cf9-46e1-83fc-41e772ccdbd0 admin admin] PATH_INFO: `/v3/projects/e2ce22eaa1674845bd38d391f0b93ee7/users/7e6e68e4217a476f9cb9d08b3c2063b6/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:24.607208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46533f04-6782-44b4-979e-1dedd42994d3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:24.610137 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-46533f04-6782-44b4-979e-1dedd42994d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:24.628014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a55c-6cf9-46e1-83fc-41e772ccdbd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ce22eaa1674845bd38d391f0b93ee7, user_id=7e6e68e4217a476f9cb9d08b3c2063b6, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:24.629661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46533f04-6782-44b4-979e-1dedd42994d3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:24.630864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc1a55c-6cf9-46e1-83fc-41e772ccdbd0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:24.636298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16832bf1-b861-4be8-9914-42398de176af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:24.637331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16832bf1-b861-4be8-9914-42398de176af admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:24.637744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16832bf1-b861-4be8-9914-42398de176af admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:24.638176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16832bf1-b861-4be8-9914-42398de176af admin admin] PATH_INFO: `/v3/users/2002b1b7b59b4a4e8b44d27b879ae067` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:24.640895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16832bf1-b861-4be8-9914-42398de176af admin admin] RBAC: Authorizing `identity:delete_user(user_id=2002b1b7b59b4a4e8b44d27b879ae067)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:24.643820 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16832bf1-b861-4be8-9914-42398de176af admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:24.694921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 844/1680] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:24 2022] PUT /identity/v3/projects/e2ce22eaa1674845bd38d391f0b93ee7/users/7e6e68e4217a476f9cb9d08b3c2063b6/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:24.697057 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1fb53-14f6-4fa7-8869-5c2ee23c652f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:24.697522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1fb53-14f6-4fa7-8869-5c2ee23c652f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:24.701201 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc1fb53-14f6-4fa7-8869-5c2ee23c652f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:24.784852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-16832bf1-b861-4be8-9914-42398de176af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2002b1b7b59b4a4e8b44d27b879ae067'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:24.798128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0dc1fb53-14f6-4fa7-8869-5c2ee23c652f None None] MFA Rules not processed for user `0e1fee2d310542a2aa47bd33d769e42d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:24.799425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0dc1fb53-14f6-4fa7-8869-5c2ee23c652f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:24.815588 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-16832bf1-b861-4be8-9914-42398de176af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2002b1b7b59b4a4e8b44d27b879ae067'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:24.816216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-16832bf1-b861-4be8-9914-42398de176af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2002b1b7b59b4a4e8b44d27b879ae067'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:24.816838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-16832bf1-b861-4be8-9914-42398de176af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2002b1b7b59b4a4e8b44d27b879ae067'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:24.843278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-16832bf1-b861-4be8-9914-42398de176af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2002b1b7b59b4a4e8b44d27b879ae067'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:24.920951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 837/1681] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:18:24 2022] DELETE /identity/v3/users/2002b1b7b59b4a4e8b44d27b879ae067 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:18:24.922520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955a105-90d7-45b6-9417-a2c97164f989 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:24.922803 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955a105-90d7-45b6-9417-a2c97164f989 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:24.923286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2955a105-90d7-45b6-9417-a2c97164f989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:24.995788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2955a105-90d7-45b6-9417-a2c97164f989 None None] MFA Rules not processed for user `7e6e68e4217a476f9cb9d08b3c2063b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:24.997063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2955a105-90d7-45b6-9417-a2c97164f989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:25.037847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 845/1682] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:24 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:25.037847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c752ff-4799-4c70-ab25-a5437aa4c929 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:25.037847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c752ff-4799-4c70-ab25-a5437aa4c929 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:25.037847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c752ff-4799-4c70-ab25-a5437aa4c929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:25.071145 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-58c752ff-4799-4c70-ab25-a5437aa4c929 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:25.072165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-58c752ff-4799-4c70-ab25-a5437aa4c929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:25.076186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:25.154817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 838/1683] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:25.156293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf0342-3e64-44ab-9080-b37385769964 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:25.156587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf0342-3e64-44ab-9080-b37385769964 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:25.156858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaf0342-3e64-44ab-9080-b37385769964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:25.199707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-cdaf0342-3e64-44ab-9080-b37385769964 None None] MFA Rules not processed for user `0e1fee2d310542a2aa47bd33d769e42d`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:25.201003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cdaf0342-3e64-44ab-9080-b37385769964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:25.216095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 846/1684] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:25.217038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c752ff-4799-4c70-ab25-a5437aa4c929 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:25.218817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-58c752ff-4799-4c70-ab25-a5437aa4c929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:25.264157 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:25.343400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 839/1685] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:25.344667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf0342-3e64-44ab-9080-b37385769964 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:25.352230 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cdaf0342-3e64-44ab-9080-b37385769964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:25.367426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c752ff-4799-4c70-ab25-a5437aa4c929 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:25.377662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc81c5-5375-4fcd-a253-e76b1a92a8aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:25.379195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc81c5-5375-4fcd-a253-e76b1a92a8aa service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:25.379912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc81c5-5375-4fcd-a253-e76b1a92a8aa service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:25.381308 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfc81c5-5375-4fcd-a253-e76b1a92a8aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:25.416864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc81c5-5375-4fcd-a253-e76b1a92a8aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:25.418735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfc81c5-5375-4fcd-a253-e76b1a92a8aa service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:25.446899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 847/1686] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:25 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:25.448082 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc81c5-5375-4fcd-a253-e76b1a92a8aa service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:25.449655 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9cfc81c5-5375-4fcd-a253-e76b1a92a8aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:25.567668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaf0342-3e64-44ab-9080-b37385769964 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:25.576374 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f41a77-f9e5-482c-9da7-b57903b196a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:25.577036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f41a77-f9e5-482c-9da7-b57903b196a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:25.577307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f41a77-f9e5-482c-9da7-b57903b196a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:25.577574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f41a77-f9e5-482c-9da7-b57903b196a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:25.606751 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f41a77-f9e5-482c-9da7-b57903b196a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:25.608273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f41a77-f9e5-482c-9da7-b57903b196a7 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:25.632658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfc81c5-5375-4fcd-a253-e76b1a92a8aa service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:25.646126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 840/1687] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:25.647359 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e893df-d13d-4e13-9a70-f05ac0ea5487 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:25.649829 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fff45-ffd0-4114-b5c1-1cb410826a89 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:25.650455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e893df-d13d-4e13-9a70-f05ac0ea5487 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:25.650564 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fff45-ffd0-4114-b5c1-1cb410826a89 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:25.650738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fff45-ffd0-4114-b5c1-1cb410826a89 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:25.651001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e893df-d13d-4e13-9a70-f05ac0ea5487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:25.651108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7fff45-ffd0-4114-b5c1-1cb410826a89 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:25.669368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fff45-ffd0-4114-b5c1-1cb410826a89 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:25.672418 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7fff45-ffd0-4114-b5c1-1cb410826a89 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:25.694890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 848/1688] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:25 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:25.725660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-17e893df-d13d-4e13-9a70-f05ac0ea5487 None None] MFA Rules not processed for user `a5a8b4618308488dabdef27763f291e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:25.728341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-17e893df-d13d-4e13-9a70-f05ac0ea5487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:25.916043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 841/1689] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:26.009714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fff45-ffd0-4114-b5c1-1cb410826a89 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:26.011611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ac7fff45-ffd0-4114-b5c1-1cb410826a89 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:26.053940 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7fff45-ffd0-4114-b5c1-1cb410826a89 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:26.079671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6677afef-8a2a-45b8-8677-96096e8d186c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:26.082102 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677afef-8a2a-45b8-8677-96096e8d186c service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:26.083589 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677afef-8a2a-45b8-8677-96096e8d186c service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:26.085057 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6677afef-8a2a-45b8-8677-96096e8d186c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:26.118395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677afef-8a2a-45b8-8677-96096e8d186c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:26.124941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6677afef-8a2a-45b8-8677-96096e8d186c service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:26.169000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 849/1690] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:18:26.931426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8ec8d-f53d-4b4f-9fc3-464eb1e18590 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:26.932565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8ec8d-f53d-4b4f-9fc3-464eb1e18590 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:26.933070 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8ec8d-f53d-4b4f-9fc3-464eb1e18590 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:26.936676 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 842/1691] 10.222.0.25 () {54 vars in 912 bytes} [Thu Sep 15 19:18:26 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:18:26.945927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026eb9-0e0e-42d3-8dcc-166ad907ebfd None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:26.946859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026eb9-0e0e-42d3-8dcc-166ad907ebfd None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:26.947284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8026eb9-0e0e-42d3-8dcc-166ad907ebfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:27.052459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c8026eb9-0e0e-42d3-8dcc-166ad907ebfd None None] MFA Rules not processed for user `4591e01ab4954b22a81f6b09cdb2d544`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:27.062087 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c8026eb9-0e0e-42d3-8dcc-166ad907ebfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:27.083549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 850/1692] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:18:26 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:27.281488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8ec8d-f53d-4b4f-9fc3-464eb1e18590 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:27.283964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-65b8ec8d-f53d-4b4f-9fc3-464eb1e18590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:27.341130 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8ec8d-f53d-4b4f-9fc3-464eb1e18590 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:27.357473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84a5bd-fcb3-4c69-bf46-5a6c308e9ce9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:27.358571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84a5bd-fcb3-4c69-bf46-5a6c308e9ce9 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:27.362670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84a5bd-fcb3-4c69-bf46-5a6c308e9ce9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:27.364244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea84a5bd-fcb3-4c69-bf46-5a6c308e9ce9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:27.395061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:27.409150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84a5bd-fcb3-4c69-bf46-5a6c308e9ce9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:27.411364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea84a5bd-fcb3-4c69-bf46-5a6c308e9ce9 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:27.450860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 843/1693] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:27 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:29.564317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026eb9-0e0e-42d3-8dcc-166ad907ebfd None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:29.567457 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c8026eb9-0e0e-42d3-8dcc-166ad907ebfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:29.934233 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8026eb9-0e0e-42d3-8dcc-166ad907ebfd None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:29.978834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017cd24-442c-4c3d-b40a-a0081a66f03b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d5f3ec00844cf28c01a14f8a071a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:29.990678 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017cd24-442c-4c3d-b40a-a0081a66f03b service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:29.993382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017cd24-442c-4c3d-b40a-a0081a66f03b service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:29.995011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7017cd24-442c-4c3d-b40a-a0081a66f03b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:30.013715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7017cd24-442c-4c3d-b40a-a0081a66f03b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:30.048373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84a5bd-fcb3-4c69-bf46-5a6c308e9ce9 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:30.053237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ea84a5bd-fcb3-4c69-bf46-5a6c308e9ce9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:30.093283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017cd24-442c-4c3d-b40a-a0081a66f03b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:30.101367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7017cd24-442c-4c3d-b40a-a0081a66f03b service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:30.153627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 851/1694] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:29 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:30.207017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea84a5bd-fcb3-4c69-bf46-5a6c308e9ce9 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:30.259165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:30.260407 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:30.268794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:30.269265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d admin admin] PATH_INFO: `/v3/projects/a16700e2430d4d04885b9a21881b7c8d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:30.289071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16700e2430d4d04885b9a21881b7c8d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:30.319075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:30.719146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16700e2430d4d04885b9a21881b7c8d', 'request_id': 'req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:30.777524 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16700e2430d4d04885b9a21881b7c8d', 'request_id': 'req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:30.817188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16700e2430d4d04885b9a21881b7c8d', 'request_id': 'req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:30.844396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d admin admin] The token cache is being invalidate because project a16700e2430d4d04885b9a21881b7c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:18:30.844943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:30.847054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-32b4a87f-7ce4-45d4-9dbd-24ff5c8f3f5d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:30.850432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 844/1695] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:18:30 2022] DELETE /identity/v3/projects/a16700e2430d4d04885b9a21881b7c8d => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:30.855621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017cd24-442c-4c3d-b40a-a0081a66f03b service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:30.862860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:30.872283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7017cd24-442c-4c3d-b40a-a0081a66f03b service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:30.996791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e0fed9-715b-4930-bcaa-a7e1bb958835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:30.999454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0fed9-715b-4930-bcaa-a7e1bb958835 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:31.000512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0fed9-715b-4930-bcaa-a7e1bb958835 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:31.001521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e0fed9-715b-4930-bcaa-a7e1bb958835 admin admin] PATH_INFO: `/v3/users/cc323fb4c0624dba915b067f113e88bb` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:31.005533 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0fed9-715b-4930-bcaa-a7e1bb958835 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc323fb4c0624dba915b067f113e88bb)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:31.008807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: WARNING py.warnings [None req-05e0fed9-715b-4930-bcaa-a7e1bb958835 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 15 19:18:31.008807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: warnings.warn(msg) Sep 15 19:18:31.008807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: Sep 15 19:18:31.012616 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e0fed9-715b-4930-bcaa-a7e1bb958835 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:31.182368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-05e0fed9-715b-4930-bcaa-a7e1bb958835 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc323fb4c0624dba915b067f113e88bb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:31.207178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-05e0fed9-715b-4930-bcaa-a7e1bb958835 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc323fb4c0624dba915b067f113e88bb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:31.208098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-05e0fed9-715b-4930-bcaa-a7e1bb958835 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc323fb4c0624dba915b067f113e88bb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:31.209516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-05e0fed9-715b-4930-bcaa-a7e1bb958835 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc323fb4c0624dba915b067f113e88bb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:31.242708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-05e0fed9-715b-4930-bcaa-a7e1bb958835 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc323fb4c0624dba915b067f113e88bb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:31.387617 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 852/1696] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:18:30 2022] DELETE /identity/v3/users/cc323fb4c0624dba915b067f113e88bb => generated 0 bytes in 530 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:31.951252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e4e6-57b4-4303-8db1-208558c3c618 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:31.954696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e4e6-57b4-4303-8db1-208558c3c618 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:31.955239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5e4e6-57b4-4303-8db1-208558c3c618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:32.250908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-faa5e4e6-57b4-4303-8db1-208558c3c618 None None] MFA Rules not processed for user `6a7f1fb1137c4fa7aa572631db1b00ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:32.264424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-faa5e4e6-57b4-4303-8db1-208558c3c618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:32.456400 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e9988-b677-457c-91b6-baa1ae22fbcc None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:32.457005 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e9988-b677-457c-91b6-baa1ae22fbcc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:32.457563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5e9988-b677-457c-91b6-baa1ae22fbcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:32.625446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fb5e9988-b677-457c-91b6-baa1ae22fbcc None None] MFA Rules not processed for user `45156089d449401abc9a163bf1e15d32`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:32.635072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fb5e9988-b677-457c-91b6-baa1ae22fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:32.720513 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 845/1697] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 786 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:32.732452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b3b08-1c36-49c3-ac42-bb0c1e489491 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:32.733210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b3b08-1c36-49c3-ac42-bb0c1e489491 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:32.734252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500b3b08-1c36-49c3-ac42-bb0c1e489491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:32.795469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-500b3b08-1c36-49c3-ac42-bb0c1e489491 None None] MFA Rules not processed for user `6a7f1fb1137c4fa7aa572631db1b00ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:32.798515 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-500b3b08-1c36-49c3-ac42-bb0c1e489491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:32.815549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 846/1698] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:32 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:18:32.868629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 853/1699] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:32 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 415 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:33.003797 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b3b08-1c36-49c3-ac42-bb0c1e489491 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:33.008006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-500b3b08-1c36-49c3-ac42-bb0c1e489491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:33.266400 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e9988-b677-457c-91b6-baa1ae22fbcc None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:33.272074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fb5e9988-b677-457c-91b6-baa1ae22fbcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:33.403541 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:33.463375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:33.517767 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500b3b08-1c36-49c3-ac42-bb0c1e489491 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:33.527272 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4820-175d-44d6-9110-d8fd9bf4317a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:33.528471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4820-175d-44d6-9110-d8fd9bf4317a service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:33.529017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4820-175d-44d6-9110-d8fd9bf4317a service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:33.529479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50b4820-175d-44d6-9110-d8fd9bf4317a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:33.559361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b4820-175d-44d6-9110-d8fd9bf4317a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:33.563056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50b4820-175d-44d6-9110-d8fd9bf4317a service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:33.594509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 847/1700] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:33.595887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4820-175d-44d6-9110-d8fd9bf4317a service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:33.601764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f50b4820-175d-44d6-9110-d8fd9bf4317a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:33.667223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50b4820-175d-44d6-9110-d8fd9bf4317a service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:33.713257 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916f5eac-192b-4c28-8605-d53d815bfbb8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:33.716812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f5eac-192b-4c28-8605-d53d815bfbb8 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:33.717465 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f5eac-192b-4c28-8605-d53d815bfbb8 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:33.718059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916f5eac-192b-4c28-8605-d53d815bfbb8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:33.731199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5e9988-b677-457c-91b6-baa1ae22fbcc None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:33.748480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f5eac-192b-4c28-8605-d53d815bfbb8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:33.752522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916f5eac-192b-4c28-8605-d53d815bfbb8 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:33.753230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:33.770894 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:33.773913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:33.774435 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0 admin admin] PATH_INFO: `/v3/projects/b893431677224efd87942627d161b84c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:33.792280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b893431677224efd87942627d161b84c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:33.800125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:33.803874 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 848/1701] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:33 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:34.063521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b893431677224efd87942627d161b84c', 'request_id': 'req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:34.080203 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b893431677224efd87942627d161b84c', 'request_id': 'req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:34.109501 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b893431677224efd87942627d161b84c', 'request_id': 'req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:34.169617 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0 admin admin] The token cache is being invalidate because project b893431677224efd87942627d161b84c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:18:34.174043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:34.176117 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5031a4d-c1b0-497d-b8c2-aa103899fbe0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:34.185207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 854/1702] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:18:33 2022] DELETE /identity/v3/projects/b893431677224efd87942627d161b84c => generated 0 bytes in 920 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:34.190959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c58dd7-6f0e-4792-8bd1-94e61b2e9fbf None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:34.192094 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c58dd7-6f0e-4792-8bd1-94e61b2e9fbf None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:34.192513 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c58dd7-6f0e-4792-8bd1-94e61b2e9fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:34.248323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-62c58dd7-6f0e-4792-8bd1-94e61b2e9fbf None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:34.250001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-62c58dd7-6f0e-4792-8bd1-94e61b2e9fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:34.476818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 849/1703] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:34.489200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb23b31-e197-4a02-88ba-7b3a3e225cc0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:34.489670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb23b31-e197-4a02-88ba-7b3a3e225cc0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:34.490232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb23b31-e197-4a02-88ba-7b3a3e225cc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:34.631696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4fb23b31-e197-4a02-88ba-7b3a3e225cc0 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:34.644626 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4fb23b31-e197-4a02-88ba-7b3a3e225cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:34.690085 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 855/1704] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:34.692142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c58dd7-6f0e-4792-8bd1-94e61b2e9fbf None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:34.771128 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c58dd7-6f0e-4792-8bd1-94e61b2e9fbf None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:34.823841 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8c4fa-a81a-4db8-af93-69e8ac4c606c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:34.824843 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8c4fa-a81a-4db8-af93-69e8ac4c606c admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:34.825373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8c4fa-a81a-4db8-af93-69e8ac4c606c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:34.825813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd8c4fa-a81a-4db8-af93-69e8ac4c606c admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:34.839045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8c4fa-a81a-4db8-af93-69e8ac4c606c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:18:34.839579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8c4fa-a81a-4db8-af93-69e8ac4c606c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:34.860167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd8c4fa-a81a-4db8-af93-69e8ac4c606c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:34.951036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 850/1705] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:18:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:18:34.953124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb23b31-e197-4a02-88ba-7b3a3e225cc0 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:34.982573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb23b31-e197-4a02-88ba-7b3a3e225cc0 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:34.999923 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df077e0-873b-4c04-a829-b8a6c1645434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:35.005222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df077e0-873b-4c04-a829-b8a6c1645434 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:35.009775 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df077e0-873b-4c04-a829-b8a6c1645434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:35.010329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df077e0-873b-4c04-a829-b8a6c1645434 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:35.011757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df077e0-873b-4c04-a829-b8a6c1645434 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:35.021861 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df077e0-873b-4c04-a829-b8a6c1645434 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:35.173663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 856/1706] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:34 2022] POST /identity/v3/projects => generated 381 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:35.176486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8c4fa-a81a-4db8-af93-69e8ac4c606c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:35.213943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd8c4fa-a81a-4db8-af93-69e8ac4c606c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:35.569605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19641419-4035-493a-9259-b001e3c9b769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:35.572335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19641419-4035-493a-9259-b001e3c9b769 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:35.572706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19641419-4035-493a-9259-b001e3c9b769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:35.572967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19641419-4035-493a-9259-b001e3c9b769 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:35.573613 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19641419-4035-493a-9259-b001e3c9b769 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:35.589438 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19641419-4035-493a-9259-b001e3c9b769 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:35.668785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 851/1707] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:35 2022] POST /identity/v3/users => generated 291 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:18:35.675585 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df077e0-873b-4c04-a829-b8a6c1645434 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:35.695905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df077e0-873b-4c04-a829-b8a6c1645434 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:35.717557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974226-77d7-43b2-8032-ef0739bdf5a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:35.721418 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974226-77d7-43b2-8032-ef0739bdf5a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:35.721713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974226-77d7-43b2-8032-ef0739bdf5a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:35.722013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e974226-77d7-43b2-8032-ef0739bdf5a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:35.722717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e974226-77d7-43b2-8032-ef0739bdf5a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:35.724363 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e974226-77d7-43b2-8032-ef0739bdf5a8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:35.746670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 857/1708] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:35.752240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19641419-4035-493a-9259-b001e3c9b769 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:35.784907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19641419-4035-493a-9259-b001e3c9b769 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:35.810699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151476ee-303f-462d-ad99-4adb873194f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:35.812085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151476ee-303f-462d-ad99-4adb873194f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:35.813895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151476ee-303f-462d-ad99-4adb873194f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:35.814525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151476ee-303f-462d-ad99-4adb873194f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:35.817500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151476ee-303f-462d-ad99-4adb873194f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:35.825389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151476ee-303f-462d-ad99-4adb873194f9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:35.884431 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 852/1709] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:35 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:35.886378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974226-77d7-43b2-8032-ef0739bdf5a8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:35.904884 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e974226-77d7-43b2-8032-ef0739bdf5a8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:35.922571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf8ba5a-b9db-42be-8c4e-18760ae7b88f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:35.923019 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8ba5a-b9db-42be-8c4e-18760ae7b88f admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:35.923460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8ba5a-b9db-42be-8c4e-18760ae7b88f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:35.924453 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf8ba5a-b9db-42be-8c4e-18760ae7b88f admin admin] PATH_INFO: `/v3/projects/6bd8deccce8d4a588d5d17c4c1c81f20/users/21946c048f004d80924f44d658e41ad9/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:35.963797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8ba5a-b9db-42be-8c4e-18760ae7b88f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd8deccce8d4a588d5d17c4c1c81f20, user_id=21946c048f004d80924f44d658e41ad9, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:35.970831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf8ba5a-b9db-42be-8c4e-18760ae7b88f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:36.000064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 858/1710] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:35 2022] PUT /identity/v3/projects/6bd8deccce8d4a588d5d17c4c1c81f20/users/21946c048f004d80924f44d658e41ad9/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:36.012881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e3188-f65d-4f24-b251-9c78bc396b8a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:36.015589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e3188-f65d-4f24-b251-9c78bc396b8a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:36.016186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230e3188-f65d-4f24-b251-9c78bc396b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:36.082046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-230e3188-f65d-4f24-b251-9c78bc396b8a None None] MFA Rules not processed for user `21946c048f004d80924f44d658e41ad9`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:36.084844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-230e3188-f65d-4f24-b251-9c78bc396b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:36.142888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2091-3af6-4371-a202-31fa5c399df7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:36.143680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2091-3af6-4371-a202-31fa5c399df7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:36.144294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365c2091-3af6-4371-a202-31fa5c399df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:36.180529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:36.265505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-365c2091-3af6-4371-a202-31fa5c399df7 None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:36.268581 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-365c2091-3af6-4371-a202-31fa5c399df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:36.314275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:36.395919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 853/1711] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:36 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:18:36.397222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e3188-f65d-4f24-b251-9c78bc396b8a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:36.575952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 859/1712] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:18:36 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 434 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:18:36.580994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd878d5-7b7a-4184-8560-b6edee444195 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:36.580994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd878d5-7b7a-4184-8560-b6edee444195 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:36.581432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd878d5-7b7a-4184-8560-b6edee444195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:36.588475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230e3188-f65d-4f24-b251-9c78bc396b8a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:36.610788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f035e51-534a-49a7-a97b-e097c440a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:36.614539 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f035e51-534a-49a7-a97b-e097c440a578 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:36.616016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f035e51-534a-49a7-a97b-e097c440a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:36.617002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f035e51-534a-49a7-a97b-e097c440a578 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:36.622692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f035e51-534a-49a7-a97b-e097c440a578 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:36.628760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f035e51-534a-49a7-a97b-e097c440a578 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:36.713016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6dd878d5-7b7a-4184-8560-b6edee444195 None None] MFA Rules not processed for user `4e5cb514da72438ab36c05399083f109`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:36.716983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6dd878d5-7b7a-4184-8560-b6edee444195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:36.786964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 854/1713] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:36 2022] POST /identity/v3/projects => generated 381 bytes in 390 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:18:36.799445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f035e51-534a-49a7-a97b-e097c440a578 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:36.928664 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 860/1714] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 352 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:36.932407 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd878d5-7b7a-4184-8560-b6edee444195 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:36.936104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6dd878d5-7b7a-4184-8560-b6edee444195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:37.137985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f035e51-534a-49a7-a97b-e097c440a578 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:37.164068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc369059-ac2a-487b-8b50-8852639cbb35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:37.164793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc369059-ac2a-487b-8b50-8852639cbb35 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:37.166925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc369059-ac2a-487b-8b50-8852639cbb35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:37.167214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc369059-ac2a-487b-8b50-8852639cbb35 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:37.167907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc369059-ac2a-487b-8b50-8852639cbb35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:37.169964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc369059-ac2a-487b-8b50-8852639cbb35 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:37.255855 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd878d5-7b7a-4184-8560-b6edee444195 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:37.268409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 855/1715] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:36 2022] POST /identity/v3/users => generated 297 bytes in 470 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:37.272488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc369059-ac2a-487b-8b50-8852639cbb35 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:37.315541 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc369059-ac2a-487b-8b50-8852639cbb35 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:37.335717 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1267d871-f017-42f6-bad7-a68161b01a61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:37.336314 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:37.336759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267d871-f017-42f6-bad7-a68161b01a61 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:37.337204 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267d871-f017-42f6-bad7-a68161b01a61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:37.337598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1267d871-f017-42f6-bad7-a68161b01a61 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:37.338440 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267d871-f017-42f6-bad7-a68161b01a61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:37.342545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1267d871-f017-42f6-bad7-a68161b01a61 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:37.391806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 856/1716] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:37 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:37.402938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239ef7c-930d-4d99-98f0-6abd6ee56245 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:37.403572 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239ef7c-930d-4d99-98f0-6abd6ee56245 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:37.403672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239ef7c-930d-4d99-98f0-6abd6ee56245 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:37.517121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab75d1-6588-485a-8297-3757757ce3ba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:37.517803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab75d1-6588-485a-8297-3757757ce3ba service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:37.518090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab75d1-6588-485a-8297-3757757ce3ba service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:37.518362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ab75d1-6588-485a-8297-3757757ce3ba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:37.562137 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d239ef7c-930d-4d99-98f0-6abd6ee56245 None None] MFA Rules not processed for user `6a7f1fb1137c4fa7aa572631db1b00ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:37.576099 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d239ef7c-930d-4d99-98f0-6abd6ee56245 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:37.767669 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab75d1-6588-485a-8297-3757757ce3ba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:37.775205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ab75d1-6588-485a-8297-3757757ce3ba service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:37.778522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:37.831564 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 861/1717] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:18:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 900 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 19:18:37.832524 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab75d1-6588-485a-8297-3757757ce3ba service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:37.845947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-73ab75d1-6588-485a-8297-3757757ce3ba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:38.005525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 857/1718] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 611 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:38.005525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239ef7c-930d-4d99-98f0-6abd6ee56245 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:38.058971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239ef7c-930d-4d99-98f0-6abd6ee56245 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:38.087198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8e683-b183-4e90-a203-12eb7210361f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:38.088269 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e683-b183-4e90-a203-12eb7210361f admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:38.088737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e683-b183-4e90-a203-12eb7210361f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:38.089229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8e683-b183-4e90-a203-12eb7210361f admin admin] PATH_INFO: `/v3/projects/d09b2f69e47a49409af54c3e1fbd9854/users/132eb6d8698147c4938bcab7167785c3/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:38.188264 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8e683-b183-4e90-a203-12eb7210361f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09b2f69e47a49409af54c3e1fbd9854, user_id=132eb6d8698147c4938bcab7167785c3, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:38.194984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8e683-b183-4e90-a203-12eb7210361f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:38.228174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 858/1719] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:38 2022] PUT /identity/v3/projects/d09b2f69e47a49409af54c3e1fbd9854/users/132eb6d8698147c4938bcab7167785c3/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:38.236930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8e683-b183-4e90-a203-12eb7210361f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:38.429504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ab75d1-6588-485a-8297-3757757ce3ba service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:38.581755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8e683-b183-4e90-a203-12eb7210361f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:38.635334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89f714-448e-4acf-a693-0f4851059025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:38.636378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89f714-448e-4acf-a693-0f4851059025 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:38.639170 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89f714-448e-4acf-a693-0f4851059025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:38.639697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec89f714-448e-4acf-a693-0f4851059025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:38.642774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89f714-448e-4acf-a693-0f4851059025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:38.651094 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec89f714-448e-4acf-a693-0f4851059025 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:38.694282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 859/1720] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:38 2022] GET /identity/v3/roles => generated 1420 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:38.711514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89f714-448e-4acf-a693-0f4851059025 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:38.751904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec89f714-448e-4acf-a693-0f4851059025 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:38.772498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a24f07-9fd0-4d0f-8912-abf39fee4a2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:38.774049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a24f07-9fd0-4d0f-8912-abf39fee4a2b admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:38.775002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a24f07-9fd0-4d0f-8912-abf39fee4a2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:38.775645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a24f07-9fd0-4d0f-8912-abf39fee4a2b admin admin] PATH_INFO: `/v3/projects/d09b2f69e47a49409af54c3e1fbd9854/users/132eb6d8698147c4938bcab7167785c3/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:38.778291 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a24f07-9fd0-4d0f-8912-abf39fee4a2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09b2f69e47a49409af54c3e1fbd9854, user_id=132eb6d8698147c4938bcab7167785c3, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:38.785730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a24f07-9fd0-4d0f-8912-abf39fee4a2b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:38.814993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 860/1721] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:38 2022] PUT /identity/v3/projects/d09b2f69e47a49409af54c3e1fbd9854/users/132eb6d8698147c4938bcab7167785c3/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:38.819717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:38.826998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2951bb-af6a-49b1-8de5-dd4852725c0c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:38.827811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2951bb-af6a-49b1-8de5-dd4852725c0c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:38.828320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2951bb-af6a-49b1-8de5-dd4852725c0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:38.925615 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71990a-0f6d-4ece-8ec3-444933d11d4f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:38.935397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71990a-0f6d-4ece-8ec3-444933d11d4f service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:38.935748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71990a-0f6d-4ece-8ec3-444933d11d4f service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:38.936048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a71990a-0f6d-4ece-8ec3-444933d11d4f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:38.964563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ce2951bb-af6a-49b1-8de5-dd4852725c0c None None] MFA Rules not processed for user `132eb6d8698147c4938bcab7167785c3`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:38.967360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ce2951bb-af6a-49b1-8de5-dd4852725c0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:39.203591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71990a-0f6d-4ece-8ec3-444933d11d4f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:39.211312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a71990a-0f6d-4ece-8ec3-444933d11d4f service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:39.259311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 862/1722] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 1426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:39.319168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 861/1723] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:38 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:18:39.332664 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71990a-0f6d-4ece-8ec3-444933d11d4f service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:39.334670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9a71990a-0f6d-4ece-8ec3-444933d11d4f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:39.687630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a71990a-0f6d-4ece-8ec3-444933d11d4f service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:39.961324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be94784-a354-47f9-8f5d-4dc8fee5bbed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:39.962433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be94784-a354-47f9-8f5d-4dc8fee5bbed service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:39.964468 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be94784-a354-47f9-8f5d-4dc8fee5bbed service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:39.965257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be94784-a354-47f9-8f5d-4dc8fee5bbed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:39.996185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be94784-a354-47f9-8f5d-4dc8fee5bbed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:40.004166 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be94784-a354-47f9-8f5d-4dc8fee5bbed service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:40.058321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 863/1724] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:39 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 726 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:40.073061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b88d7-9b79-431d-8ed7-4eaa33fb3548 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:40.073653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b88d7-9b79-431d-8ed7-4eaa33fb3548 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:40.073900 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4b88d7-9b79-431d-8ed7-4eaa33fb3548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:40.176925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-cc4b88d7-9b79-431d-8ed7-4eaa33fb3548 None None] MFA Rules not processed for user `a5a8b4618308488dabdef27763f291e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:40.177913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cc4b88d7-9b79-431d-8ed7-4eaa33fb3548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:40.260407 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:40.479595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 862/1725] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:40 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:41.114901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4717-0839-4285-8f60-9580cde60f46 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:41.116012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4717-0839-4285-8f60-9580cde60f46 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:41.116533 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fc4717-0839-4285-8f60-9580cde60f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:41.189691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-68fc4717-0839-4285-8f60-9580cde60f46 None None] MFA Rules not processed for user `4591e01ab4954b22a81f6b09cdb2d544`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:41.206587 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-68fc4717-0839-4285-8f60-9580cde60f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:41.417509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 864/1726] 10.222.0.16 () {58 vars in 1015 bytes} [Thu Sep 15 19:18:41 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:18:41.755175 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b88d7-9b79-431d-8ed7-4eaa33fb3548 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:41.803005 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc4717-0839-4285-8f60-9580cde60f46 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:41.804462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-68fc4717-0839-4285-8f60-9580cde60f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:41.816832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:41.986373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4b88d7-9b79-431d-8ed7-4eaa33fb3548 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:42.000043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:42.000995 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:42.001514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:42.001960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] PATH_INFO: `/v3/users/21946c048f004d80924f44d658e41ad9` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:42.003636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=21946c048f004d80924f44d658e41ad9)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:42.014602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:42.100371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fc4717-0839-4285-8f60-9580cde60f46 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:42.111956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d21f543-d6f5-4d13-83f3-78869ac47dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:42.112929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21f543-d6f5-4d13-83f3-78869ac47dd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:42.113380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21f543-d6f5-4d13-83f3-78869ac47dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:42.113820 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d21f543-d6f5-4d13-83f3-78869ac47dd1 admin admin] PATH_INFO: `/v3/users/7e6e68e4217a476f9cb9d08b3c2063b6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:42.121352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21f543-d6f5-4d13-83f3-78869ac47dd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e6e68e4217a476f9cb9d08b3c2063b6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:42.125687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d21f543-d6f5-4d13-83f3-78869ac47dd1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:42.171571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '21946c048f004d80924f44d658e41ad9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:42.215135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '21946c048f004d80924f44d658e41ad9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:42.218415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '21946c048f004d80924f44d658e41ad9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:42.220896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '21946c048f004d80924f44d658e41ad9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:42.281137 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '21946c048f004d80924f44d658e41ad9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:42.386626 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0d21f543-d6f5-4d13-83f3-78869ac47dd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e6e68e4217a476f9cb9d08b3c2063b6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:42.388965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 863/1727] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:18:41 2022] DELETE /identity/v3/users/21946c048f004d80924f44d658e41ad9 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:42.390374 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:42.395124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:42.405585 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0d21f543-d6f5-4d13-83f3-78869ac47dd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e6e68e4217a476f9cb9d08b3c2063b6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:42.406844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0d21f543-d6f5-4d13-83f3-78869ac47dd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e6e68e4217a476f9cb9d08b3c2063b6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:42.407900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0d21f543-d6f5-4d13-83f3-78869ac47dd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e6e68e4217a476f9cb9d08b3c2063b6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:42.451536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0d21f543-d6f5-4d13-83f3-78869ac47dd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e6e68e4217a476f9cb9d08b3c2063b6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:42.573941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 865/1728] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:18:41 2022] DELETE /identity/v3/users/7e6e68e4217a476f9cb9d08b3c2063b6 => generated 0 bytes in 768 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:42.593836 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa330bba-3445-4de3-a8c6-681bd11a6028 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:42.594345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa330bba-3445-4de3-a8c6-681bd11a6028 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:42.594626 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa330bba-3445-4de3-a8c6-681bd11a6028 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:42.710232 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:42.718268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-aa330bba-3445-4de3-a8c6-681bd11a6028 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:42.720904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-aa330bba-3445-4de3-a8c6-681bd11a6028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:42.808123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0765e27-beda-418c-ad2f-88e03fad84ae admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:43.009453 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea8272-0251-4f16-898e-24b2f0cbf977 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:43.010349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea8272-0251-4f16-898e-24b2f0cbf977 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:43.012626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea8272-0251-4f16-898e-24b2f0cbf977 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:43.013008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea8272-0251-4f16-898e-24b2f0cbf977 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:43.018538 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d5ea8272-0251-4f16-898e-24b2f0cbf977 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:43.050873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea8272-0251-4f16-898e-24b2f0cbf977 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:43.052820 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ea8272-0251-4f16-898e-24b2f0cbf977 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:43.103920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 864/1729] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:42 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 714 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:43.106679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb3e1b-b2e0-4956-89e5-2173262b41f1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:43.111695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb3e1b-b2e0-4956-89e5-2173262b41f1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:43.117059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70bb3e1b-b2e0-4956-89e5-2173262b41f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:43.223711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-70bb3e1b-b2e0-4956-89e5-2173262b41f1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:43.235546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-70bb3e1b-b2e0-4956-89e5-2173262b41f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:43.365863 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 866/1730] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 791 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:43.460850 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa330bba-3445-4de3-a8c6-681bd11a6028 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:43.463861 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-aa330bba-3445-4de3-a8c6-681bd11a6028 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:43.509961 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa330bba-3445-4de3-a8c6-681bd11a6028 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:43.520389 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff287ede-bc91-4735-b541-6827b6916c7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:43.521388 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff287ede-bc91-4735-b541-6827b6916c7d service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:43.521885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff287ede-bc91-4735-b541-6827b6916c7d service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:43.522486 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff287ede-bc91-4735-b541-6827b6916c7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:43.545737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff287ede-bc91-4735-b541-6827b6916c7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:43.548434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff287ede-bc91-4735-b541-6827b6916c7d service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:43.587343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 865/1731] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:43.610609 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 867/1732] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:43.646408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb3e1b-b2e0-4956-89e5-2173262b41f1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:43.677220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70bb3e1b-b2e0-4956-89e5-2173262b41f1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:43.708645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a09464-419c-4ad8-af3c-dbf41b2d3f52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:43.709406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a09464-419c-4ad8-af3c-dbf41b2d3f52 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:43.709655 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a09464-419c-4ad8-af3c-dbf41b2d3f52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:43.709973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a09464-419c-4ad8-af3c-dbf41b2d3f52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:43.772605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a09464-419c-4ad8-af3c-dbf41b2d3f52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:43.778808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a09464-419c-4ad8-af3c-dbf41b2d3f52 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:43.811432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 866/1733] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:44.299991 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e07f0f-136d-4901-956a-149cb671e347 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:44.300275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e07f0f-136d-4901-956a-149cb671e347 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:44.301289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e07f0f-136d-4901-956a-149cb671e347 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:44.305352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 868/1734] 10.222.0.25 () {54 vars in 912 bytes} [Thu Sep 15 19:18:44 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:18:44.321422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9da51-a6ed-4526-af2e-7599374f941b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:44.322625 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9da51-a6ed-4526-af2e-7599374f941b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:44.323195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe9da51-a6ed-4526-af2e-7599374f941b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:44.374333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-efe9da51-a6ed-4526-af2e-7599374f941b None None] MFA Rules not processed for user `4591e01ab4954b22a81f6b09cdb2d544`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:44.376058 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-efe9da51-a6ed-4526-af2e-7599374f941b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:44.401121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 867/1735] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:18:44 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:18:44.523198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e07f0f-136d-4901-956a-149cb671e347 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:44.525871 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-91e07f0f-136d-4901-956a-149cb671e347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:44.576355 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e07f0f-136d-4901-956a-149cb671e347 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:44.581203 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aaa343-15f5-4ce2-8c03-50ca8f81ce6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:44.582242 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaa343-15f5-4ce2-8c03-50ca8f81ce6d service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:44.582709 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaa343-15f5-4ce2-8c03-50ca8f81ce6d service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:44.583175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aaa343-15f5-4ce2-8c03-50ca8f81ce6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:44.607035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aaa343-15f5-4ce2-8c03-50ca8f81ce6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:44.609258 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aaa343-15f5-4ce2-8c03-50ca8f81ce6d service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:44.618113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:44.624654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 869/1736] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:44 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:47.927716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78596b98-1f2a-412d-b2bc-4d639081ac6a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:47.928233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78596b98-1f2a-412d-b2bc-4d639081ac6a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:47.928233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78596b98-1f2a-412d-b2bc-4d639081ac6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:47.999020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-78596b98-1f2a-412d-b2bc-4d639081ac6a None None] MFA Rules not processed for user `45156089d449401abc9a163bf1e15d32`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:48.006402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-78596b98-1f2a-412d-b2bc-4d639081ac6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:48.313258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 868/1737] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:47 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:48.462287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fd637-e53f-4f76-ae06-b68a2b3d7446 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:48.463406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fd637-e53f-4f76-ae06-b68a2b3d7446 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:48.463873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-120fd637-e53f-4f76-ae06-b68a2b3d7446 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:48.466378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 870/1738] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:18:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:18:48.579558 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200f3e5-18df-40c2-94d0-c2d78e497303 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:48.580016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200f3e5-18df-40c2-94d0-c2d78e497303 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:48.580385 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200f3e5-18df-40c2-94d0-c2d78e497303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:48.634954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5200f3e5-18df-40c2-94d0-c2d78e497303 None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:48.646236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5200f3e5-18df-40c2-94d0-c2d78e497303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:48.734186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:48.847155 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 869/1739] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:18:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:49.046637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fd637-e53f-4f76-ae06-b68a2b3d7446 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:49.048663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-120fd637-e53f-4f76-ae06-b68a2b3d7446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:49.094199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-120fd637-e53f-4f76-ae06-b68a2b3d7446 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:49.104174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d91983-8130-4e24-af75-3fa6e7adb033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:49.105255 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d91983-8130-4e24-af75-3fa6e7adb033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:49.105574 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d91983-8130-4e24-af75-3fa6e7adb033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:49.105874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d91983-8130-4e24-af75-3fa6e7adb033 admin admin] PATH_INFO: `/v3/projects/e2ce22eaa1674845bd38d391f0b93ee7` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:49.107886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d91983-8130-4e24-af75-3fa6e7adb033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ce22eaa1674845bd38d391f0b93ee7)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:49.110162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d91983-8130-4e24-af75-3fa6e7adb033 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:49.261952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200f3e5-18df-40c2-94d0-c2d78e497303 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:49.264000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5200f3e5-18df-40c2-94d0-c2d78e497303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:49.294833 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200f3e5-18df-40c2-94d0-c2d78e497303 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:49.295334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-93d91983-8130-4e24-af75-3fa6e7adb033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ce22eaa1674845bd38d391f0b93ee7', 'request_id': 'req-93d91983-8130-4e24-af75-3fa6e7adb033'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:49.335067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-93d91983-8130-4e24-af75-3fa6e7adb033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ce22eaa1674845bd38d391f0b93ee7', 'request_id': 'req-93d91983-8130-4e24-af75-3fa6e7adb033'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:49.353756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-93d91983-8130-4e24-af75-3fa6e7adb033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ce22eaa1674845bd38d391f0b93ee7', 'request_id': 'req-93d91983-8130-4e24-af75-3fa6e7adb033'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:49.426813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-93d91983-8130-4e24-af75-3fa6e7adb033 admin admin] The token cache is being invalidate because project e2ce22eaa1674845bd38d391f0b93ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:18:49.430311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-93d91983-8130-4e24-af75-3fa6e7adb033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:49.435601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-93d91983-8130-4e24-af75-3fa6e7adb033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:49.448131 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 871/1740] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:18:49 2022] DELETE /identity/v3/projects/e2ce22eaa1674845bd38d391f0b93ee7 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:18:49.455124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49d523-bc84-4d78-b687-d6d785639070 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:49.455667 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49d523-bc84-4d78-b687-d6d785639070 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:49.456075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad49d523-bc84-4d78-b687-d6d785639070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:49.543631 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ad49d523-bc84-4d78-b687-d6d785639070 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:49.547747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ad49d523-bc84-4d78-b687-d6d785639070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:49.556289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:49.590848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:49.598085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:49.599014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] PATH_INFO: `/v3/projects/6bd8deccce8d4a588d5d17c4c1c81f20` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:49.600897 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 872/1741] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:49.609529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd8deccce8d4a588d5d17c4c1c81f20)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:49.614383 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:49.617600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d874a76-fa2a-42ba-9a3f-0519047eee93 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:49.618061 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d874a76-fa2a-42ba-9a3f-0519047eee93 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:49.618331 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d874a76-fa2a-42ba-9a3f-0519047eee93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:49.721104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6d874a76-fa2a-42ba-9a3f-0519047eee93 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:49.732976 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6d874a76-fa2a-42ba-9a3f-0519047eee93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:49.795785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 873/1742] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:49.799063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d874a76-fa2a-42ba-9a3f-0519047eee93 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:49.831913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d874a76-fa2a-42ba-9a3f-0519047eee93 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:49.835860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd8deccce8d4a588d5d17c4c1c81f20', 'request_id': 'req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:49.876359 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd8deccce8d4a588d5d17c4c1c81f20', 'request_id': 'req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:49.908055 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd8deccce8d4a588d5d17c4c1c81f20', 'request_id': 'req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:49.966324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] The token cache is being invalidate because project 6bd8deccce8d4a588d5d17c4c1c81f20 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:18:49.967864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:49.969731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:49.979872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 870/1743] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:18:49 2022] DELETE /identity/v3/projects/6bd8deccce8d4a588d5d17c4c1c81f20 => generated 0 bytes in 714 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:18:49.982622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:49.987415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:50.068396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401c723-e3cc-459f-8f09-e7dcc49f7bec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:50.069305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401c723-e3cc-459f-8f09-e7dcc49f7bec admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:50.069920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401c723-e3cc-459f-8f09-e7dcc49f7bec admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:50.070411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401c723-e3cc-459f-8f09-e7dcc49f7bec admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:50.074952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401c723-e3cc-459f-8f09-e7dcc49f7bec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:18:50.075874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401c723-e3cc-459f-8f09-e7dcc49f7bec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:50.079825 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401c723-e3cc-459f-8f09-e7dcc49f7bec admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:50.149034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 874/1744] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:18:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:18:50.154653 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401c723-e3cc-459f-8f09-e7dcc49f7bec admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:50.158284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0401c723-e3cc-459f-8f09-e7dcc49f7bec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:50.216473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401c723-e3cc-459f-8f09-e7dcc49f7bec admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:50.238087 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d642e30-e8a9-4630-b982-9a858c7c81b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:50.239697 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d642e30-e8a9-4630-b982-9a858c7c81b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:50.242413 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d642e30-e8a9-4630-b982-9a858c7c81b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:50.244137 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d642e30-e8a9-4630-b982-9a858c7c81b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:50.248134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d642e30-e8a9-4630-b982-9a858c7c81b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:50.256059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d642e30-e8a9-4630-b982-9a858c7c81b9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:50.335314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:50.437897 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ca0d8-900c-4b8b-a5bc-ee203105cd0a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:50.447975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 875/1745] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:50 2022] POST /identity/v3/projects => generated 379 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:18:50.449172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d642e30-e8a9-4630-b982-9a858c7c81b9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:50.451989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3d642e30-e8a9-4630-b982-9a858c7c81b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:50.477900 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:50.478839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:50.480087 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:50.480539 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] PATH_INFO: `/v3/users/132eb6d8698147c4938bcab7167785c3` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:50.482314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=132eb6d8698147c4938bcab7167785c3)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:50.485679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:50.635899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '132eb6d8698147c4938bcab7167785c3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:50.653720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '132eb6d8698147c4938bcab7167785c3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:50.654644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '132eb6d8698147c4938bcab7167785c3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:50.656373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '132eb6d8698147c4938bcab7167785c3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:50.672851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '132eb6d8698147c4938bcab7167785c3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:50.716126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:50.769192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 871/1746] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:18:49 2022] DELETE /identity/v3/users/132eb6d8698147c4938bcab7167785c3 => generated 0 bytes in 788 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:50.770740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:50.777641 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:50.804720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d642e30-e8a9-4630-b982-9a858c7c81b9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:51.041323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b627ebf-67f9-4fde-b42d-d35ce2823fd5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:51.051065 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe8caa-c652-4ea2-b0f1-85149bb0cc88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:51.054880 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8caa-c652-4ea2-b0f1-85149bb0cc88 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:51.054880 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8caa-c652-4ea2-b0f1-85149bb0cc88 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:51.055519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefe8caa-c652-4ea2-b0f1-85149bb0cc88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:51.057372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd50b75-bd82-40ed-ab6e-5df6d75d0c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:51.059572 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd50b75-bd82-40ed-ab6e-5df6d75d0c77 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:51.063773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fefe8caa-c652-4ea2-b0f1-85149bb0cc88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:51.064312 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd50b75-bd82-40ed-ab6e-5df6d75d0c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:51.064845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd50b75-bd82-40ed-ab6e-5df6d75d0c77 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:51.066972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd50b75-bd82-40ed-ab6e-5df6d75d0c77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:51.070691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd50b75-bd82-40ed-ab6e-5df6d75d0c77 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:51.116388 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe8caa-c652-4ea2-b0f1-85149bb0cc88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:51.123607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefe8caa-c652-4ea2-b0f1-85149bb0cc88 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:51.154098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 872/1747] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:50 2022] POST /identity/v3/users => generated 290 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:51.160451 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd50b75-bd82-40ed-ab6e-5df6d75d0c77 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:51.170402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 876/1748] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:50 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 722 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:51.180328 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd50b75-bd82-40ed-ab6e-5df6d75d0c77 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:51.187900 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37cdab03-7e21-4069-bca1-9ef789fb39d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:51.188868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdab03-7e21-4069-bca1-9ef789fb39d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:51.189393 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdab03-7e21-4069-bca1-9ef789fb39d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:51.189943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37cdab03-7e21-4069-bca1-9ef789fb39d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:51.190947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdab03-7e21-4069-bca1-9ef789fb39d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:51.192847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37cdab03-7e21-4069-bca1-9ef789fb39d9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:51.206603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 873/1749] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:51.213159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe8caa-c652-4ea2-b0f1-85149bb0cc88 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:51.234031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefe8caa-c652-4ea2-b0f1-85149bb0cc88 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:51.246777 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4575e9-7219-478d-b28e-77557dc2eb22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:51.247584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4575e9-7219-478d-b28e-77557dc2eb22 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:51.248139 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4575e9-7219-478d-b28e-77557dc2eb22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:51.249904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4575e9-7219-478d-b28e-77557dc2eb22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:51.252010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4575e9-7219-478d-b28e-77557dc2eb22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:51.263956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4575e9-7219-478d-b28e-77557dc2eb22 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:51.319926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d285a-7e12-4bec-8075-3f3c43d0dfe1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:51.320434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 877/1750] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:51 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:51.321500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d285a-7e12-4bec-8075-3f3c43d0dfe1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:51.321716 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4575e9-7219-478d-b28e-77557dc2eb22 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:51.321836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938d285a-7e12-4bec-8075-3f3c43d0dfe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:51.370553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4575e9-7219-478d-b28e-77557dc2eb22 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:51.383675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-938d285a-7e12-4bec-8075-3f3c43d0dfe1 None None] MFA Rules not processed for user `4e5cb514da72438ab36c05399083f109`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:51.387267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-938d285a-7e12-4bec-8075-3f3c43d0dfe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:51.392218 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691db41d-6480-4a1f-a592-81ed6c270637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:51.393121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691db41d-6480-4a1f-a592-81ed6c270637 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:51.394529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691db41d-6480-4a1f-a592-81ed6c270637 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:51.396663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691db41d-6480-4a1f-a592-81ed6c270637 admin admin] PATH_INFO: `/v3/projects/7c7f4f5861324977bb386e47dde0df11/users/faa00051dea645129bbd46dfd06c3f69/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:51.466312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691db41d-6480-4a1f-a592-81ed6c270637 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7f4f5861324977bb386e47dde0df11, user_id=faa00051dea645129bbd46dfd06c3f69, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:51.473160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691db41d-6480-4a1f-a592-81ed6c270637 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:51.532757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:51.536461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 878/1751] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:51 2022] PUT /identity/v3/projects/7c7f4f5861324977bb386e47dde0df11/users/faa00051dea645129bbd46dfd06c3f69/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:51.550998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b284642-e4cd-44f9-a040-d56b159ff6fe None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:51.551442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b284642-e4cd-44f9-a040-d56b159ff6fe None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:51.551793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b284642-e4cd-44f9-a040-d56b159ff6fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:51.575899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 874/1752] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:51.706214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0b284642-e4cd-44f9-a040-d56b159ff6fe None None] MFA Rules not processed for user `faa00051dea645129bbd46dfd06c3f69`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:51.711608 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0b284642-e4cd-44f9-a040-d56b159ff6fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:51.982281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 879/1753] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:51 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 433 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:18:51.987138 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d285a-7e12-4bec-8075-3f3c43d0dfe1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:52.004766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938d285a-7e12-4bec-8075-3f3c43d0dfe1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:52.187172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feed666-ae9b-4b04-bd67-4b256933724e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:52.187835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feed666-ae9b-4b04-bd67-4b256933724e admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:52.188222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feed666-ae9b-4b04-bd67-4b256933724e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:52.188600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9feed666-ae9b-4b04-bd67-4b256933724e admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:52.190278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feed666-ae9b-4b04-bd67-4b256933724e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:52.198393 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9feed666-ae9b-4b04-bd67-4b256933724e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:52.298638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 875/1754] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:51 2022] POST /identity/v3/projects => generated 379 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:18:52.316050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b284642-e4cd-44f9-a040-d56b159ff6fe None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:52.344792 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b284642-e4cd-44f9-a040-d56b159ff6fe None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:52.399531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:52.537734 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65032c46-61ac-48b9-98b6-856bba407d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:52.538472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65032c46-61ac-48b9-98b6-856bba407d7b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:52.540168 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65032c46-61ac-48b9-98b6-856bba407d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:52.541302 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65032c46-61ac-48b9-98b6-856bba407d7b admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:52.542159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65032c46-61ac-48b9-98b6-856bba407d7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:52.548955 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65032c46-61ac-48b9-98b6-856bba407d7b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:52.608384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 880/1755] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:52 2022] POST /identity/v3/users => generated 296 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:52.611050 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feed666-ae9b-4b04-bd67-4b256933724e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:52.633231 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9feed666-ae9b-4b04-bd67-4b256933724e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:52.642228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49de849-d444-43af-8d32-a334021e9bb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:52.642981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49de849-d444-43af-8d32-a334021e9bb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:52.643329 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49de849-d444-43af-8d32-a334021e9bb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:52.643674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49de849-d444-43af-8d32-a334021e9bb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:52.644469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49de849-d444-43af-8d32-a334021e9bb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:52.646251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49de849-d444-43af-8d32-a334021e9bb2 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:52.677171 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 876/1756] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:52.681658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65032c46-61ac-48b9-98b6-856bba407d7b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:52.698454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65032c46-61ac-48b9-98b6-856bba407d7b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:52.710645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1163a-b492-40f2-be0a-27e3a4825fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:52.711537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1163a-b492-40f2-be0a-27e3a4825fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:52.712024 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1163a-b492-40f2-be0a-27e3a4825fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:52.712455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a1163a-b492-40f2-be0a-27e3a4825fd0 admin admin] PATH_INFO: `/v3/projects/e1bbec80cd2142a392c4ff9542b6c639/users/d1ceee58e294441383993a31723f8e81/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:52.749064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1163a-b492-40f2-be0a-27e3a4825fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bbec80cd2142a392c4ff9542b6c639, user_id=d1ceee58e294441383993a31723f8e81, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:52.753095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a1163a-b492-40f2-be0a-27e3a4825fd0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:52.790600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49de849-d444-43af-8d32-a334021e9bb2 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:52.791279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 881/1757] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:52 2022] PUT /identity/v3/projects/e1bbec80cd2142a392c4ff9542b6c639/users/d1ceee58e294441383993a31723f8e81/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:52.807044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49de849-d444-43af-8d32-a334021e9bb2 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:52.950601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7426baa7-db4b-48bd-8d30-538f55a0fba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:52.950601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426baa7-db4b-48bd-8d30-538f55a0fba5 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:52.950601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426baa7-db4b-48bd-8d30-538f55a0fba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:52.950601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7426baa7-db4b-48bd-8d30-538f55a0fba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:52.951161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426baa7-db4b-48bd-8d30-538f55a0fba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:52.951356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7426baa7-db4b-48bd-8d30-538f55a0fba5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:52.990440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1163a-b492-40f2-be0a-27e3a4825fd0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:52.996282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 877/1758] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:52 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:53.009551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a1163a-b492-40f2-be0a-27e3a4825fd0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:53.035757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf72ef-1f69-4735-8914-14496b196fbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:53.036462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf72ef-1f69-4735-8914-14496b196fbf admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:53.036750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf72ef-1f69-4735-8914-14496b196fbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:53.037035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbf72ef-1f69-4735-8914-14496b196fbf admin admin] PATH_INFO: `/v3/projects/e1bbec80cd2142a392c4ff9542b6c639/users/d1ceee58e294441383993a31723f8e81/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:53.048240 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf72ef-1f69-4735-8914-14496b196fbf admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bbec80cd2142a392c4ff9542b6c639, user_id=d1ceee58e294441383993a31723f8e81, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:53.053052 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbf72ef-1f69-4735-8914-14496b196fbf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:53.113983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 882/1759] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:52 2022] PUT /identity/v3/projects/e1bbec80cd2142a392c4ff9542b6c639/users/d1ceee58e294441383993a31723f8e81/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:53.130514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b603e6b-d470-4d28-9998-5476782a3d51 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:53.131209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b603e6b-d470-4d28-9998-5476782a3d51 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:53.131650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b603e6b-d470-4d28-9998-5476782a3d51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:53.215828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5b603e6b-d470-4d28-9998-5476782a3d51 None None] MFA Rules not processed for user `d1ceee58e294441383993a31723f8e81`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:53.235782 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5b603e6b-d470-4d28-9998-5476782a3d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:53.389190 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:53.703092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 878/1760] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:53 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 574 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:53.712496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf72ef-1f69-4735-8914-14496b196fbf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:53.714528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cbbf72ef-1f69-4735-8914-14496b196fbf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:53.955926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbf72ef-1f69-4735-8914-14496b196fbf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:53.971890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d11a03-61e0-4b7c-afeb-65ecbed2c66e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:53.975130 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11a03-61e0-4b7c-afeb-65ecbed2c66e service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:53.978652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11a03-61e0-4b7c-afeb-65ecbed2c66e service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:53.980443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d11a03-61e0-4b7c-afeb-65ecbed2c66e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:54.041357 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b603e6b-d470-4d28-9998-5476782a3d51 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:54.053224 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5b603e6b-d470-4d28-9998-5476782a3d51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:54.202302 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d11a03-61e0-4b7c-afeb-65ecbed2c66e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:54.205194 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d11a03-61e0-4b7c-afeb-65ecbed2c66e service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:54.237624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 883/1761] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:53 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 523 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:54.400734 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b603e6b-d470-4d28-9998-5476782a3d51 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:54.428129 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:54.428848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:54.429101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:54.431625 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] PATH_INFO: `/v3/users/7b7a860ab49f4b69a1df9bc4fb7ec61c` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:54.440137 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b7a860ab49f4b69a1df9bc4fb7ec61c)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:54.445977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:54.643759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b7a860ab49f4b69a1df9bc4fb7ec61c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:54.669957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b7a860ab49f4b69a1df9bc4fb7ec61c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:54.671131 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b7a860ab49f4b69a1df9bc4fb7ec61c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:54.671824 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b7a860ab49f4b69a1df9bc4fb7ec61c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:54.690696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b7a860ab49f4b69a1df9bc4fb7ec61c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:54.720851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 879/1762] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:18:54 2022] DELETE /identity/v3/users/7b7a860ab49f4b69a1df9bc4fb7ec61c => generated 0 bytes in 680 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:54.725422 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df71b1-27f8-4246-9a87-bcdbbcc37713 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:54.726005 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df71b1-27f8-4246-9a87-bcdbbcc37713 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:54.726681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66df71b1-27f8-4246-9a87-bcdbbcc37713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:54.768881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-66df71b1-27f8-4246-9a87-bcdbbcc37713 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:54.775977 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-66df71b1-27f8-4246-9a87-bcdbbcc37713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:54.837871 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:54.937199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 884/1763] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:55.029316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:55.038974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:55.270469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5b4fb-cd22-405c-a041-97d5970b4b13 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:55.277172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc6c5c7-e15d-4009-8454-b81cd13c8602 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:55.278652 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6c5c7-e15d-4009-8454-b81cd13c8602 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:55.278963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6c5c7-e15d-4009-8454-b81cd13c8602 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:55.279283 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc6c5c7-e15d-4009-8454-b81cd13c8602 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:55.308253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6c5c7-e15d-4009-8454-b81cd13c8602 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:55.309984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc6c5c7-e15d-4009-8454-b81cd13c8602 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:55.334829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 880/1764] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:55.931620 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df71b1-27f8-4246-9a87-bcdbbcc37713 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:55.935805 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-66df71b1-27f8-4246-9a87-bcdbbcc37713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:55.968934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66df71b1-27f8-4246-9a87-bcdbbcc37713 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:55.986456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:55.988327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:55.988622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:55.990411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] PATH_INFO: `/v3/projects/d09b2f69e47a49409af54c3e1fbd9854` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:55.993980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09b2f69e47a49409af54c3e1fbd9854)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:55.998855 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:56.143644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09b2f69e47a49409af54c3e1fbd9854', 'request_id': 'req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:56.159737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09b2f69e47a49409af54c3e1fbd9854', 'request_id': 'req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:56.208529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09b2f69e47a49409af54c3e1fbd9854', 'request_id': 'req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:56.239445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] The token cache is being invalidate because project d09b2f69e47a49409af54c3e1fbd9854 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:18:56.240513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:56.243161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:56.247257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 885/1765] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:18:55 2022] DELETE /identity/v3/projects/d09b2f69e47a49409af54c3e1fbd9854 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:56.252708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769552a1-d35e-43c3-92b8-cf3a99f01538 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:56.253289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769552a1-d35e-43c3-92b8-cf3a99f01538 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:56.253289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769552a1-d35e-43c3-92b8-cf3a99f01538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:56.322895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-769552a1-d35e-43c3-92b8-cf3a99f01538 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:56.325478 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-769552a1-d35e-43c3-92b8-cf3a99f01538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:56.335483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:56.415769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:56.418951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:56.480206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 881/1766] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:56.482175 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e80b4-4629-4f02-b64c-63cae70f4e17 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:56.482696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e80b4-4629-4f02-b64c-63cae70f4e17 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:56.482866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e80b4-4629-4f02-b64c-63cae70f4e17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:56.523062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-240e80b4-4629-4f02-b64c-63cae70f4e17 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:56.524970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-240e80b4-4629-4f02-b64c-63cae70f4e17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:56.548787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 882/1767] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:56.549896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e80b4-4629-4f02-b64c-63cae70f4e17 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:56.574842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e80b4-4629-4f02-b64c-63cae70f4e17 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:56.588879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4139d9d-1b3d-48f9-a716-0ab597cdd6e4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:56.590157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ee671-83f8-413d-96e7-d6e40ec23005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:56.590845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ee671-83f8-413d-96e7-d6e40ec23005 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:56.594228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ee671-83f8-413d-96e7-d6e40ec23005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:56.594581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ee671-83f8-413d-96e7-d6e40ec23005 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:56.595426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ee671-83f8-413d-96e7-d6e40ec23005 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:18:56.595744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ee671-83f8-413d-96e7-d6e40ec23005 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:56.596298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31273765-2d15-4cda-8f83-27328e628f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:56.597952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31273765-2d15-4cda-8f83-27328e628f0a service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:56.598511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31273765-2d15-4cda-8f83-27328e628f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:56.599066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31273765-2d15-4cda-8f83-27328e628f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:56.601500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ee671-83f8-413d-96e7-d6e40ec23005 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:56.602417 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-31273765-2d15-4cda-8f83-27328e628f0a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:56.633896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 883/1768] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:18:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:18:56.638766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ee671-83f8-413d-96e7-d6e40ec23005 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:56.653010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ee671-83f8-413d-96e7-d6e40ec23005 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:56.672745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879832bd-bd43-43bc-bcda-9e233adbce70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:56.673726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879832bd-bd43-43bc-bcda-9e233adbce70 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:56.674397 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879832bd-bd43-43bc-bcda-9e233adbce70 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:56.675753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879832bd-bd43-43bc-bcda-9e233adbce70 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:56.676887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879832bd-bd43-43bc-bcda-9e233adbce70 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:56.679282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879832bd-bd43-43bc-bcda-9e233adbce70 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:56.737987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 884/1769] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:18:56 2022] POST /identity/v3/projects => generated 371 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:18:56.744196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879832bd-bd43-43bc-bcda-9e233adbce70 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:56.829419 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31273765-2d15-4cda-8f83-27328e628f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:56.832766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31273765-2d15-4cda-8f83-27328e628f0a service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:56.849649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:56.865563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 886/1770] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:56 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:56.932338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879832bd-bd43-43bc-bcda-9e233adbce70 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:56.942690 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833c7b9-d8ec-40c3-b10a-2f4038c20e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:56.943363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833c7b9-d8ec-40c3-b10a-2f4038c20e14 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:56.943633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833c7b9-d8ec-40c3-b10a-2f4038c20e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:56.943967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e833c7b9-d8ec-40c3-b10a-2f4038c20e14 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:56.944676 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833c7b9-d8ec-40c3-b10a-2f4038c20e14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:56.949244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e833c7b9-d8ec-40c3-b10a-2f4038c20e14 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:57.029294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 885/1771] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:18:56 2022] POST /identity/v3/users => generated 286 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:18:57.030482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31273765-2d15-4cda-8f83-27328e628f0a service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:57.058296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31273765-2d15-4cda-8f83-27328e628f0a service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:57.058296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cad43b-d0b5-43e7-818f-231747e76460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:57.058296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cad43b-d0b5-43e7-818f-231747e76460 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:57.058296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cad43b-d0b5-43e7-818f-231747e76460 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:57.058808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cad43b-d0b5-43e7-818f-231747e76460 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:57.060566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cad43b-d0b5-43e7-818f-231747e76460 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:57.061882 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cad43b-d0b5-43e7-818f-231747e76460 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:57.085873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 887/1772] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:57.086193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833c7b9-d8ec-40c3-b10a-2f4038c20e14 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:57.096887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e833c7b9-d8ec-40c3-b10a-2f4038c20e14 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:57.108182 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bab38-59bc-40cf-b0c6-3125c4e7cc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:57.109189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bab38-59bc-40cf-b0c6-3125c4e7cc0e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:57.109518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bab38-59bc-40cf-b0c6-3125c4e7cc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:57.110621 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288bab38-59bc-40cf-b0c6-3125c4e7cc0e admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:57.110621 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bab38-59bc-40cf-b0c6-3125c4e7cc0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:57.119911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288bab38-59bc-40cf-b0c6-3125c4e7cc0e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:57.142605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 886/1773] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:18:57 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:18:57.147269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cad43b-d0b5-43e7-818f-231747e76460 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:57.161762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cad43b-d0b5-43e7-818f-231747e76460 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:57.189423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f44020-392a-49e3-ba32-5ee102b6951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:57.192568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f44020-392a-49e3-ba32-5ee102b6951c admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:57.193908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f44020-392a-49e3-ba32-5ee102b6951c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:57.195944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f44020-392a-49e3-ba32-5ee102b6951c admin admin] PATH_INFO: `/v3/projects/35d4eb327c014de9a43e564fa55a4421/users/33cd6e0fe4ab4d398710eab37588dcdd/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:57.266910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f44020-392a-49e3-ba32-5ee102b6951c admin admin] RBAC: Authorizing `identity:create_grant(project_id=35d4eb327c014de9a43e564fa55a4421, user_id=33cd6e0fe4ab4d398710eab37588dcdd, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:57.280008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f44020-392a-49e3-ba32-5ee102b6951c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:57.335013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bab38-59bc-40cf-b0c6-3125c4e7cc0e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:57.335738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 888/1774] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:18:57 2022] PUT /identity/v3/projects/35d4eb327c014de9a43e564fa55a4421/users/33cd6e0fe4ab4d398710eab37588dcdd/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:57.347003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-288bab38-59bc-40cf-b0c6-3125c4e7cc0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:57.349774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8ba76-8ad0-4c89-87a0-0d5d51a19c63 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:57.350208 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8ba76-8ad0-4c89-87a0-0d5d51a19c63 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:57.351858 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb8ba76-8ad0-4c89-87a0-0d5d51a19c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:57.383626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288bab38-59bc-40cf-b0c6-3125c4e7cc0e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:57.433034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3fb8ba76-8ad0-4c89-87a0-0d5d51a19c63 None None] MFA Rules not processed for user `33cd6e0fe4ab4d398710eab37588dcdd`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:57.434545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3fb8ba76-8ad0-4c89-87a0-0d5d51a19c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:57.506857 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:57.539356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00d2406-bca7-4f4f-80c5-92355bcb6e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:57.541143 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d2406-bca7-4f4f-80c5-92355bcb6e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:57.541618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d2406-bca7-4f4f-80c5-92355bcb6e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:57.542159 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00d2406-bca7-4f4f-80c5-92355bcb6e84 admin admin] PATH_INFO: `/v3/projects/1ca39aedf9274f3bb4e996fe39bae300` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:57.543640 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d2406-bca7-4f4f-80c5-92355bcb6e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ca39aedf9274f3bb4e996fe39bae300)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:57.550725 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00d2406-bca7-4f4f-80c5-92355bcb6e84 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:57.651054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 889/1775] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 302 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:57.659789 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8ba76-8ad0-4c89-87a0-0d5d51a19c63 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:57.662780 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3fb8ba76-8ad0-4c89-87a0-0d5d51a19c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:57.709259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f00d2406-bca7-4f4f-80c5-92355bcb6e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ca39aedf9274f3bb4e996fe39bae300', 'request_id': 'req-f00d2406-bca7-4f4f-80c5-92355bcb6e84'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:57.740921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f00d2406-bca7-4f4f-80c5-92355bcb6e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ca39aedf9274f3bb4e996fe39bae300', 'request_id': 'req-f00d2406-bca7-4f4f-80c5-92355bcb6e84'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:57.772317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f00d2406-bca7-4f4f-80c5-92355bcb6e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ca39aedf9274f3bb4e996fe39bae300', 'request_id': 'req-f00d2406-bca7-4f4f-80c5-92355bcb6e84'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:57.797563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f00d2406-bca7-4f4f-80c5-92355bcb6e84 admin admin] The token cache is being invalidate because project 1ca39aedf9274f3bb4e996fe39bae300 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:18:57.797563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f00d2406-bca7-4f4f-80c5-92355bcb6e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:57.797563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f00d2406-bca7-4f4f-80c5-92355bcb6e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:57.800312 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 887/1776] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:18:57 2022] DELETE /identity/v3/projects/1ca39aedf9274f3bb4e996fe39bae300 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:57.802134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2fff1-e4b7-432d-9c91-047395244eb5 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:57.802424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2fff1-e4b7-432d-9c91-047395244eb5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:57.802689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c2fff1-e4b7-432d-9c91-047395244eb5 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:57.805918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 888/1777] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:18:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:18:57.806981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2fff1-e4b7-432d-9c91-047395244eb5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:57.808756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-52c2fff1-e4b7-432d-9c91-047395244eb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:57.932003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb8ba76-8ad0-4c89-87a0-0d5d51a19c63 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:57.951251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c2fff1-e4b7-432d-9c91-047395244eb5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:57.960539 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21641d3b-fd4a-4e88-be3b-1665a3713926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:57.961244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21641d3b-fd4a-4e88-be3b-1665a3713926 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:57.961630 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21641d3b-fd4a-4e88-be3b-1665a3713926 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:57.962020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21641d3b-fd4a-4e88-be3b-1665a3713926 admin admin] PATH_INFO: `/v3/users/05b6a54e7777487697c9cd36e792ad6b` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:57.967886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21641d3b-fd4a-4e88-be3b-1665a3713926 admin admin] RBAC: Authorizing `identity:delete_user(user_id=05b6a54e7777487697c9cd36e792ad6b)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:57.969978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21641d3b-fd4a-4e88-be3b-1665a3713926 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:58.161103 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb676f2-436e-4ae3-a332-ff925ac67f3c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:58.162334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb676f2-436e-4ae3-a332-ff925ac67f3c service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:58.162866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb676f2-436e-4ae3-a332-ff925ac67f3c service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:58.163442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb676f2-436e-4ae3-a332-ff925ac67f3c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:58.167940 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2bb676f2-436e-4ae3-a332-ff925ac67f3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:58.181895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-21641d3b-fd4a-4e88-be3b-1665a3713926 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '05b6a54e7777487697c9cd36e792ad6b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:58.201290 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-21641d3b-fd4a-4e88-be3b-1665a3713926 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '05b6a54e7777487697c9cd36e792ad6b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:58.202660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-21641d3b-fd4a-4e88-be3b-1665a3713926 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '05b6a54e7777487697c9cd36e792ad6b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:58.212292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-21641d3b-fd4a-4e88-be3b-1665a3713926 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '05b6a54e7777487697c9cd36e792ad6b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:58.234794 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:58.261601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-21641d3b-fd4a-4e88-be3b-1665a3713926 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '05b6a54e7777487697c9cd36e792ad6b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:58.327844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:58.349857 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 889/1778] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:18:57 2022] DELETE /identity/v3/users/05b6a54e7777487697c9cd36e792ad6b => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:58.356058 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479ced1-a7e7-4969-90bb-3538f58c06b8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:58.356491 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479ced1-a7e7-4969-90bb-3538f58c06b8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:58.359736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c479ced1-a7e7-4969-90bb-3538f58c06b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:58.366742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb676f2-436e-4ae3-a332-ff925ac67f3c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:58.372675 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb676f2-436e-4ae3-a332-ff925ac67f3c service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:58.395415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c479ced1-a7e7-4969-90bb-3538f58c06b8 None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:58.395708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 890/1779] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:57 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 737 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:58.396795 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c479ced1-a7e7-4969-90bb-3538f58c06b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:58.442268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb676f2-436e-4ae3-a332-ff925ac67f3c service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:58.445559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2bb676f2-436e-4ae3-a332-ff925ac67f3c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:58.512008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb676f2-436e-4ae3-a332-ff925ac67f3c service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:58.545618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 890/1780] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:18:58 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:58.746016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:58.747790 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:58.748319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:58.748844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] PATH_INFO: `/v3/users/33cd6e0fe4ab4d398710eab37588dcdd` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:58.752630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=33cd6e0fe4ab4d398710eab37588dcdd)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:58.757481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:58.918801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33cd6e0fe4ab4d398710eab37588dcdd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:58.941746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33cd6e0fe4ab4d398710eab37588dcdd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:58.943898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33cd6e0fe4ab4d398710eab37588dcdd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:58.945208 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33cd6e0fe4ab4d398710eab37588dcdd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:58.970897 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33cd6e0fe4ab4d398710eab37588dcdd'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:18:59.061161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 891/1781] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:18:58 2022] DELETE /identity/v3/users/33cd6e0fe4ab4d398710eab37588dcdd => generated 0 bytes in 616 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:18:59.062904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fffc8-3f57-43f0-80e5-1b7e165c826a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:59.063324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fffc8-3f57-43f0-80e5-1b7e165c826a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:59.063858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852fffc8-3f57-43f0-80e5-1b7e165c826a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:59.150473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-852fffc8-3f57-43f0-80e5-1b7e165c826a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:18:59.153292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-852fffc8-3f57-43f0-80e5-1b7e165c826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:59.340916 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 891/1782] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:18:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:18:59.476579 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:59.488653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fffc8-3f57-43f0-80e5-1b7e165c826a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:18:59.491679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-852fffc8-3f57-43f0-80e5-1b7e165c826a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:59.498201 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:59.604140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:18:59.635086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7b4eb6-da12-47d0-9f87-881f41926bd6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:59.644707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ff7b5-ba63-41e4-87da-75a228e31aa9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:59.646571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ff7b5-ba63-41e4-87da-75a228e31aa9 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:59.647206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ff7b5-ba63-41e4-87da-75a228e31aa9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:59.648137 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1ff7b5-ba63-41e4-87da-75a228e31aa9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:59.682149 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852fffc8-3f57-43f0-80e5-1b7e165c826a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:18:59.683115 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ff7b5-ba63-41e4-87da-75a228e31aa9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:59.688020 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1ff7b5-ba63-41e4-87da-75a228e31aa9 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:59.704972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79553b5-b3cc-4c2d-8800-956c101757b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:18:59.706167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79553b5-b3cc-4c2d-8800-956c101757b3 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:18:59.706525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79553b5-b3cc-4c2d-8800-956c101757b3 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:18:59.706869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79553b5-b3cc-4c2d-8800-956c101757b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:18:59.711899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f79553b5-b3cc-4c2d-8800-956c101757b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:18:59.716503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 892/1783] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:18:59.737295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79553b5-b3cc-4c2d-8800-956c101757b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:18:59.739256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79553b5-b3cc-4c2d-8800-956c101757b3 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:18:59.755085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 892/1784] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:18:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:01.563641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ff7b5-ba63-41e4-87da-75a228e31aa9 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:01.567276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4b1ff7b5-ba63-41e4-87da-75a228e31aa9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:01.622900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1ff7b5-ba63-41e4-87da-75a228e31aa9 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:01.667703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:01.678197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:01.678722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:01.679216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] PATH_INFO: `/v3/projects/97a987360a4d49a888f8f8b4e523f826` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:01.691843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97a987360a4d49a888f8f8b4e523f826)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:01.697047 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:01.797195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97a987360a4d49a888f8f8b4e523f826', 'request_id': 'req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:01.805342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97a987360a4d49a888f8f8b4e523f826', 'request_id': 'req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:01.824378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97a987360a4d49a888f8f8b4e523f826', 'request_id': 'req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:01.846423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] The token cache is being invalidate because project 97a987360a4d49a888f8f8b4e523f826 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:01.848699 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:01.849943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:01.853351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 893/1785] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:01 2022] DELETE /identity/v3/projects/97a987360a4d49a888f8f8b4e523f826 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:01.861031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38948f5-0648-4357-b613-464cd67c95b2 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:01.861965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38948f5-0648-4357-b613-464cd67c95b2 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:01.861965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38948f5-0648-4357-b613-464cd67c95b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:01.908765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f38948f5-0648-4357-b613-464cd67c95b2 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:01.912125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f38948f5-0648-4357-b613-464cd67c95b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:01.965962 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:02.093434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:02.095410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:02.116339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 893/1786] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:02.119928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a5cb9-7016-4716-a8f5-50ac23e421d9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:02.119928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a5cb9-7016-4716-a8f5-50ac23e421d9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:02.119928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a5cb9-7016-4716-a8f5-50ac23e421d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:02.126769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf11d6-898c-4deb-b1ed-7b83e0a9bc26 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:02.140784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:02.142957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:02.143409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:02.143950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] PATH_INFO: `/v3/projects/35d4eb327c014de9a43e564fa55a4421` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:02.146381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35d4eb327c014de9a43e564fa55a4421)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:02.154758 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:02.160585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-cb9a5cb9-7016-4716-a8f5-50ac23e421d9 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:02.162738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cb9a5cb9-7016-4716-a8f5-50ac23e421d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:02.184973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 894/1787] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:02.186840 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a5cb9-7016-4716-a8f5-50ac23e421d9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:02.191172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cb9a5cb9-7016-4716-a8f5-50ac23e421d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:02.215081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9a5cb9-7016-4716-a8f5-50ac23e421d9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:02.224652 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c87f278-e3f1-41f5-ad00-59924781c4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:02.226267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87f278-e3f1-41f5-ad00-59924781c4d6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:02.226549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87f278-e3f1-41f5-ad00-59924781c4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:02.227030 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c87f278-e3f1-41f5-ad00-59924781c4d6 admin admin] PATH_INFO: `/v3/users/faa00051dea645129bbd46dfd06c3f69` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:02.229537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87f278-e3f1-41f5-ad00-59924781c4d6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=faa00051dea645129bbd46dfd06c3f69)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:02.234964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c87f278-e3f1-41f5-ad00-59924781c4d6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:02.324798 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35d4eb327c014de9a43e564fa55a4421', 'request_id': 'req-233cb335-8fb5-46ae-9c30-944d218e4dd6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:02.340458 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35d4eb327c014de9a43e564fa55a4421', 'request_id': 'req-233cb335-8fb5-46ae-9c30-944d218e4dd6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:02.362072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35d4eb327c014de9a43e564fa55a4421', 'request_id': 'req-233cb335-8fb5-46ae-9c30-944d218e4dd6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:02.379042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] The token cache is being invalidate because project 35d4eb327c014de9a43e564fa55a4421 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:02.379644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:02.380554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:02.384462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 894/1788] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:02 2022] DELETE /identity/v3/projects/35d4eb327c014de9a43e564fa55a4421 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:02.384643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3c87f278-e3f1-41f5-ad00-59924781c4d6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'faa00051dea645129bbd46dfd06c3f69'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:02.385905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:02.391304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:02.403923 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3c87f278-e3f1-41f5-ad00-59924781c4d6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'faa00051dea645129bbd46dfd06c3f69'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:02.407656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3c87f278-e3f1-41f5-ad00-59924781c4d6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'faa00051dea645129bbd46dfd06c3f69'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:02.409549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3c87f278-e3f1-41f5-ad00-59924781c4d6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'faa00051dea645129bbd46dfd06c3f69'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:02.463382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3c87f278-e3f1-41f5-ad00-59924781c4d6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'faa00051dea645129bbd46dfd06c3f69'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:02.487685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:02.507225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233cb335-8fb5-46ae-9c30-944d218e4dd6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:02.513345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee02984d-0557-4c45-af5e-f9123c3f9fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:02.514704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02984d-0557-4c45-af5e-f9123c3f9fb4 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:02.515349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02984d-0557-4c45-af5e-f9123c3f9fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:02.515757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee02984d-0557-4c45-af5e-f9123c3f9fb4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:02.516692 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02984d-0557-4c45-af5e-f9123c3f9fb4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:02.517091 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02984d-0557-4c45-af5e-f9123c3f9fb4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:02.519125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee02984d-0557-4c45-af5e-f9123c3f9fb4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:02.529154 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 895/1789] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:02 2022] DELETE /identity/v3/users/faa00051dea645129bbd46dfd06c3f69 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:02.536254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aa19c-66bb-4efa-9e5c-e030aaf6de8d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:02.536860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aa19c-66bb-4efa-9e5c-e030aaf6de8d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:02.539920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 895/1790] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:02.541712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b903bc-4c80-483d-a2e5-ff73a923af91 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:02.542126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b903bc-4c80-483d-a2e5-ff73a923af91 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:02.542499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b903bc-4c80-483d-a2e5-ff73a923af91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:02.549975 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29aa19c-66bb-4efa-9e5c-e030aaf6de8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:02.568136 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-85b903bc-4c80-483d-a2e5-ff73a923af91 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:02.569615 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-85b903bc-4c80-483d-a2e5-ff73a923af91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:02.617020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a29aa19c-66bb-4efa-9e5c-e030aaf6de8d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:02.619807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a29aa19c-66bb-4efa-9e5c-e030aaf6de8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:02.682004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 896/1791] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:02.683048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b903bc-4c80-483d-a2e5-ff73a923af91 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:02.684803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-85b903bc-4c80-483d-a2e5-ff73a923af91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:02.699123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b903bc-4c80-483d-a2e5-ff73a923af91 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:02.705225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a07d6-d585-4f9c-b4ca-3238b57e5b71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:02.706036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a07d6-d585-4f9c-b4ca-3238b57e5b71 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:02.706379 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a07d6-d585-4f9c-b4ca-3238b57e5b71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:02.706718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30a07d6-d585-4f9c-b4ca-3238b57e5b71 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:02.707445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a07d6-d585-4f9c-b4ca-3238b57e5b71 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:02.709671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30a07d6-d585-4f9c-b4ca-3238b57e5b71 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:02.765217 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 897/1792] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:02 2022] POST /identity/v3/projects => generated 381 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:02.765217 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a07d6-d585-4f9c-b4ca-3238b57e5b71 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:02.770193 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c30a07d6-d585-4f9c-b4ca-3238b57e5b71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:02.797978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 896/1793] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:02.799403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29aa19c-66bb-4efa-9e5c-e030aaf6de8d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:02.836599 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29aa19c-66bb-4efa-9e5c-e030aaf6de8d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:02.867023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:02.885173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30a07d6-d585-4f9c-b4ca-3238b57e5b71 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:02.895287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a795e082-41ea-4f3c-9fa9-d2f0b6c6dbb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:02.895968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795e082-41ea-4f3c-9fa9-d2f0b6c6dbb6 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:02.896247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795e082-41ea-4f3c-9fa9-d2f0b6c6dbb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:02.896523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a795e082-41ea-4f3c-9fa9-d2f0b6c6dbb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:02.954426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af719c0-b774-46a1-b77a-d0988ed73c52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:02.955332 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af719c0-b774-46a1-b77a-d0988ed73c52 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:02.955688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af719c0-b774-46a1-b77a-d0988ed73c52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:02.967418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af719c0-b774-46a1-b77a-d0988ed73c52 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:02.995761 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af719c0-b774-46a1-b77a-d0988ed73c52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:03.000673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af719c0-b774-46a1-b77a-d0988ed73c52 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:03.033381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795e082-41ea-4f3c-9fa9-d2f0b6c6dbb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:03.035104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a795e082-41ea-4f3c-9fa9-d2f0b6c6dbb6 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:03.063001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 898/1794] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:03.069695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad86c-52b3-4fcf-981a-b6412fc55daa None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:03.069695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad86c-52b3-4fcf-981a-b6412fc55daa None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:03.069695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cad86c-52b3-4fcf-981a-b6412fc55daa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:03.124031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-85cad86c-52b3-4fcf-981a-b6412fc55daa None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:03.126101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 897/1795] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:02 2022] POST /identity/v3/users => generated 291 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:03.126291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-85cad86c-52b3-4fcf-981a-b6412fc55daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:03.130493 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af719c0-b774-46a1-b77a-d0988ed73c52 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:03.145361 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 899/1796] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:03.151263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cad86c-52b3-4fcf-981a-b6412fc55daa None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:03.162759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af719c0-b774-46a1-b77a-d0988ed73c52 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:03.166764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cad86c-52b3-4fcf-981a-b6412fc55daa None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:03.168563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e25767-dd24-414d-a524-19d3177d956e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:03.169363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e25767-dd24-414d-a524-19d3177d956e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:03.169648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e25767-dd24-414d-a524-19d3177d956e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:03.169951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e25767-dd24-414d-a524-19d3177d956e admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:03.171942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e25767-dd24-414d-a524-19d3177d956e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:03.173682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e25767-dd24-414d-a524-19d3177d956e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:03.188998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8dea0-d8eb-4668-9e1a-6e43935e6e48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:03.189680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8dea0-d8eb-4668-9e1a-6e43935e6e48 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:03.189993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8dea0-d8eb-4668-9e1a-6e43935e6e48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:03.190417 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8dea0-d8eb-4668-9e1a-6e43935e6e48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:03.192055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8dea0-d8eb-4668-9e1a-6e43935e6e48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:03.192055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8dea0-d8eb-4668-9e1a-6e43935e6e48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:03.195761 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8dea0-d8eb-4668-9e1a-6e43935e6e48 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:03.200427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 898/1797] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:03.202698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:03.211992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e25767-dd24-414d-a524-19d3177d956e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:03.224708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 900/1798] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:03.229252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e25767-dd24-414d-a524-19d3177d956e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:03.229448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8dea0-d8eb-4668-9e1a-6e43935e6e48 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:03.234836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459018b-0fe7-4762-b2ce-dd1fc46ef768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:03.236512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459018b-0fe7-4762-b2ce-dd1fc46ef768 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:03.237036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459018b-0fe7-4762-b2ce-dd1fc46ef768 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:03.238025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a459018b-0fe7-4762-b2ce-dd1fc46ef768 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:03.241095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459018b-0fe7-4762-b2ce-dd1fc46ef768 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:03.243873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8dea0-d8eb-4668-9e1a-6e43935e6e48 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:03.244255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a459018b-0fe7-4762-b2ce-dd1fc46ef768 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:03.250153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f1b2-dcd6-4ff3-ba3f-331e59f9e348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:03.250796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f1b2-dcd6-4ff3-ba3f-331e59f9e348 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:03.251073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f1b2-dcd6-4ff3-ba3f-331e59f9e348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:03.251346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d1f1b2-dcd6-4ff3-ba3f-331e59f9e348 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:03.252561 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1f1b2-dcd6-4ff3-ba3f-331e59f9e348 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:03.255177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d1f1b2-dcd6-4ff3-ba3f-331e59f9e348 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:03.263757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 899/1799] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:03.265611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459018b-0fe7-4762-b2ce-dd1fc46ef768 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:03.277612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a459018b-0fe7-4762-b2ce-dd1fc46ef768 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:03.284353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffeed90-f691-4720-940e-02177a51f339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:03.285682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeed90-f691-4720-940e-02177a51f339 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:03.286224 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeed90-f691-4720-940e-02177a51f339 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:03.286707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffeed90-f691-4720-940e-02177a51f339 admin admin] PATH_INFO: `/v3/projects/8401ee12bed645aea9696de41339fb7d/users/069cf084e605408ab8508ebab691dcf6/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:03.312795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 901/1800] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:03 2022] POST /identity/v3/projects => generated 377 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:19:03.317725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f1b2-dcd6-4ff3-ba3f-331e59f9e348 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:03.334782 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeed90-f691-4720-940e-02177a51f339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8401ee12bed645aea9696de41339fb7d, user_id=069cf084e605408ab8508ebab691dcf6, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:03.358927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffeed90-f691-4720-940e-02177a51f339 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:03.397821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 900/1801] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:03 2022] PUT /identity/v3/projects/8401ee12bed645aea9696de41339fb7d/users/069cf084e605408ab8508ebab691dcf6/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:03.411054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582db0a4-a2ea-4ba8-8eb8-70d723e8b590 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:03.411435 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582db0a4-a2ea-4ba8-8eb8-70d723e8b590 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:03.411616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582db0a4-a2ea-4ba8-8eb8-70d723e8b590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:03.455314 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d1f1b2-dcd6-4ff3-ba3f-331e59f9e348 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:03.482648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-582db0a4-a2ea-4ba8-8eb8-70d723e8b590 None None] MFA Rules not processed for user `069cf084e605408ab8508ebab691dcf6`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:03.484518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-582db0a4-a2ea-4ba8-8eb8-70d723e8b590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:03.552204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef722b-3f06-43b3-9b0d-ca554e7c6f58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:03.555495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef722b-3f06-43b3-9b0d-ca554e7c6f58 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:03.556108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef722b-3f06-43b3-9b0d-ca554e7c6f58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:03.556582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef722b-3f06-43b3-9b0d-ca554e7c6f58 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:03.558239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef722b-3f06-43b3-9b0d-ca554e7c6f58 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:03.561738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef722b-3f06-43b3-9b0d-ca554e7c6f58 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:03.594618 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 902/1802] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:03 2022] POST /identity/v3/users => generated 289 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:03.598229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef722b-3f06-43b3-9b0d-ca554e7c6f58 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:03.612448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef722b-3f06-43b3-9b0d-ca554e7c6f58 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:03.619173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17358e-1a90-4c4b-ad7a-1c489a29406d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:03.620402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17358e-1a90-4c4b-ad7a-1c489a29406d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:03.621036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17358e-1a90-4c4b-ad7a-1c489a29406d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:03.622806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e17358e-1a90-4c4b-ad7a-1c489a29406d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:03.624729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17358e-1a90-4c4b-ad7a-1c489a29406d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:03.628415 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e17358e-1a90-4c4b-ad7a-1c489a29406d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:03.646039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 903/1803] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:03.646159 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 901/1804] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:03 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:19:03.648516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17358e-1a90-4c4b-ad7a-1c489a29406d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:03.655750 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582db0a4-a2ea-4ba8-8eb8-70d723e8b590 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:03.673304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e17358e-1a90-4c4b-ad7a-1c489a29406d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:03.678932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582db0a4-a2ea-4ba8-8eb8-70d723e8b590 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:03.688048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a5275-b5a4-4920-8e96-eaae20564d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:03.688867 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a5275-b5a4-4920-8e96-eaae20564d5f admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:03.689153 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a5275-b5a4-4920-8e96-eaae20564d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:03.689650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40a5275-b5a4-4920-8e96-eaae20564d5f admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:03.690124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c77fbc-3f5b-4914-b6dd-5923fc0bfbc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:03.690759 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c77fbc-3f5b-4914-b6dd-5923fc0bfbc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:03.690861 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a5275-b5a4-4920-8e96-eaae20564d5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:03.691030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c77fbc-3f5b-4914-b6dd-5923fc0bfbc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:03.691302 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c77fbc-3f5b-4914-b6dd-5923fc0bfbc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:03.691958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c77fbc-3f5b-4914-b6dd-5923fc0bfbc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:03.693569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c77fbc-3f5b-4914-b6dd-5923fc0bfbc3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:03.694406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f40a5275-b5a4-4920-8e96-eaae20564d5f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:03.742031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 904/1805] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:03 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:03.743640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c77fbc-3f5b-4914-b6dd-5923fc0bfbc3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:03.758027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 902/1806] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:03 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:03.759244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a5275-b5a4-4920-8e96-eaae20564d5f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:03.782024 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c77fbc-3f5b-4914-b6dd-5923fc0bfbc3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:03.848245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:03.893678 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:03.925847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40a5275-b5a4-4920-8e96-eaae20564d5f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:03.938060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffbdbf9-bf6a-431a-af00-01f93193ea15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:03.939700 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbdbf9-bf6a-431a-af00-01f93193ea15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:03.939906 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbdbf9-bf6a-431a-af00-01f93193ea15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:03.940522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffbdbf9-bf6a-431a-af00-01f93193ea15 admin admin] PATH_INFO: `/v3/projects/72c2d9a5e45445f4b317c1eb5305c7f5/users/109127dce14543eda02c3d2c3f08bf0d/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:03.948285 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf9e45-4cee-4187-9a9a-abc4f08f4810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:03.949191 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf9e45-4cee-4187-9a9a-abc4f08f4810 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:03.949574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf9e45-4cee-4187-9a9a-abc4f08f4810 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:03.949980 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cf9e45-4cee-4187-9a9a-abc4f08f4810 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:03.951217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf9e45-4cee-4187-9a9a-abc4f08f4810 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:03.953371 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cf9e45-4cee-4187-9a9a-abc4f08f4810 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:03.977864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbdbf9-bf6a-431a-af00-01f93193ea15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=72c2d9a5e45445f4b317c1eb5305c7f5, user_id=109127dce14543eda02c3d2c3f08bf0d, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:03.985346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffbdbf9-bf6a-431a-af00-01f93193ea15 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:04.017221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 903/1807] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:03 2022] POST /identity/v3/users => generated 297 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:04.023449 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf9e45-4cee-4187-9a9a-abc4f08f4810 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:04.031316 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 905/1808] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:03 2022] PUT /identity/v3/projects/72c2d9a5e45445f4b317c1eb5305c7f5/users/109127dce14543eda02c3d2c3f08bf0d/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:04.051231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db1b9b-2557-49f8-994e-d537f8851411 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:04.051491 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cf9e45-4cee-4187-9a9a-abc4f08f4810 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:04.051980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db1b9b-2557-49f8-994e-d537f8851411 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:04.053521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2db1b9b-2557-49f8-994e-d537f8851411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:04.204795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e2db1b9b-2557-49f8-994e-d537f8851411 None None] MFA Rules not processed for user `109127dce14543eda02c3d2c3f08bf0d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:04.209300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e2db1b9b-2557-49f8-994e-d537f8851411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:04.227520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a603c0-d8da-4da6-b075-dbca0323616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:04.229499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a603c0-d8da-4da6-b075-dbca0323616e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:04.234289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a603c0-d8da-4da6-b075-dbca0323616e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:04.234962 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a603c0-d8da-4da6-b075-dbca0323616e admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:04.236245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a603c0-d8da-4da6-b075-dbca0323616e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:04.242363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a603c0-d8da-4da6-b075-dbca0323616e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:04.288203 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 904/1809] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:04.289768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a603c0-d8da-4da6-b075-dbca0323616e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:04.353218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a603c0-d8da-4da6-b075-dbca0323616e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:04.387701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 906/1810] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:04 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:04.408432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db1b9b-2557-49f8-994e-d537f8851411 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:04.409965 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e2db1b9b-2557-49f8-994e-d537f8851411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:04.412485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422f7852-715b-4193-a41e-ce84710b7a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:04.418255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f7852-715b-4193-a41e-ce84710b7a78 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:04.419651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f7852-715b-4193-a41e-ce84710b7a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:04.420214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422f7852-715b-4193-a41e-ce84710b7a78 admin admin] PATH_INFO: `/v3/projects/a908cdae8cd742b0802d6f6258926a48/users/f900fa9ed0d64cc4be5d4b4bbf9833dd/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:04.495282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f7852-715b-4193-a41e-ce84710b7a78 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a908cdae8cd742b0802d6f6258926a48, user_id=f900fa9ed0d64cc4be5d4b4bbf9833dd, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:04.506844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422f7852-715b-4193-a41e-ce84710b7a78 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:04.550912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 905/1811] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:04 2022] PUT /identity/v3/projects/a908cdae8cd742b0802d6f6258926a48/users/f900fa9ed0d64cc4be5d4b4bbf9833dd/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:04.559718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef878ce-37b4-4b28-93d4-df2db0b34143 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:04.562381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef878ce-37b4-4b28-93d4-df2db0b34143 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:04.564134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef878ce-37b4-4b28-93d4-df2db0b34143 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:04.566794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 906/1812] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:19:04 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:19:04.567688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef878ce-37b4-4b28-93d4-df2db0b34143 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:04.603074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2db1b9b-2557-49f8-994e-d537f8851411 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:04.783385 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564a9b1-2d8e-431c-b16e-51852b23c851 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06d8a144ecf43fc8de82346758b6065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:04.785412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564a9b1-2d8e-431c-b16e-51852b23c851 service glance] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:04.787745 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564a9b1-2d8e-431c-b16e-51852b23c851 service glance] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:04.792624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f564a9b1-2d8e-431c-b16e-51852b23c851 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:04.813606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef878ce-37b4-4b28-93d4-df2db0b34143 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:04.824674 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:04.831957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4196b25-78f0-4efc-b6c0-965f44761c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:04.833930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4196b25-78f0-4efc-b6c0-965f44761c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:04.837460 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4196b25-78f0-4efc-b6c0-965f44761c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:04.838269 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4196b25-78f0-4efc-b6c0-965f44761c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:04.839847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4196b25-78f0-4efc-b6c0-965f44761c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:04.844869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4196b25-78f0-4efc-b6c0-965f44761c65 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:04.881582 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 907/1813] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:04 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:04.894930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31b86b-3a92-4ff8-904b-8f98db7e3356 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:04.894930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31b86b-3a92-4ff8-904b-8f98db7e3356 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:04.894930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f31b86b-3a92-4ff8-904b-8f98db7e3356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:04.968414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0f31b86b-3a92-4ff8-904b-8f98db7e3356 None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:04.969677 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0f31b86b-3a92-4ff8-904b-8f98db7e3356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:05.010898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564a9b1-2d8e-431c-b16e-51852b23c851 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:05.013593 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f564a9b1-2d8e-431c-b16e-51852b23c851 service glance] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:05.042251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 907/1814] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 632 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:19:05.046791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564a9b1-2d8e-431c-b16e-51852b23c851 service glance] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:05.055978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:05.082265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f564a9b1-2d8e-431c-b16e-51852b23c851 service glance] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:05.093836 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e9ff8-e9cd-4ad1-b24b-5b4d9c1bffc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:05.098534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e9ff8-e9cd-4ad1-b24b-5b4d9c1bffc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:05.098828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e9ff8-e9cd-4ad1-b24b-5b4d9c1bffc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:05.099110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49e9ff8-e9cd-4ad1-b24b-5b4d9c1bffc3 admin admin] PATH_INFO: `/v3/projects/a908cdae8cd742b0802d6f6258926a48/users/f900fa9ed0d64cc4be5d4b4bbf9833dd/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:05.103594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e9ff8-e9cd-4ad1-b24b-5b4d9c1bffc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a908cdae8cd742b0802d6f6258926a48, user_id=f900fa9ed0d64cc4be5d4b4bbf9833dd, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:05.108608 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49e9ff8-e9cd-4ad1-b24b-5b4d9c1bffc3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:05.133827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 908/1815] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:05 2022] PUT /identity/v3/projects/a908cdae8cd742b0802d6f6258926a48/users/f900fa9ed0d64cc4be5d4b4bbf9833dd/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:05.133827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e9ff8-e9cd-4ad1-b24b-5b4d9c1bffc3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:05.133827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f49e9ff8-e9cd-4ad1-b24b-5b4d9c1bffc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:05.178974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 908/1816] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:19:04 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:05.179544 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165f12-2d37-442d-9c44-9a7dc2cdf4a8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:05.180000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165f12-2d37-442d-9c44-9a7dc2cdf4a8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:05.196804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33165f12-2d37-442d-9c44-9a7dc2cdf4a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:05.249335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-33165f12-2d37-442d-9c44-9a7dc2cdf4a8 None None] MFA Rules not processed for user `f900fa9ed0d64cc4be5d4b4bbf9833dd`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:05.263118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-33165f12-2d37-442d-9c44-9a7dc2cdf4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:05.265048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49e9ff8-e9cd-4ad1-b24b-5b4d9c1bffc3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:05.284557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:05.285498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:05.285809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:05.286096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] PATH_INFO: `/v3/projects/7c7f4f5861324977bb386e47dde0df11` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:05.288765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7f4f5861324977bb386e47dde0df11)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:05.290948 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:05.434170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7f4f5861324977bb386e47dde0df11', 'request_id': 'req-fc2c40ca-0d67-4889-80cd-87aa842dde4c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:05.445210 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7f4f5861324977bb386e47dde0df11', 'request_id': 'req-fc2c40ca-0d67-4889-80cd-87aa842dde4c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:05.462308 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7f4f5861324977bb386e47dde0df11', 'request_id': 'req-fc2c40ca-0d67-4889-80cd-87aa842dde4c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:05.477510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 909/1817] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:05 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:05.486475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33165f12-2d37-442d-9c44-9a7dc2cdf4a8 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:05.490993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-33165f12-2d37-442d-9c44-9a7dc2cdf4a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:05.498900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] The token cache is being invalidate because project 7c7f4f5861324977bb386e47dde0df11 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:05.498900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:05.500413 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:05.502958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 909/1818] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:05 2022] DELETE /identity/v3/projects/7c7f4f5861324977bb386e47dde0df11 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:05.508202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:05.530807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:05.633475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:05.690078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33165f12-2d37-442d-9c44-9a7dc2cdf4a8 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:05.755497 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c40ca-0d67-4889-80cd-87aa842dde4c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:05.768944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:05.770863 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:05.771335 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:05.773151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] PATH_INFO: `/v3/users/d1ceee58e294441383993a31723f8e81` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:05.777082 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1ceee58e294441383993a31723f8e81)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:05.780023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:05.812251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41e91b-fd05-4846-985c-04d8044d5be3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:05.813254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41e91b-fd05-4846-985c-04d8044d5be3 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:05.813804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41e91b-fd05-4846-985c-04d8044d5be3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:05.814373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff41e91b-fd05-4846-985c-04d8044d5be3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:05.817695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ff41e91b-fd05-4846-985c-04d8044d5be3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:05.864720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:05.954095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1ceee58e294441383993a31723f8e81'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:05.989594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1ceee58e294441383993a31723f8e81'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:05.991639 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1ceee58e294441383993a31723f8e81'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:05.994956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1ceee58e294441383993a31723f8e81'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:06.041826 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41e91b-fd05-4846-985c-04d8044d5be3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:06.057581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff41e91b-fd05-4846-985c-04d8044d5be3 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:06.057879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1ceee58e294441383993a31723f8e81'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:06.124196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 910/1819] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:05 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:19:06.135814 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41e91b-fd05-4846-985c-04d8044d5be3 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:06.143637 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ff41e91b-fd05-4846-985c-04d8044d5be3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:06.214313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 910/1820] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:05 2022] DELETE /identity/v3/users/d1ceee58e294441383993a31723f8e81 => generated 0 bytes in 701 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:06.423321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff41e91b-fd05-4846-985c-04d8044d5be3 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:06.438282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:06.440988 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:06.598362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a4af7a-468f-4c92-9183-f2402a8486c6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:06.602280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8125dd-418f-468d-ac32-b4adb2c8546a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:06.602938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8125dd-418f-468d-ac32-b4adb2c8546a service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:06.603217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8125dd-418f-468d-ac32-b4adb2c8546a service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:06.603492 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8125dd-418f-468d-ac32-b4adb2c8546a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:06.605401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8e8125dd-418f-468d-ac32-b4adb2c8546a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:06.607736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72950acb-0507-4694-8953-6ecffb37465f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:06.609364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72950acb-0507-4694-8953-6ecffb37465f service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:06.610181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72950acb-0507-4694-8953-6ecffb37465f service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:06.610864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72950acb-0507-4694-8953-6ecffb37465f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:06.616338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-72950acb-0507-4694-8953-6ecffb37465f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:06.635634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8125dd-418f-468d-ac32-b4adb2c8546a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:06.645762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8125dd-418f-468d-ac32-b4adb2c8546a service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:06.712041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 911/1821] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 577 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:06.835722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72950acb-0507-4694-8953-6ecffb37465f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:06.841186 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72950acb-0507-4694-8953-6ecffb37465f service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:06.872670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 911/1822] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:08.518373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8125dd-418f-468d-ac32-b4adb2c8546a service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:08.521157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8e8125dd-418f-468d-ac32-b4adb2c8546a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:08.640789 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:08.718317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8125dd-418f-468d-ac32-b4adb2c8546a service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:08.728428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc29d8ca-08a2-4f82-84ee-2e259030f114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:08.730063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29d8ca-08a2-4f82-84ee-2e259030f114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:08.730063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29d8ca-08a2-4f82-84ee-2e259030f114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:08.730721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc29d8ca-08a2-4f82-84ee-2e259030f114 admin admin] PATH_INFO: `/v3/projects/e1bbec80cd2142a392c4ff9542b6c639` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:08.744355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29d8ca-08a2-4f82-84ee-2e259030f114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1bbec80cd2142a392c4ff9542b6c639)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:08.749027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc29d8ca-08a2-4f82-84ee-2e259030f114 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:08.901498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bc29d8ca-08a2-4f82-84ee-2e259030f114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1bbec80cd2142a392c4ff9542b6c639', 'request_id': 'req-bc29d8ca-08a2-4f82-84ee-2e259030f114'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:08.928874 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bc29d8ca-08a2-4f82-84ee-2e259030f114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1bbec80cd2142a392c4ff9542b6c639', 'request_id': 'req-bc29d8ca-08a2-4f82-84ee-2e259030f114'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:08.964173 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bc29d8ca-08a2-4f82-84ee-2e259030f114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1bbec80cd2142a392c4ff9542b6c639', 'request_id': 'req-bc29d8ca-08a2-4f82-84ee-2e259030f114'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:09.016010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bc29d8ca-08a2-4f82-84ee-2e259030f114 admin admin] The token cache is being invalidate because project e1bbec80cd2142a392c4ff9542b6c639 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:09.017771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bc29d8ca-08a2-4f82-84ee-2e259030f114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:09.022415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bc29d8ca-08a2-4f82-84ee-2e259030f114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:09.036332 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 912/1823] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:08 2022] DELETE /identity/v3/projects/e1bbec80cd2142a392c4ff9542b6c639 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:09.042649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3ab3c-8f0a-47fe-923d-d996fdd2d569 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:09.043215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3ab3c-8f0a-47fe-923d-d996fdd2d569 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:09.043675 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c3ab3c-8f0a-47fe-923d-d996fdd2d569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:09.092961 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:09.130774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-99c3ab3c-8f0a-47fe-923d-d996fdd2d569 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:09.147913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-99c3ab3c-8f0a-47fe-923d-d996fdd2d569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:09.309022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 912/1824] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:09.325088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e69b3e-39b9-4922-81b2-1f2418166ea5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:09.325726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e69b3e-39b9-4922-81b2-1f2418166ea5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:09.326464 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e69b3e-39b9-4922-81b2-1f2418166ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:09.364106 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-04e69b3e-39b9-4922-81b2-1f2418166ea5 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:09.367620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-04e69b3e-39b9-4922-81b2-1f2418166ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:09.387835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 913/1825] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:09.391524 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3ab3c-8f0a-47fe-923d-d996fdd2d569 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:09.415956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c3ab3c-8f0a-47fe-923d-d996fdd2d569 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:09.422813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa5a5c-a8d7-4c7f-9fb9-36ac0e97d5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:09.423455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa5a5c-a8d7-4c7f-9fb9-36ac0e97d5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:09.423734 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa5a5c-a8d7-4c7f-9fb9-36ac0e97d5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:09.424026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaa5a5c-a8d7-4c7f-9fb9-36ac0e97d5f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:09.424671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa5a5c-a8d7-4c7f-9fb9-36ac0e97d5f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:09.424973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa5a5c-a8d7-4c7f-9fb9-36ac0e97d5f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:09.426721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaa5a5c-a8d7-4c7f-9fb9-36ac0e97d5f4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:09.441352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 913/1826] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:09.447269 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e69b3e-39b9-4922-81b2-1f2418166ea5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:09.464823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e69b3e-39b9-4922-81b2-1f2418166ea5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:09.475949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ebbe2-fa63-4fd5-94d7-ac6fdb5e120e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:09.476931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ebbe2-fa63-4fd5-94d7-ac6fdb5e120e admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:09.477637 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ebbe2-fa63-4fd5-94d7-ac6fdb5e120e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:09.478103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428ebbe2-fa63-4fd5-94d7-ac6fdb5e120e admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:09.479420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ebbe2-fa63-4fd5-94d7-ac6fdb5e120e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:09.483342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428ebbe2-fa63-4fd5-94d7-ac6fdb5e120e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:09.533716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 914/1827] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:09 2022] POST /identity/v3/projects => generated 393 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:09.537592 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa5a5c-a8d7-4c7f-9fb9-36ac0e97d5f4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:09.555718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaa5a5c-a8d7-4c7f-9fb9-36ac0e97d5f4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:09.670040 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bd31f-fa77-46cb-8ec7-7cf6a6cd8a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:09.670803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bd31f-fa77-46cb-8ec7-7cf6a6cd8a68 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:09.671223 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bd31f-fa77-46cb-8ec7-7cf6a6cd8a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:09.671605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863bd31f-fa77-46cb-8ec7-7cf6a6cd8a68 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:09.672735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bd31f-fa77-46cb-8ec7-7cf6a6cd8a68 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:09.676196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863bd31f-fa77-46cb-8ec7-7cf6a6cd8a68 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:09.722499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 914/1828] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:09 2022] POST /identity/v3/users => generated 297 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:19:09.728142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ebbe2-fa63-4fd5-94d7-ac6fdb5e120e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:09.746078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428ebbe2-fa63-4fd5-94d7-ac6fdb5e120e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:09.755678 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460df3c-e7d0-4f3d-b10f-052140e065e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:09.756669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460df3c-e7d0-4f3d-b10f-052140e065e0 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:09.757110 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460df3c-e7d0-4f3d-b10f-052140e065e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:09.757545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f460df3c-e7d0-4f3d-b10f-052140e065e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:09.758653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460df3c-e7d0-4f3d-b10f-052140e065e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:09.761462 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f460df3c-e7d0-4f3d-b10f-052140e065e0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:09.781739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 915/1829] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:19:09.785842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bd31f-fa77-46cb-8ec7-7cf6a6cd8a68 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:09.802852 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863bd31f-fa77-46cb-8ec7-7cf6a6cd8a68 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:09.811042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26c4c6-812f-48e1-a2b9-ecf040edfa58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:09.812128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c4c6-812f-48e1-a2b9-ecf040edfa58 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:09.812527 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c4c6-812f-48e1-a2b9-ecf040edfa58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:09.812927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26c4c6-812f-48e1-a2b9-ecf040edfa58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:09.813903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26c4c6-812f-48e1-a2b9-ecf040edfa58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:09.816399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26c4c6-812f-48e1-a2b9-ecf040edfa58 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:09.840583 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 915/1830] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:09 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:09.845293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460df3c-e7d0-4f3d-b10f-052140e065e0 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:09.856667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f460df3c-e7d0-4f3d-b10f-052140e065e0 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:09.863004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563124f-1217-4a7c-a2dd-a9141624dec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:09.864183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563124f-1217-4a7c-a2dd-a9141624dec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:09.864676 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563124f-1217-4a7c-a2dd-a9141624dec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:09.865167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563124f-1217-4a7c-a2dd-a9141624dec3 admin admin] PATH_INFO: `/v3/projects/953ad96d7c4b45f482e7a773fe831ca9/users/702fec5401a24ccf823a2cbdec84fb78/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:09.907510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563124f-1217-4a7c-a2dd-a9141624dec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=953ad96d7c4b45f482e7a773fe831ca9, user_id=702fec5401a24ccf823a2cbdec84fb78, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:09.910756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563124f-1217-4a7c-a2dd-a9141624dec3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:09.935830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 916/1831] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:09 2022] PUT /identity/v3/projects/953ad96d7c4b45f482e7a773fe831ca9/users/702fec5401a24ccf823a2cbdec84fb78/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:09.951639 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeab8d-44d5-4a86-9b2d-329aee82f7e1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:09.952077 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeab8d-44d5-4a86-9b2d-329aee82f7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:09.952453 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefeab8d-44d5-4a86-9b2d-329aee82f7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:09.988687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fefeab8d-44d5-4a86-9b2d-329aee82f7e1 None None] MFA Rules not processed for user `702fec5401a24ccf823a2cbdec84fb78`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:09.990068 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fefeab8d-44d5-4a86-9b2d-329aee82f7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:10.137225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:10.155729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 916/1832] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:09 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:10.157009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563124f-1217-4a7c-a2dd-a9141624dec3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:10.353645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563124f-1217-4a7c-a2dd-a9141624dec3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:10.374034 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bf313-b50e-4617-9617-57742c2db7d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:10.377521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bf313-b50e-4617-9617-57742c2db7d0 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:10.377521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bf313-b50e-4617-9617-57742c2db7d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:10.378431 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2bf313-b50e-4617-9617-57742c2db7d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:10.379684 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bf313-b50e-4617-9617-57742c2db7d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:10.384270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2bf313-b50e-4617-9617-57742c2db7d0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:10.406350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:10.488378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 917/1833] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:10 2022] POST /identity/v3/projects => generated 391 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:10.494317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefeab8d-44d5-4a86-9b2d-329aee82f7e1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:10.521629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefeab8d-44d5-4a86-9b2d-329aee82f7e1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:10.721639 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60efdc-9776-438f-b352-a1d6538e08bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:10.722747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60efdc-9776-438f-b352-a1d6538e08bd admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:10.723311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60efdc-9776-438f-b352-a1d6538e08bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:10.734267 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef60efdc-9776-438f-b352-a1d6538e08bd admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:10.737967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60efdc-9776-438f-b352-a1d6538e08bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:10.739423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef60efdc-9776-438f-b352-a1d6538e08bd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:10.836194 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 917/1834] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:10 2022] POST /identity/v3/users => generated 302 bytes in 340 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:10.837813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bf313-b50e-4617-9617-57742c2db7d0 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:10.873265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2bf313-b50e-4617-9617-57742c2db7d0 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:10.883808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18ad3c-980f-4eef-a3cc-7c686343aa1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:10.884851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18ad3c-980f-4eef-a3cc-7c686343aa1a admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:10.885338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18ad3c-980f-4eef-a3cc-7c686343aa1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:10.885849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c18ad3c-980f-4eef-a3cc-7c686343aa1a admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:10.887017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18ad3c-980f-4eef-a3cc-7c686343aa1a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:10.892384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c18ad3c-980f-4eef-a3cc-7c686343aa1a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:10.927472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 918/1835] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:10 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:10.942517 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60efdc-9776-438f-b352-a1d6538e08bd admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:10.961076 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef60efdc-9776-438f-b352-a1d6538e08bd admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:10.970076 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c43e4-83a2-4753-9a50-e3b56e932bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:10.971333 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c43e4-83a2-4753-9a50-e3b56e932bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:10.971903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c43e4-83a2-4753-9a50-e3b56e932bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:10.972462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5c43e4-83a2-4753-9a50-e3b56e932bcd admin admin] PATH_INFO: `/v3/projects/0502640274c64443ae51e9375dd94ba9/users/9289938aa3f54bf98745fd20fbd690b9/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:11.003240 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c43e4-83a2-4753-9a50-e3b56e932bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=0502640274c64443ae51e9375dd94ba9, user_id=9289938aa3f54bf98745fd20fbd690b9, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:11.008059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5c43e4-83a2-4753-9a50-e3b56e932bcd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:11.045561 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 918/1836] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:10 2022] PUT /identity/v3/projects/0502640274c64443ae51e9375dd94ba9/users/9289938aa3f54bf98745fd20fbd690b9/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:11.047380 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18ad3c-980f-4eef-a3cc-7c686343aa1a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:11.082430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c18ad3c-980f-4eef-a3cc-7c686343aa1a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:11.179118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddd7f9c-91fc-42a1-94cc-a366895eee15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:11.180192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd7f9c-91fc-42a1-94cc-a366895eee15 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:11.180682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd7f9c-91fc-42a1-94cc-a366895eee15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:11.181349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddd7f9c-91fc-42a1-94cc-a366895eee15 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:11.182622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd7f9c-91fc-42a1-94cc-a366895eee15 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:11.185810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddd7f9c-91fc-42a1-94cc-a366895eee15 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:11.204354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 919/1837] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:11 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:11.211975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c43e4-83a2-4753-9a50-e3b56e932bcd admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:11.230673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5c43e4-83a2-4753-9a50-e3b56e932bcd admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:11.238983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679f688-fd61-4928-a6c5-37f5714fd612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:11.240177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679f688-fd61-4928-a6c5-37f5714fd612 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:11.240667 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679f688-fd61-4928-a6c5-37f5714fd612 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:11.241153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6679f688-fd61-4928-a6c5-37f5714fd612 admin admin] PATH_INFO: `/v3/projects/0502640274c64443ae51e9375dd94ba9/users/9289938aa3f54bf98745fd20fbd690b9/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:11.244730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679f688-fd61-4928-a6c5-37f5714fd612 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0502640274c64443ae51e9375dd94ba9, user_id=9289938aa3f54bf98745fd20fbd690b9, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:11.250281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6679f688-fd61-4928-a6c5-37f5714fd612 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:11.269876 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 919/1838] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:11 2022] PUT /identity/v3/projects/0502640274c64443ae51e9375dd94ba9/users/9289938aa3f54bf98745fd20fbd690b9/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:11.288390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e246c-04bb-4f06-a69e-b4dd24b07f52 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:11.288898 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e246c-04bb-4f06-a69e-b4dd24b07f52 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:11.289403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961e246c-04bb-4f06-a69e-b4dd24b07f52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:11.342740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-961e246c-04bb-4f06-a69e-b4dd24b07f52 None None] MFA Rules not processed for user `9289938aa3f54bf98745fd20fbd690b9`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:11.345209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-961e246c-04bb-4f06-a69e-b4dd24b07f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:11.577836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 920/1839] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:11 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:11.594203 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679f688-fd61-4928-a6c5-37f5714fd612 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:11.595942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6679f688-fd61-4928-a6c5-37f5714fd612 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:11.704123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6679f688-fd61-4928-a6c5-37f5714fd612 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:11.711046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd114a5-1138-49e4-9221-1daab9c17f56 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:11.712106 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd114a5-1138-49e4-9221-1daab9c17f56 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:11.712578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd114a5-1138-49e4-9221-1daab9c17f56 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:11.713078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd114a5-1138-49e4-9221-1daab9c17f56 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:11.738741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd114a5-1138-49e4-9221-1daab9c17f56 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:11.738741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd114a5-1138-49e4-9221-1daab9c17f56 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:11.762302 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 920/1840] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:11 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:19:11.854097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e246c-04bb-4f06-a69e-b4dd24b07f52 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:11.856673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-961e246c-04bb-4f06-a69e-b4dd24b07f52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:11.885538 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-961e246c-04bb-4f06-a69e-b4dd24b07f52 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:11.902417 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca75be84-1a94-4811-a21b-203754ad4220 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:11.903757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75be84-1a94-4811-a21b-203754ad4220 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:11.906348 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75be84-1a94-4811-a21b-203754ad4220 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:11.906985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca75be84-1a94-4811-a21b-203754ad4220 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:12.152445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75be84-1a94-4811-a21b-203754ad4220 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:12.155676 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca75be84-1a94-4811-a21b-203754ad4220 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:12.174693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:12.213600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 921/1841] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:11 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:16.101411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd114a5-1138-49e4-9221-1daab9c17f56 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:16.104397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fdd114a5-1138-49e4-9221-1daab9c17f56 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:16.277199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:16.332714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd114a5-1138-49e4-9221-1daab9c17f56 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:16.345725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:16.346519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:16.346865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:16.347144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] PATH_INFO: `/v3/users/069cf084e605408ab8508ebab691dcf6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:16.348694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] RBAC: Authorizing `identity:delete_user(user_id=069cf084e605408ab8508ebab691dcf6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:16.350819 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:16.433614 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '069cf084e605408ab8508ebab691dcf6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:16.458982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '069cf084e605408ab8508ebab691dcf6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:16.460113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '069cf084e605408ab8508ebab691dcf6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:16.461143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '069cf084e605408ab8508ebab691dcf6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:16.477413 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '069cf084e605408ab8508ebab691dcf6'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:16.524397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 921/1842] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:16 2022] DELETE /identity/v3/users/069cf084e605408ab8508ebab691dcf6 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:16.526628 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e94f2a-96c7-4397-94ec-6f9356f7b982 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:16.527111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e94f2a-96c7-4397-94ec-6f9356f7b982 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:16.527186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e94f2a-96c7-4397-94ec-6f9356f7b982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:16.556685 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b5e94f2a-96c7-4397-94ec-6f9356f7b982 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:16.558997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b5e94f2a-96c7-4397-94ec-6f9356f7b982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:16.688044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 922/1843] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:16.703714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:16.706563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:16.850279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c28cc-5c52-4995-971d-9f5970e4578c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:16.857687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51831ea-5785-49f6-8ae6-c303a949f5f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:16.858532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51831ea-5785-49f6-8ae6-c303a949f5f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:16.859069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51831ea-5785-49f6-8ae6-c303a949f5f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:16.859419 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51831ea-5785-49f6-8ae6-c303a949f5f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:16.876032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51831ea-5785-49f6-8ae6-c303a949f5f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:16.877914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51831ea-5785-49f6-8ae6-c303a949f5f4 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:16.899399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 922/1844] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:16.925136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e94f2a-96c7-4397-94ec-6f9356f7b982 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:16.940306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b5e94f2a-96c7-4397-94ec-6f9356f7b982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:16.954779 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e94f2a-96c7-4397-94ec-6f9356f7b982 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:16.960622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:16.961378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:16.961937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:16.962673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] PATH_INFO: `/v3/users/702fec5401a24ccf823a2cbdec84fb78` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:16.964459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] RBAC: Authorizing `identity:delete_user(user_id=702fec5401a24ccf823a2cbdec84fb78)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:16.967415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:17.054698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '702fec5401a24ccf823a2cbdec84fb78'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:17.068117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '702fec5401a24ccf823a2cbdec84fb78'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:17.068930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '702fec5401a24ccf823a2cbdec84fb78'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:17.069661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '702fec5401a24ccf823a2cbdec84fb78'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:17.081736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '702fec5401a24ccf823a2cbdec84fb78'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:17.128520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 923/1845] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:16 2022] DELETE /identity/v3/users/702fec5401a24ccf823a2cbdec84fb78 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:17.140631 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e59cc-2a66-48cf-901e-4f25f0772a57 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:17.140631 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e59cc-2a66-48cf-901e-4f25f0772a57 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:17.140631 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e59cc-2a66-48cf-901e-4f25f0772a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:17.197106 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ff3e59cc-2a66-48cf-901e-4f25f0772a57 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:17.204077 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ff3e59cc-2a66-48cf-901e-4f25f0772a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:17.373130 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 923/1846] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:17.406904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:17.409279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:17.610201 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dfe696d-3ae4-4076-b292-d860e49d61de admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:17.619202 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0087d9-6cfe-4346-b748-6cc125dbd2ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:17.620350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0087d9-6cfe-4346-b748-6cc125dbd2ad service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:17.620847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0087d9-6cfe-4346-b748-6cc125dbd2ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:17.621358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0087d9-6cfe-4346-b748-6cc125dbd2ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:17.645875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0087d9-6cfe-4346-b748-6cc125dbd2ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:17.647818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0087d9-6cfe-4346-b748-6cc125dbd2ad service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:17.672512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 924/1847] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:18.080666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e59cc-2a66-48cf-901e-4f25f0772a57 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:18.082266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ff3e59cc-2a66-48cf-901e-4f25f0772a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:18.097394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e59cc-2a66-48cf-901e-4f25f0772a57 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:18.103238 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:18.104218 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:18.104499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:18.104795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] PATH_INFO: `/v3/projects/8401ee12bed645aea9696de41339fb7d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:18.106224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=8401ee12bed645aea9696de41339fb7d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:18.108340 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:18.124023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:18.194796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8401ee12bed645aea9696de41339fb7d', 'request_id': 'req-d6741106-1dca-46c5-b190-0b1aa15e6a6b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.207187 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8401ee12bed645aea9696de41339fb7d', 'request_id': 'req-d6741106-1dca-46c5-b190-0b1aa15e6a6b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.219808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8401ee12bed645aea9696de41339fb7d', 'request_id': 'req-d6741106-1dca-46c5-b190-0b1aa15e6a6b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.235394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] The token cache is being invalidate because project 8401ee12bed645aea9696de41339fb7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:18.235697 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.236684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.239076 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 924/1848] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:18 2022] DELETE /identity/v3/projects/8401ee12bed645aea9696de41339fb7d => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:18.243473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0087d9-6cfe-4346-b748-6cc125dbd2ad service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:18.253767 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0087d9-6cfe-4346-b748-6cc125dbd2ad service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:18.263701 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:18.357534 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:18.359086 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:18.361186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:18.361481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] PATH_INFO: `/v3/users/f900fa9ed0d64cc4be5d4b4bbf9833dd` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:18.363337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] RBAC: Authorizing `identity:delete_user(user_id=f900fa9ed0d64cc4be5d4b4bbf9833dd)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:18.367236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:18.466144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f900fa9ed0d64cc4be5d4b4bbf9833dd'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.480222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f900fa9ed0d64cc4be5d4b4bbf9833dd'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.481265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f900fa9ed0d64cc4be5d4b4bbf9833dd'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.482550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f900fa9ed0d64cc4be5d4b4bbf9833dd'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.494436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f900fa9ed0d64cc4be5d4b4bbf9833dd'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.522801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 925/1849] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:18 2022] DELETE /identity/v3/users/f900fa9ed0d64cc4be5d4b4bbf9833dd => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:18.595444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:18.597578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:18.621904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6741106-1dca-46c5-b190-0b1aa15e6a6b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:18.720207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:18.721823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:18.722448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:18.722889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] PATH_INFO: `/v3/projects/953ad96d7c4b45f482e7a773fe831ca9` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:18.725958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=953ad96d7c4b45f482e7a773fe831ca9)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:18.731179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:18.812366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '953ad96d7c4b45f482e7a773fe831ca9', 'request_id': 'req-5d7fe68e-11b7-4f69-bd30-43980dc29db5'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.819579 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '953ad96d7c4b45f482e7a773fe831ca9', 'request_id': 'req-5d7fe68e-11b7-4f69-bd30-43980dc29db5'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.832841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '953ad96d7c4b45f482e7a773fe831ca9', 'request_id': 'req-5d7fe68e-11b7-4f69-bd30-43980dc29db5'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.850269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] The token cache is being invalidate because project 953ad96d7c4b45f482e7a773fe831ca9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:18.850582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.851284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:18.853838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 925/1850] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:18 2022] DELETE /identity/v3/projects/953ad96d7c4b45f482e7a773fe831ca9 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:18.858275 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:18.862689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:18.877618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5310581-667a-4907-932d-c5e46037e6be admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:18.974459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1cfe0-5365-466c-a51f-f2760fb550f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:18.977160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1cfe0-5365-466c-a51f-f2760fb550f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:18.978562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1cfe0-5365-466c-a51f-f2760fb550f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:18.979063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1cfe0-5365-466c-a51f-f2760fb550f5 admin admin] PATH_INFO: `/v3/users/9289938aa3f54bf98745fd20fbd690b9` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:18.980675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1cfe0-5365-466c-a51f-f2760fb550f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9289938aa3f54bf98745fd20fbd690b9)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:18.983428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1cfe0-5365-466c-a51f-f2760fb550f5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:18.997688 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:18.999765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:19.022531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7fe68e-11b7-4f69-bd30-43980dc29db5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:19.036007 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afebdc2f-b188-4d5e-a6eb-f51614404ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:19.037181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebdc2f-b188-4d5e-a6eb-f51614404ee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:19.038000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebdc2f-b188-4d5e-a6eb-f51614404ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:19.038403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afebdc2f-b188-4d5e-a6eb-f51614404ee8 admin admin] PATH_INFO: `/v3/projects/a908cdae8cd742b0802d6f6258926a48` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:19.040513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebdc2f-b188-4d5e-a6eb-f51614404ee8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a908cdae8cd742b0802d6f6258926a48)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:19.043536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afebdc2f-b188-4d5e-a6eb-f51614404ee8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:19.079333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:19.090343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:19.098963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-34b1cfe0-5365-466c-a51f-f2760fb550f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9289938aa3f54bf98745fd20fbd690b9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:19.110939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-34b1cfe0-5365-466c-a51f-f2760fb550f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9289938aa3f54bf98745fd20fbd690b9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:19.111846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-34b1cfe0-5365-466c-a51f-f2760fb550f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9289938aa3f54bf98745fd20fbd690b9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:19.112740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-34b1cfe0-5365-466c-a51f-f2760fb550f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9289938aa3f54bf98745fd20fbd690b9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:19.125258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-34b1cfe0-5365-466c-a51f-f2760fb550f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9289938aa3f54bf98745fd20fbd690b9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:19.129733 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-afebdc2f-b188-4d5e-a6eb-f51614404ee8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a908cdae8cd742b0802d6f6258926a48', 'request_id': 'req-afebdc2f-b188-4d5e-a6eb-f51614404ee8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:19.142741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-afebdc2f-b188-4d5e-a6eb-f51614404ee8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a908cdae8cd742b0802d6f6258926a48', 'request_id': 'req-afebdc2f-b188-4d5e-a6eb-f51614404ee8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:19.154808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 926/1851] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:18 2022] DELETE /identity/v3/users/9289938aa3f54bf98745fd20fbd690b9 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:19.158210 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-afebdc2f-b188-4d5e-a6eb-f51614404ee8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a908cdae8cd742b0802d6f6258926a48', 'request_id': 'req-afebdc2f-b188-4d5e-a6eb-f51614404ee8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:19.178864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-afebdc2f-b188-4d5e-a6eb-f51614404ee8 admin admin] The token cache is being invalidate because project a908cdae8cd742b0802d6f6258926a48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:19.179424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-afebdc2f-b188-4d5e-a6eb-f51614404ee8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:19.180597 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-afebdc2f-b188-4d5e-a6eb-f51614404ee8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:19.187915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 926/1852] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:18 2022] DELETE /identity/v3/projects/a908cdae8cd742b0802d6f6258926a48 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:19.189804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dcdbc-3d90-482c-9416-ca30bdd160e7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:19.190380 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dcdbc-3d90-482c-9416-ca30bdd160e7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:19.190712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41dcdbc-3d90-482c-9416-ca30bdd160e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:19.230186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b41dcdbc-3d90-482c-9416-ca30bdd160e7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:19.233258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b41dcdbc-3d90-482c-9416-ca30bdd160e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:19.331794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 927/1853] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:19.339696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee788096-1fea-4df4-8b89-6a2eec309da9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:19.340441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee788096-1fea-4df4-8b89-6a2eec309da9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:19.340441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee788096-1fea-4df4-8b89-6a2eec309da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:19.363473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ee788096-1fea-4df4-8b89-6a2eec309da9 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:19.364797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ee788096-1fea-4df4-8b89-6a2eec309da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:19.374786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 927/1854] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:19.383091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dcdbc-3d90-482c-9416-ca30bdd160e7 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:19.394132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41dcdbc-3d90-482c-9416-ca30bdd160e7 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:19.400176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7205cb2-2f21-49dc-a0b4-3b609b71998d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:19.401051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7205cb2-2f21-49dc-a0b4-3b609b71998d admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:19.401421 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7205cb2-2f21-49dc-a0b4-3b609b71998d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:19.401844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7205cb2-2f21-49dc-a0b4-3b609b71998d admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:19.403048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7205cb2-2f21-49dc-a0b4-3b609b71998d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:19.403269 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7205cb2-2f21-49dc-a0b4-3b609b71998d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:19.405352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7205cb2-2f21-49dc-a0b4-3b609b71998d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:19.421591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 928/1855] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:19.426092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee788096-1fea-4df4-8b89-6a2eec309da9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:19.436532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee788096-1fea-4df4-8b89-6a2eec309da9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:19.442980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca65a8-97b3-43c1-88dd-689020f38010 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:19.443846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca65a8-97b3-43c1-88dd-689020f38010 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:19.444799 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca65a8-97b3-43c1-88dd-689020f38010 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:19.444799 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ca65a8-97b3-43c1-88dd-689020f38010 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:19.445760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca65a8-97b3-43c1-88dd-689020f38010 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:19.447975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ca65a8-97b3-43c1-88dd-689020f38010 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:19.494988 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 928/1856] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:19 2022] POST /identity/v3/projects => generated 385 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:19.498935 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7205cb2-2f21-49dc-a0b4-3b609b71998d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:19.513511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7205cb2-2f21-49dc-a0b4-3b609b71998d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:19.612212 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a407ad-7ab6-4b8e-aaa2-359fe9e1d2ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:19.613977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a407ad-7ab6-4b8e-aaa2-359fe9e1d2ad admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:19.614292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a407ad-7ab6-4b8e-aaa2-359fe9e1d2ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:19.614562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a407ad-7ab6-4b8e-aaa2-359fe9e1d2ad admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:19.619470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a407ad-7ab6-4b8e-aaa2-359fe9e1d2ad admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:19.621967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a407ad-7ab6-4b8e-aaa2-359fe9e1d2ad admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:19.667973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 929/1857] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:19 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:19.673429 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca65a8-97b3-43c1-88dd-689020f38010 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:19.692122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ca65a8-97b3-43c1-88dd-689020f38010 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:19.698478 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119cd21-ecb6-4eb6-b6a9-023bddb436b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:19.699206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119cd21-ecb6-4eb6-b6a9-023bddb436b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:19.699521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119cd21-ecb6-4eb6-b6a9-023bddb436b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:19.699974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7119cd21-ecb6-4eb6-b6a9-023bddb436b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:19.700449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119cd21-ecb6-4eb6-b6a9-023bddb436b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:19.712233 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7119cd21-ecb6-4eb6-b6a9-023bddb436b0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:19.738679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 929/1858] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:19.741390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a407ad-7ab6-4b8e-aaa2-359fe9e1d2ad admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:19.765134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a407ad-7ab6-4b8e-aaa2-359fe9e1d2ad admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:19.772465 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b34a8ec-f925-4341-80d7-9724bc294c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:19.773150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34a8ec-f925-4341-80d7-9724bc294c07 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:19.773724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34a8ec-f925-4341-80d7-9724bc294c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:19.774039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b34a8ec-f925-4341-80d7-9724bc294c07 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:19.774753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34a8ec-f925-4341-80d7-9724bc294c07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:19.776928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b34a8ec-f925-4341-80d7-9724bc294c07 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:19.791299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 930/1859] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:19 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:19.795443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119cd21-ecb6-4eb6-b6a9-023bddb436b0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:19.808806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7119cd21-ecb6-4eb6-b6a9-023bddb436b0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:19.832263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c55ff-2109-4b18-b07e-f10b6c053c20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:19.832263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c55ff-2109-4b18-b07e-f10b6c053c20 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:19.832263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c55ff-2109-4b18-b07e-f10b6c053c20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:19.832263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3c55ff-2109-4b18-b07e-f10b6c053c20 admin admin] PATH_INFO: `/v3/projects/3a8a2b34a8a4468ab829bfbad6d7fbe6/users/cb233f9cb9af4b7db0c4441a84dd8c16/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:19.852551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c55ff-2109-4b18-b07e-f10b6c053c20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a8a2b34a8a4468ab829bfbad6d7fbe6, user_id=cb233f9cb9af4b7db0c4441a84dd8c16, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:19.855392 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3c55ff-2109-4b18-b07e-f10b6c053c20 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:19.876722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 930/1860] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:19 2022] PUT /identity/v3/projects/3a8a2b34a8a4468ab829bfbad6d7fbe6/users/cb233f9cb9af4b7db0c4441a84dd8c16/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:19.889938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc85e2-7f52-4036-874b-2f08d6685bdb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:19.890496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc85e2-7f52-4036-874b-2f08d6685bdb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:19.890496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecc85e2-7f52-4036-874b-2f08d6685bdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:19.936067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6ecc85e2-7f52-4036-874b-2f08d6685bdb None None] MFA Rules not processed for user `cb233f9cb9af4b7db0c4441a84dd8c16`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:19.937639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6ecc85e2-7f52-4036-874b-2f08d6685bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:19.949267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:19.951667 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c55ff-2109-4b18-b07e-f10b6c053c20 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:19.955021 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6d3c55ff-2109-4b18-b07e-f10b6c053c20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:20.066320 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3c55ff-2109-4b18-b07e-f10b6c053c20 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:20.072163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1d5485-048d-448f-9c88-9a84aba0b14d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:20.073113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5485-048d-448f-9c88-9a84aba0b14d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:20.073834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5485-048d-448f-9c88-9a84aba0b14d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:20.073834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1d5485-048d-448f-9c88-9a84aba0b14d admin admin] PATH_INFO: `/v3/projects/0502640274c64443ae51e9375dd94ba9` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:20.074161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 931/1861] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:19 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:20.075267 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d5485-048d-448f-9c88-9a84aba0b14d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0502640274c64443ae51e9375dd94ba9)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:20.077346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1d5485-048d-448f-9c88-9a84aba0b14d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:20.080773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc85e2-7f52-4036-874b-2f08d6685bdb None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:20.093936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecc85e2-7f52-4036-874b-2f08d6685bdb None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:20.099869 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fa13c-c21f-4394-8dff-1e364d41a2de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:20.100728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fa13c-c21f-4394-8dff-1e364d41a2de admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:20.101049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fa13c-c21f-4394-8dff-1e364d41a2de admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:20.101049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819fa13c-c21f-4394-8dff-1e364d41a2de admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:20.101717 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fa13c-c21f-4394-8dff-1e364d41a2de admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:20.103856 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819fa13c-c21f-4394-8dff-1e364d41a2de admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:20.145631 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 932/1862] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:20 2022] POST /identity/v3/projects => generated 387 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:19:20.149437 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cc1d5485-048d-448f-9c88-9a84aba0b14d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0502640274c64443ae51e9375dd94ba9', 'request_id': 'req-cc1d5485-048d-448f-9c88-9a84aba0b14d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:20.150434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fa13c-c21f-4394-8dff-1e364d41a2de admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:20.151183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:20.169606 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cc1d5485-048d-448f-9c88-9a84aba0b14d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0502640274c64443ae51e9375dd94ba9', 'request_id': 'req-cc1d5485-048d-448f-9c88-9a84aba0b14d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:20.187380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cc1d5485-048d-448f-9c88-9a84aba0b14d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0502640274c64443ae51e9375dd94ba9', 'request_id': 'req-cc1d5485-048d-448f-9c88-9a84aba0b14d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:20.205139 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cc1d5485-048d-448f-9c88-9a84aba0b14d admin admin] The token cache is being invalidate because project 0502640274c64443ae51e9375dd94ba9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:20.205411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cc1d5485-048d-448f-9c88-9a84aba0b14d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:20.206162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cc1d5485-048d-448f-9c88-9a84aba0b14d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:20.215995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 931/1863] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:19 2022] DELETE /identity/v3/projects/0502640274c64443ae51e9375dd94ba9 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:20.218532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71eb47-1edb-4998-bc79-213a9e8a4009 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:20.218894 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71eb47-1edb-4998-bc79-213a9e8a4009 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:20.219073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71eb47-1edb-4998-bc79-213a9e8a4009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:20.245297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8b71eb47-1edb-4998-bc79-213a9e8a4009 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:20.246629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8b71eb47-1edb-4998-bc79-213a9e8a4009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:20.267179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819fa13c-c21f-4394-8dff-1e364d41a2de admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:20.274202 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002827c7-1e47-43dc-8591-d204995b17bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:20.274854 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002827c7-1e47-43dc-8591-d204995b17bc admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:20.275305 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002827c7-1e47-43dc-8591-d204995b17bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:20.275760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002827c7-1e47-43dc-8591-d204995b17bc admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:20.276880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002827c7-1e47-43dc-8591-d204995b17bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:20.280916 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002827c7-1e47-43dc-8591-d204995b17bc admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:20.315513 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 933/1864] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:20 2022] POST /identity/v3/users => generated 300 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:19:20.332864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002827c7-1e47-43dc-8591-d204995b17bc admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:20.336535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-002827c7-1e47-43dc-8591-d204995b17bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:20.337196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 932/1865] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:20.346517 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6ebd8-f509-42d8-b7c5-5ab9d4ebfd15 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:20.347361 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6ebd8-f509-42d8-b7c5-5ab9d4ebfd15 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:20.347649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e6ebd8-f509-42d8-b7c5-5ab9d4ebfd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:20.365344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002827c7-1e47-43dc-8591-d204995b17bc admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:20.370859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e29a2d-89ad-4f2f-ab56-ce310399865e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:20.371726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e29a2d-89ad-4f2f-ab56-ce310399865e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:20.372193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e29a2d-89ad-4f2f-ab56-ce310399865e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:20.372963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e29a2d-89ad-4f2f-ab56-ce310399865e admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:20.377928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e29a2d-89ad-4f2f-ab56-ce310399865e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:20.384523 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e29a2d-89ad-4f2f-ab56-ce310399865e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:20.402201 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-99e6ebd8-f509-42d8-b7c5-5ab9d4ebfd15 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:20.405076 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-99e6ebd8-f509-42d8-b7c5-5ab9d4ebfd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:20.406902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 934/1866] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:20.407905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e29a2d-89ad-4f2f-ab56-ce310399865e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:20.422140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e29a2d-89ad-4f2f-ab56-ce310399865e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:20.428037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1626bb-3c76-46a4-8bd7-dc1ab4e4f7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:20.428480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 933/1867] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:20.428651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1626bb-3c76-46a4-8bd7-dc1ab4e4f7b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:20.429010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1626bb-3c76-46a4-8bd7-dc1ab4e4f7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:20.429405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1626bb-3c76-46a4-8bd7-dc1ab4e4f7b5 admin admin] PATH_INFO: `/v3/projects/5ed70e66b60a4f16a9c9d6e461c4202f/users/5317b897b8ed4a3e9d09870471b0745d/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:20.432841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6ebd8-f509-42d8-b7c5-5ab9d4ebfd15 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:20.447225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e6ebd8-f509-42d8-b7c5-5ab9d4ebfd15 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:20.453556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1626bb-3c76-46a4-8bd7-dc1ab4e4f7b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed70e66b60a4f16a9c9d6e461c4202f, user_id=5317b897b8ed4a3e9d09870471b0745d, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:20.454261 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc84ce7-96eb-4b8e-aa32-994761ed8e75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:20.454891 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc84ce7-96eb-4b8e-aa32-994761ed8e75 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:20.455165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc84ce7-96eb-4b8e-aa32-994761ed8e75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:20.455436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc84ce7-96eb-4b8e-aa32-994761ed8e75 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:20.456085 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc84ce7-96eb-4b8e-aa32-994761ed8e75 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:20.456391 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc84ce7-96eb-4b8e-aa32-994761ed8e75 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:20.457572 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1626bb-3c76-46a4-8bd7-dc1ab4e4f7b5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:20.458202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc84ce7-96eb-4b8e-aa32-994761ed8e75 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:20.474626 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 934/1868] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:20.476478 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 935/1869] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:20 2022] PUT /identity/v3/projects/5ed70e66b60a4f16a9c9d6e461c4202f/users/5317b897b8ed4a3e9d09870471b0745d/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:20.479087 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc84ce7-96eb-4b8e-aa32-994761ed8e75 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:20.481604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1626bb-3c76-46a4-8bd7-dc1ab4e4f7b5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:20.491207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc84ce7-96eb-4b8e-aa32-994761ed8e75 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:20.567212 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:20.577691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eb6dd-2310-466b-a05c-10f0257dc67f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:20.578461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb6dd-2310-466b-a05c-10f0257dc67f admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:20.578838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb6dd-2310-466b-a05c-10f0257dc67f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:20.579196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9eb6dd-2310-466b-a05c-10f0257dc67f admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:20.580306 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eb6dd-2310-466b-a05c-10f0257dc67f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:20.583274 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9eb6dd-2310-466b-a05c-10f0257dc67f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:20.595152 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1626bb-3c76-46a4-8bd7-dc1ab4e4f7b5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:20.601302 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fce28-5007-4080-98b6-095883d5a057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:20.602086 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fce28-5007-4080-98b6-095883d5a057 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:20.602369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fce28-5007-4080-98b6-095883d5a057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:20.602638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fce28-5007-4080-98b6-095883d5a057 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:20.603300 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fce28-5007-4080-98b6-095883d5a057 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:20.604972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080fce28-5007-4080-98b6-095883d5a057 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:20.635499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 936/1870] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:19:20.635973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 935/1871] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:20 2022] POST /identity/v3/projects => generated 385 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:20.647045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fce28-5007-4080-98b6-095883d5a057 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:20.654157 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eb6dd-2310-466b-a05c-10f0257dc67f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:20.675029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080fce28-5007-4080-98b6-095883d5a057 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:20.740731 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:20.786384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9eb6dd-2310-466b-a05c-10f0257dc67f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:20.794369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa34c43-068e-46b7-bb6f-08d986c9ba55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:20.795381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa34c43-068e-46b7-bb6f-08d986c9ba55 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:20.795682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa34c43-068e-46b7-bb6f-08d986c9ba55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:20.796377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa34c43-068e-46b7-bb6f-08d986c9ba55 admin admin] PATH_INFO: `/v3/projects/5ed70e66b60a4f16a9c9d6e461c4202f/users/5317b897b8ed4a3e9d09870471b0745d/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:20.798059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5f39e-a41d-4fcc-bd22-dadd6c3e5944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:20.799038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5f39e-a41d-4fcc-bd22-dadd6c3e5944 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:20.799497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5f39e-a41d-4fcc-bd22-dadd6c3e5944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:20.799702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa34c43-068e-46b7-bb6f-08d986c9ba55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ed70e66b60a4f16a9c9d6e461c4202f, user_id=5317b897b8ed4a3e9d09870471b0745d, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:20.800282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5f39e-a41d-4fcc-bd22-dadd6c3e5944 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:20.801130 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5f39e-a41d-4fcc-bd22-dadd6c3e5944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:20.803108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa34c43-068e-46b7-bb6f-08d986c9ba55 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:20.803589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5f39e-a41d-4fcc-bd22-dadd6c3e5944 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:20.836921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 936/1872] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:20 2022] PUT /identity/v3/projects/5ed70e66b60a4f16a9c9d6e461c4202f/users/5317b897b8ed4a3e9d09870471b0745d/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:20.850427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc4c49-59f2-477a-9109-edeff48ce86e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:20.850741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc4c49-59f2-477a-9109-edeff48ce86e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:20.851051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bc4c49-59f2-477a-9109-edeff48ce86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:20.868864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 937/1873] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:20 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:20.871217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5f39e-a41d-4fcc-bd22-dadd6c3e5944 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:20.892585 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-11bc4c49-59f2-477a-9109-edeff48ce86e None None] MFA Rules not processed for user `5317b897b8ed4a3e9d09870471b0745d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:20.894770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-11bc4c49-59f2-477a-9109-edeff48ce86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:20.901520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5f39e-a41d-4fcc-bd22-dadd6c3e5944 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:21.054586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 937/1874] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:20 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:21.067120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fea66f-3cad-4d35-8a99-0e22165d97d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:21.067876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fea66f-3cad-4d35-8a99-0e22165d97d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:21.068365 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fea66f-3cad-4d35-8a99-0e22165d97d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:21.068646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fea66f-3cad-4d35-8a99-0e22165d97d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:21.070858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fea66f-3cad-4d35-8a99-0e22165d97d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:21.071769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc4c49-59f2-477a-9109-edeff48ce86e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:21.073254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-11bc4c49-59f2-477a-9109-edeff48ce86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:21.075224 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fea66f-3cad-4d35-8a99-0e22165d97d2 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:21.105948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 938/1875] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:20 2022] GET /identity/v3/roles => generated 1420 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:21.110289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fea66f-3cad-4d35-8a99-0e22165d97d2 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:21.135211 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fea66f-3cad-4d35-8a99-0e22165d97d2 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:21.145873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bec0c3-00a4-4e6d-8fad-6c7ce47cc3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:21.146896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bec0c3-00a4-4e6d-8fad-6c7ce47cc3ed admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:21.147333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bec0c3-00a4-4e6d-8fad-6c7ce47cc3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:21.147743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bec0c3-00a4-4e6d-8fad-6c7ce47cc3ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:21.148706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bec0c3-00a4-4e6d-8fad-6c7ce47cc3ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:21.151087 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6bec0c3-00a4-4e6d-8fad-6c7ce47cc3ed admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:21.167170 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 939/1876] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:21 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:19:21.172104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bec0c3-00a4-4e6d-8fad-6c7ce47cc3ed admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:21.195098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bec0c3-00a4-4e6d-8fad-6c7ce47cc3ed admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:21.203390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aa06076-ad7d-4392-b8ec-e4920a108a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:21.204505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa06076-ad7d-4392-b8ec-e4920a108a45 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:21.204923 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa06076-ad7d-4392-b8ec-e4920a108a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:21.205331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aa06076-ad7d-4392-b8ec-e4920a108a45 admin admin] PATH_INFO: `/v3/projects/0f388ef6552748f28f23384ec520c976/users/bfcc98fed72143f39a5ed63a7bbce5a3/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:21.228795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bc4c49-59f2-477a-9109-edeff48ce86e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:21.232405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa06076-ad7d-4392-b8ec-e4920a108a45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f388ef6552748f28f23384ec520c976, user_id=bfcc98fed72143f39a5ed63a7bbce5a3, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:21.232946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1c8fa-35c2-4596-aafd-b14120bdd944 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:21.233588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1c8fa-35c2-4596-aafd-b14120bdd944 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:21.233897 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1c8fa-35c2-4596-aafd-b14120bdd944 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:21.234154 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d1c8fa-35c2-4596-aafd-b14120bdd944 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:21.236612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aa06076-ad7d-4392-b8ec-e4920a108a45 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:21.256526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1c8fa-35c2-4596-aafd-b14120bdd944 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:21.258208 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d1c8fa-35c2-4596-aafd-b14120bdd944 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:21.268666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 940/1877] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:21 2022] PUT /identity/v3/projects/0f388ef6552748f28f23384ec520c976/users/bfcc98fed72143f39a5ed63a7bbce5a3/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:21.280709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c0d0d-cc12-472d-a3cb-c3e65ddb875e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:21.281005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c0d0d-cc12-472d-a3cb-c3e65ddb875e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:21.281379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5c0d0d-cc12-472d-a3cb-c3e65ddb875e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:21.292171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 938/1878] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:21 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:21.341987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0b5c0d0d-cc12-472d-a3cb-c3e65ddb875e None None] MFA Rules not processed for user `bfcc98fed72143f39a5ed63a7bbce5a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:21.345040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0b5c0d0d-cc12-472d-a3cb-c3e65ddb875e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:21.384727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:21.567602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 941/1879] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:21.586559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1c8fa-35c2-4596-aafd-b14120bdd944 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:21.588750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-47d1c8fa-35c2-4596-aafd-b14120bdd944 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:21.634742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d1c8fa-35c2-4596-aafd-b14120bdd944 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:21.759331 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422575e-8c3c-462d-ae74-a50c8385d987 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:21.760234 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422575e-8c3c-462d-ae74-a50c8385d987 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:21.760648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422575e-8c3c-462d-ae74-a50c8385d987 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:21.761211 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422575e-8c3c-462d-ae74-a50c8385d987 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:21.774624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422575e-8c3c-462d-ae74-a50c8385d987 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:21.776894 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422575e-8c3c-462d-ae74-a50c8385d987 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:21.790885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 939/1880] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:21 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:19:21.822656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c0d0d-cc12-472d-a3cb-c3e65ddb875e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:22.015776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5c0d0d-cc12-472d-a3cb-c3e65ddb875e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:22.023271 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:22.024418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:22.024777 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:22.025121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] PATH_INFO: `/v3/users/bfcc98fed72143f39a5ed63a7bbce5a3` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:22.026683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfcc98fed72143f39a5ed63a7bbce5a3)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:22.030124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:22.180817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfcc98fed72143f39a5ed63a7bbce5a3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:22.225889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfcc98fed72143f39a5ed63a7bbce5a3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:22.226708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfcc98fed72143f39a5ed63a7bbce5a3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:22.227974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfcc98fed72143f39a5ed63a7bbce5a3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:22.252262 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfcc98fed72143f39a5ed63a7bbce5a3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:22.328373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 942/1881] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:21 2022] DELETE /identity/v3/users/bfcc98fed72143f39a5ed63a7bbce5a3 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:22.334235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5245841-6cb3-4f01-998d-ed11a7586b3f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:22.334540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5245841-6cb3-4f01-998d-ed11a7586b3f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:22.334785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5245841-6cb3-4f01-998d-ed11a7586b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:22.402512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e5245841-6cb3-4f01-998d-ed11a7586b3f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:22.418839 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e5245841-6cb3-4f01-998d-ed11a7586b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:22.429433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:22.580652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 940/1882] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:22.602978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:22.604464 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:22.690283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5245841-6cb3-4f01-998d-ed11a7586b3f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:22.693341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e5245841-6cb3-4f01-998d-ed11a7586b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:22.716152 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:22.745337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5245841-6cb3-4f01-998d-ed11a7586b3f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:22.747658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed833f39-cd64-4899-8f45-5b69e0af3007 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:22.752560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21121b9-09a7-4339-9bc8-605c95f64329 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:22.753217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21121b9-09a7-4339-9bc8-605c95f64329 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:22.753497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21121b9-09a7-4339-9bc8-605c95f64329 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:22.753763 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21121b9-09a7-4339-9bc8-605c95f64329 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:22.776234 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:22.776714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:22.777123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:22.777466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] PATH_INFO: `/v3/users/cb233f9cb9af4b7db0c4441a84dd8c16` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:22.780687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb233f9cb9af4b7db0c4441a84dd8c16)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:22.784030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:22.825147 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21121b9-09a7-4339-9bc8-605c95f64329 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:22.826703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21121b9-09a7-4339-9bc8-605c95f64329 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:22.873162 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 943/1883] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:19:22.947626 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb233f9cb9af4b7db0c4441a84dd8c16'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:22.963043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb233f9cb9af4b7db0c4441a84dd8c16'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:22.967366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb233f9cb9af4b7db0c4441a84dd8c16'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:22.968196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb233f9cb9af4b7db0c4441a84dd8c16'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:22.995489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb233f9cb9af4b7db0c4441a84dd8c16'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:23.049222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 941/1884] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:22 2022] DELETE /identity/v3/users/cb233f9cb9af4b7db0c4441a84dd8c16 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:23.054335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76296d2-d3d2-4647-95ad-7ef55328b991 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:23.055097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76296d2-d3d2-4647-95ad-7ef55328b991 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:23.055097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76296d2-d3d2-4647-95ad-7ef55328b991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:23.078732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a76296d2-d3d2-4647-95ad-7ef55328b991 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:23.080089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a76296d2-d3d2-4647-95ad-7ef55328b991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:23.240506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 944/1885] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:23.267242 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:23.270588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:23.400453 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b5db5-b153-476c-97ad-f19c630aa9e1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:23.405342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7845ee9-b57e-4deb-85ab-f0f090fc42be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:23.406491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7845ee9-b57e-4deb-85ab-f0f090fc42be service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:23.406905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7845ee9-b57e-4deb-85ab-f0f090fc42be service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:23.408110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7845ee9-b57e-4deb-85ab-f0f090fc42be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:23.423885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7845ee9-b57e-4deb-85ab-f0f090fc42be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:23.426266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7845ee9-b57e-4deb-85ab-f0f090fc42be service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:23.439688 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 942/1886] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:23.502814 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76296d2-d3d2-4647-95ad-7ef55328b991 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:23.505144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a76296d2-d3d2-4647-95ad-7ef55328b991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:23.521005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76296d2-d3d2-4647-95ad-7ef55328b991 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:23.526145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fc01db-e653-4ad5-b57a-b35469db2b7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:23.527134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc01db-e653-4ad5-b57a-b35469db2b7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:23.527959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc01db-e653-4ad5-b57a-b35469db2b7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:23.528252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fc01db-e653-4ad5-b57a-b35469db2b7a admin admin] PATH_INFO: `/v3/projects/0f388ef6552748f28f23384ec520c976` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:23.530026 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc01db-e653-4ad5-b57a-b35469db2b7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f388ef6552748f28f23384ec520c976)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:23.533519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fc01db-e653-4ad5-b57a-b35469db2b7a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:23.621861 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-56fc01db-e653-4ad5-b57a-b35469db2b7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f388ef6552748f28f23384ec520c976', 'request_id': 'req-56fc01db-e653-4ad5-b57a-b35469db2b7a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:23.635780 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-56fc01db-e653-4ad5-b57a-b35469db2b7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f388ef6552748f28f23384ec520c976', 'request_id': 'req-56fc01db-e653-4ad5-b57a-b35469db2b7a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:23.654561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-56fc01db-e653-4ad5-b57a-b35469db2b7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f388ef6552748f28f23384ec520c976', 'request_id': 'req-56fc01db-e653-4ad5-b57a-b35469db2b7a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:23.677626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-56fc01db-e653-4ad5-b57a-b35469db2b7a admin admin] The token cache is being invalidate because project 0f388ef6552748f28f23384ec520c976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:23.678089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-56fc01db-e653-4ad5-b57a-b35469db2b7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:23.678768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-56fc01db-e653-4ad5-b57a-b35469db2b7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:23.684683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 945/1887] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:23 2022] DELETE /identity/v3/projects/0f388ef6552748f28f23384ec520c976 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:23.685881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0a076-9306-4907-9799-be402126bfde None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:23.686572 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0a076-9306-4907-9799-be402126bfde None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:23.687028 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f0a076-9306-4907-9799-be402126bfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:23.713529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f9f0a076-9306-4907-9799-be402126bfde None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:23.715935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f9f0a076-9306-4907-9799-be402126bfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:23.742944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:23.802383 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 943/1888] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:23.811045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7223ba-ac83-43b3-bf3b-eaac84d7654b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:23.811343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7223ba-ac83-43b3-bf3b-eaac84d7654b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:23.811618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7223ba-ac83-43b3-bf3b-eaac84d7654b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:23.825889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0a076-9306-4907-9799-be402126bfde None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:23.828368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f9f0a076-9306-4907-9799-be402126bfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:23.856335 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f0a076-9306-4907-9799-be402126bfde None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:23.863049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2c7223ba-ac83-43b3-bf3b-eaac84d7654b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:23.864808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2c7223ba-ac83-43b3-bf3b-eaac84d7654b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:23.868290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:23.869535 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:23.870134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:23.870660 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] PATH_INFO: `/v3/projects/3a8a2b34a8a4468ab829bfbad6d7fbe6` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:23.874281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a8a2b34a8a4468ab829bfbad6d7fbe6)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:23.884330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:23.893917 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 946/1889] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:23.895280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7223ba-ac83-43b3-bf3b-eaac84d7654b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:23.918508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7223ba-ac83-43b3-bf3b-eaac84d7654b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:23.926933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811597c3-5917-4459-a161-86efa5661121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:23.927945 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811597c3-5917-4459-a161-86efa5661121 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:23.928463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811597c3-5917-4459-a161-86efa5661121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:23.928946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811597c3-5917-4459-a161-86efa5661121 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:23.929874 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811597c3-5917-4459-a161-86efa5661121 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:23.930409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811597c3-5917-4459-a161-86efa5661121 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:23.932330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811597c3-5917-4459-a161-86efa5661121 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:23.956864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 947/1890] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:23.958531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811597c3-5917-4459-a161-86efa5661121 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:23.978458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811597c3-5917-4459-a161-86efa5661121 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:23.994353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e851ff2-1aac-4a97-8961-e22c1d81a852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:23.998723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e851ff2-1aac-4a97-8961-e22c1d81a852 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:23.999973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e851ff2-1aac-4a97-8961-e22c1d81a852 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:24.001762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e851ff2-1aac-4a97-8961-e22c1d81a852 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:24.008211 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e851ff2-1aac-4a97-8961-e22c1d81a852 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:24.016332 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e851ff2-1aac-4a97-8961-e22c1d81a852 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:24.033605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a8a2b34a8a4468ab829bfbad6d7fbe6', 'request_id': 'req-612c5291-55cf-4132-9f43-daa926c02575'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.042925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a8a2b34a8a4468ab829bfbad6d7fbe6', 'request_id': 'req-612c5291-55cf-4132-9f43-daa926c02575'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.058805 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a8a2b34a8a4468ab829bfbad6d7fbe6', 'request_id': 'req-612c5291-55cf-4132-9f43-daa926c02575'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.077147 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] The token cache is being invalidate because project 3a8a2b34a8a4468ab829bfbad6d7fbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:24.077587 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.078437 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.080350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 944/1891] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:23 2022] DELETE /identity/v3/projects/3a8a2b34a8a4468ab829bfbad6d7fbe6 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:24.084310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:24.086042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:24.123491 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 948/1892] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:23 2022] POST /identity/v3/projects => generated 369 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:24.125695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e851ff2-1aac-4a97-8961-e22c1d81a852 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:24.128868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4e851ff2-1aac-4a97-8961-e22c1d81a852 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:24.195535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:24.218942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612c5291-55cf-4132-9f43-daa926c02575 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:24.321093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e851ff2-1aac-4a97-8961-e22c1d81a852 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:24.335583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eca8f6-d52b-4a8f-bcdb-e1e8c90f9efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:24.336615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eca8f6-d52b-4a8f-bcdb-e1e8c90f9efd admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:24.336998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eca8f6-d52b-4a8f-bcdb-e1e8c90f9efd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:24.337369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48eca8f6-d52b-4a8f-bcdb-e1e8c90f9efd admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:24.338183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eca8f6-d52b-4a8f-bcdb-e1e8c90f9efd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:24.343482 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48eca8f6-d52b-4a8f-bcdb-e1e8c90f9efd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:24.366926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:24.383336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:24.384429 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:24.385134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:24.385999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] PATH_INFO: `/v3/users/5317b897b8ed4a3e9d09870471b0745d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:24.388094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5317b897b8ed4a3e9d09870471b0745d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:24.388914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 949/1893] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:24 2022] POST /identity/v3/users => generated 285 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:24.390646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eca8f6-d52b-4a8f-bcdb-e1e8c90f9efd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:24.392254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:24.395901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-48eca8f6-d52b-4a8f-bcdb-e1e8c90f9efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:24.414871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48eca8f6-d52b-4a8f-bcdb-e1e8c90f9efd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:24.420072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32758d7d-cd40-4653-baae-a50207b73109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:24.420749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758d7d-cd40-4653-baae-a50207b73109 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:24.421029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758d7d-cd40-4653-baae-a50207b73109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:24.421300 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32758d7d-cd40-4653-baae-a50207b73109 admin admin] PATH_INFO: `/v3/users/109127dce14543eda02c3d2c3f08bf0d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:24.422658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32758d7d-cd40-4653-baae-a50207b73109 admin admin] RBAC: Authorizing `identity:delete_user(user_id=109127dce14543eda02c3d2c3f08bf0d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:24.424877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32758d7d-cd40-4653-baae-a50207b73109 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:24.504630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5317b897b8ed4a3e9d09870471b0745d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.515339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-32758d7d-cd40-4653-baae-a50207b73109 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '109127dce14543eda02c3d2c3f08bf0d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.520651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5317b897b8ed4a3e9d09870471b0745d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.521609 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5317b897b8ed4a3e9d09870471b0745d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.523621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5317b897b8ed4a3e9d09870471b0745d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.534541 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5317b897b8ed4a3e9d09870471b0745d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.537210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-32758d7d-cd40-4653-baae-a50207b73109 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '109127dce14543eda02c3d2c3f08bf0d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.537860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-32758d7d-cd40-4653-baae-a50207b73109 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '109127dce14543eda02c3d2c3f08bf0d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.538535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-32758d7d-cd40-4653-baae-a50207b73109 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '109127dce14543eda02c3d2c3f08bf0d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.552209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-32758d7d-cd40-4653-baae-a50207b73109 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '109127dce14543eda02c3d2c3f08bf0d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:24.567524 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 945/1894] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:24 2022] DELETE /identity/v3/users/5317b897b8ed4a3e9d09870471b0745d => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:24.568228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:24.569749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:24.595375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 950/1895] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:24 2022] DELETE /identity/v3/users/109127dce14543eda02c3d2c3f08bf0d => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:24.610366 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5f320-2105-42c3-beb6-8503bdad5c78 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:24.611017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5f320-2105-42c3-beb6-8503bdad5c78 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:24.611296 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc5f320-2105-42c3-beb6-8503bdad5c78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:24.646262 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7bc5f320-2105-42c3-beb6-8503bdad5c78 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:24.651233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7bc5f320-2105-42c3-beb6-8503bdad5c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:24.711275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53960f75-e8ee-46c9-bc40-aa6667112a79 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:24.819328 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 951/1896] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:24.851325 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949fd3a-6f66-4533-aa03-8c212fb4b901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:24.852256 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949fd3a-6f66-4533-aa03-8c212fb4b901 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:24.852575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949fd3a-6f66-4533-aa03-8c212fb4b901 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:24.853231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0949fd3a-6f66-4533-aa03-8c212fb4b901 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:24.855078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949fd3a-6f66-4533-aa03-8c212fb4b901 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:24.857945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0949fd3a-6f66-4533-aa03-8c212fb4b901 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:24.878014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 946/1897] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:24.883026 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5f320-2105-42c3-beb6-8503bdad5c78 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:24.884841 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7bc5f320-2105-42c3-beb6-8503bdad5c78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:24.885366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949fd3a-6f66-4533-aa03-8c212fb4b901 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:24.893279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0949fd3a-6f66-4533-aa03-8c212fb4b901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:24.900832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc5f320-2105-42c3-beb6-8503bdad5c78 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:24.910029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc93dd-13da-4dac-a45b-480c0611f4e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:24.910688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc93dd-13da-4dac-a45b-480c0611f4e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:24.911137 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc93dd-13da-4dac-a45b-480c0611f4e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:24.911489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38bc93dd-13da-4dac-a45b-480c0611f4e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:24.912266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc93dd-13da-4dac-a45b-480c0611f4e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:24.916390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38bc93dd-13da-4dac-a45b-480c0611f4e5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:24.931430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 952/1898] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:24 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:24.935599 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc93dd-13da-4dac-a45b-480c0611f4e5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:24.946480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38bc93dd-13da-4dac-a45b-480c0611f4e5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:24.959456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e82ce681-b1ee-42de-8ea6-ea360456d16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:24.960278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ce681-b1ee-42de-8ea6-ea360456d16d admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:24.960620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ce681-b1ee-42de-8ea6-ea360456d16d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:24.960967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e82ce681-b1ee-42de-8ea6-ea360456d16d admin admin] PATH_INFO: `/v3/projects/d95b323e8023413188f6d3b76657517e/users/d3b413a1f59f4b74ab549dbc7cd18809/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:24.975711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:24.990713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:24.996223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ce681-b1ee-42de-8ea6-ea360456d16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d95b323e8023413188f6d3b76657517e, user_id=d3b413a1f59f4b74ab549dbc7cd18809, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:25.001565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e82ce681-b1ee-42de-8ea6-ea360456d16d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:25.038211 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 953/1899] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:24 2022] PUT /identity/v3/projects/d95b323e8023413188f6d3b76657517e/users/d3b413a1f59f4b74ab549dbc7cd18809/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:25.050669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f22c6d-4a4e-43fc-a73c-68d994bd2306 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:25.051453 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f22c6d-4a4e-43fc-a73c-68d994bd2306 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:25.052163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f22c6d-4a4e-43fc-a73c-68d994bd2306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:25.078978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0949fd3a-6f66-4533-aa03-8c212fb4b901 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:25.103248 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c4f22c6d-4a4e-43fc-a73c-68d994bd2306 None None] MFA Rules not processed for user `d3b413a1f59f4b74ab549dbc7cd18809`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:25.104807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c4f22c6d-4a4e-43fc-a73c-68d994bd2306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:25.163456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735aa76-343b-4190-ad45-cddf63eb2a7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:25.165058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735aa76-343b-4190-ad45-cddf63eb2a7e service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:25.165416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735aa76-343b-4190-ad45-cddf63eb2a7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:25.165753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735aa76-343b-4190-ad45-cddf63eb2a7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:25.290959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 954/1900] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:25 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:19:25.303899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f22c6d-4a4e-43fc-a73c-68d994bd2306 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:25.307125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c4f22c6d-4a4e-43fc-a73c-68d994bd2306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:25.336520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735aa76-343b-4190-ad45-cddf63eb2a7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:25.339972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7735aa76-343b-4190-ad45-cddf63eb2a7e service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:25.375873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 947/1901] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:25.459801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f22c6d-4a4e-43fc-a73c-68d994bd2306 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:25.465517 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0658c430-aa6f-4cc7-8546-69d68c20b1d0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06d8a144ecf43fc8de82346758b6065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:25.467046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c430-aa6f-4cc7-8546-69d68c20b1d0 service glance] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:25.467774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c430-aa6f-4cc7-8546-69d68c20b1d0 service glance] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:25.468288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0658c430-aa6f-4cc7-8546-69d68c20b1d0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:25.480723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658c430-aa6f-4cc7-8546-69d68c20b1d0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:25.482719 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0658c430-aa6f-4cc7-8546-69d68c20b1d0 service glance] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:25.508910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 955/1902] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:25 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:19:25.546398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735aa76-343b-4190-ad45-cddf63eb2a7e service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:25.548178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7735aa76-343b-4190-ad45-cddf63eb2a7e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:25.574045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735aa76-343b-4190-ad45-cddf63eb2a7e service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:25.588312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:25.589747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:25.590295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:25.590773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf admin admin] PATH_INFO: `/v3/projects/5ed70e66b60a4f16a9c9d6e461c4202f` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:25.593236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ed70e66b60a4f16a9c9d6e461c4202f)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:25.597114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:25.727412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ed70e66b60a4f16a9c9d6e461c4202f', 'request_id': 'req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:25.737539 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ed70e66b60a4f16a9c9d6e461c4202f', 'request_id': 'req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:25.750760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ed70e66b60a4f16a9c9d6e461c4202f', 'request_id': 'req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:25.771921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf admin admin] The token cache is being invalidate because project 5ed70e66b60a4f16a9c9d6e461c4202f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:25.772202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:25.772979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-19d0e8c2-8a70-4ecf-8aad-200dfefafebf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:25.775478 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 948/1903] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:25 2022] DELETE /identity/v3/projects/5ed70e66b60a4f16a9c9d6e461c4202f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:25.782837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f95434-0a9d-441f-b6f6-399754a00bc5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:25.783777 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f95434-0a9d-441f-b6f6-399754a00bc5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:25.784619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f95434-0a9d-441f-b6f6-399754a00bc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:25.834907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b2f95434-0a9d-441f-b6f6-399754a00bc5 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:25.836522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b2f95434-0a9d-441f-b6f6-399754a00bc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:25.998112 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 956/1904] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:26.016415 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d809b8-30a7-4baa-a56f-9b0482de1222 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:26.016981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d809b8-30a7-4baa-a56f-9b0482de1222 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:26.017628 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75d809b8-30a7-4baa-a56f-9b0482de1222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:26.058847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:26.084045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-75d809b8-30a7-4baa-a56f-9b0482de1222 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:26.086587 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-75d809b8-30a7-4baa-a56f-9b0482de1222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:26.131121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 949/1905] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:26.132587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f95434-0a9d-441f-b6f6-399754a00bc5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:26.202634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f95434-0a9d-441f-b6f6-399754a00bc5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:26.215182 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c42275-7d75-463d-8eda-d8f3c0660737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:26.217025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c42275-7d75-463d-8eda-d8f3c0660737 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:26.217633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c42275-7d75-463d-8eda-d8f3c0660737 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:26.218209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c42275-7d75-463d-8eda-d8f3c0660737 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:26.219153 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c42275-7d75-463d-8eda-d8f3c0660737 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:26.220800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c42275-7d75-463d-8eda-d8f3c0660737 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:26.225962 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c42275-7d75-463d-8eda-d8f3c0660737 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:26.244193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 957/1906] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:26.250295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d809b8-30a7-4baa-a56f-9b0482de1222 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:26.266060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75d809b8-30a7-4baa-a56f-9b0482de1222 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:26.283376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac1ab7-01de-47dd-9f52-8cce5f8d4232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:26.284082 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac1ab7-01de-47dd-9f52-8cce5f8d4232 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:26.284359 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac1ab7-01de-47dd-9f52-8cce5f8d4232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:26.286001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ac1ab7-01de-47dd-9f52-8cce5f8d4232 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:26.288993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac1ab7-01de-47dd-9f52-8cce5f8d4232 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:26.293901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ac1ab7-01de-47dd-9f52-8cce5f8d4232 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:26.400685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 950/1907] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:26 2022] POST /identity/v3/projects => generated 383 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:26.404695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c42275-7d75-463d-8eda-d8f3c0660737 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:26.426006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c42275-7d75-463d-8eda-d8f3c0660737 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:26.432586 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:26.568790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741c942-3f21-4f01-add9-12ca8216811d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:26.569673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741c942-3f21-4f01-add9-12ca8216811d admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:26.570331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741c942-3f21-4f01-add9-12ca8216811d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:26.570748 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741c942-3f21-4f01-add9-12ca8216811d admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:26.571732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741c942-3f21-4f01-add9-12ca8216811d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:26.574221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741c942-3f21-4f01-add9-12ca8216811d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:26.628848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 958/1908] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:26 2022] POST /identity/v3/users => generated 292 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:26.635280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac1ab7-01de-47dd-9f52-8cce5f8d4232 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:26.657463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ac1ab7-01de-47dd-9f52-8cce5f8d4232 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:26.666185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494659f-3a7b-4bc9-a846-a119476e35b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:26.666185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494659f-3a7b-4bc9-a846-a119476e35b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:26.666185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494659f-3a7b-4bc9-a846-a119476e35b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:26.666754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9494659f-3a7b-4bc9-a846-a119476e35b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:26.667138 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494659f-3a7b-4bc9-a846-a119476e35b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:26.669070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9494659f-3a7b-4bc9-a846-a119476e35b9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:26.688563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 951/1909] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:26.693144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741c942-3f21-4f01-add9-12ca8216811d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:26.710997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741c942-3f21-4f01-add9-12ca8216811d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:26.719831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2481215-1963-4e3d-9307-92aa6d23f94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:26.722057 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2481215-1963-4e3d-9307-92aa6d23f94a admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:26.722577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2481215-1963-4e3d-9307-92aa6d23f94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:26.722927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2481215-1963-4e3d-9307-92aa6d23f94a admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:26.724559 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2481215-1963-4e3d-9307-92aa6d23f94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:26.725683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2481215-1963-4e3d-9307-92aa6d23f94a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:26.748567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494659f-3a7b-4bc9-a846-a119476e35b9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:26.749877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 959/1910] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:26 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:26.760043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9494659f-3a7b-4bc9-a846-a119476e35b9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:26.764980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff195b09-f92e-4fc0-91c2-b550f3e7e9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:26.765748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff195b09-f92e-4fc0-91c2-b550f3e7e9e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:26.766067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff195b09-f92e-4fc0-91c2-b550f3e7e9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:26.766345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff195b09-f92e-4fc0-91c2-b550f3e7e9e1 admin admin] PATH_INFO: `/v3/projects/1208a133d31348b08d8100590992ac4b/users/e6de3fa7d93a410bb6d3e3b2f193cbfa/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:26.808611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff195b09-f92e-4fc0-91c2-b550f3e7e9e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1208a133d31348b08d8100590992ac4b, user_id=e6de3fa7d93a410bb6d3e3b2f193cbfa, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:26.812189 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff195b09-f92e-4fc0-91c2-b550f3e7e9e1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:26.871399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 952/1911] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:26 2022] PUT /identity/v3/projects/1208a133d31348b08d8100590992ac4b/users/e6de3fa7d93a410bb6d3e3b2f193cbfa/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:26.890180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50674b-cc88-4d5a-9d8d-ceb2676d184a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:26.890512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50674b-cc88-4d5a-9d8d-ceb2676d184a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:26.890726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec50674b-cc88-4d5a-9d8d-ceb2676d184a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:26.968598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ec50674b-cc88-4d5a-9d8d-ceb2676d184a None None] MFA Rules not processed for user `e6de3fa7d93a410bb6d3e3b2f193cbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:26.972119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ec50674b-cc88-4d5a-9d8d-ceb2676d184a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:26.980185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff195b09-f92e-4fc0-91c2-b550f3e7e9e1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:26.982125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ff195b09-f92e-4fc0-91c2-b550f3e7e9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:27.140214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 960/1912] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:27.145213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50674b-cc88-4d5a-9d8d-ceb2676d184a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:27.157768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff195b09-f92e-4fc0-91c2-b550f3e7e9e1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:27.171729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:27.172485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:27.172681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:27.172946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef admin admin] PATH_INFO: `/v3/projects/72c2d9a5e45445f4b317c1eb5305c7f5` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:27.174967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec50674b-cc88-4d5a-9d8d-ceb2676d184a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:27.178407 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=72c2d9a5e45445f4b317c1eb5305c7f5)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:27.181576 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:27.197446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c24f53-43bf-4fe9-9731-83ed7a9c2570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:27.198139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c24f53-43bf-4fe9-9731-83ed7a9c2570 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:27.198422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c24f53-43bf-4fe9-9731-83ed7a9c2570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:27.199181 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c24f53-43bf-4fe9-9731-83ed7a9c2570 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:27.199893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c24f53-43bf-4fe9-9731-83ed7a9c2570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:27.202743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c24f53-43bf-4fe9-9731-83ed7a9c2570 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:27.309456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 961/1913] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:27 2022] POST /identity/v3/projects => generated 381 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:27.316787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c24f53-43bf-4fe9-9731-83ed7a9c2570 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:27.331416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72c2d9a5e45445f4b317c1eb5305c7f5', 'request_id': 'req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:27.353094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72c2d9a5e45445f4b317c1eb5305c7f5', 'request_id': 'req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:27.374336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72c2d9a5e45445f4b317c1eb5305c7f5', 'request_id': 'req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:27.408926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef admin admin] The token cache is being invalidate because project 72c2d9a5e45445f4b317c1eb5305c7f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:27.411427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:27.414764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fd4bc81a-ac3f-4bea-bb45-47f4e19034ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:27.427859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 953/1914] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:26 2022] DELETE /identity/v3/projects/72c2d9a5e45445f4b317c1eb5305c7f5 => generated 0 bytes in 444 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:27.431485 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a89d7-337b-4266-bc1a-29533b19bbdb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:27.431885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a89d7-337b-4266-bc1a-29533b19bbdb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:27.432191 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9a89d7-337b-4266-bc1a-29533b19bbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:27.475233 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-cc9a89d7-337b-4266-bc1a-29533b19bbdb None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:27.479035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cc9a89d7-337b-4266-bc1a-29533b19bbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:27.502541 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:27.553213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c24f53-43bf-4fe9-9731-83ed7a9c2570 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:27.567177 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca7f55-b719-45f0-9eb1-3f57c2238c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:27.568030 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca7f55-b719-45f0-9eb1-3f57c2238c16 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:27.568480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca7f55-b719-45f0-9eb1-3f57c2238c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:27.568889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cca7f55-b719-45f0-9eb1-3f57c2238c16 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:27.569768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca7f55-b719-45f0-9eb1-3f57c2238c16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:27.572103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cca7f55-b719-45f0-9eb1-3f57c2238c16 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:27.597911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:27.626676 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 962/1915] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:27 2022] POST /identity/v3/users => generated 291 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:27.630896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca7f55-b719-45f0-9eb1-3f57c2238c16 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:27.633323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2cca7f55-b719-45f0-9eb1-3f57c2238c16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:27.656063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cca7f55-b719-45f0-9eb1-3f57c2238c16 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:27.662947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cffb4-0288-40a4-a175-bf8a517fdaac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:27.663778 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cffb4-0288-40a4-a175-bf8a517fdaac admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:27.664198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cffb4-0288-40a4-a175-bf8a517fdaac admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:27.664606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6cffb4-0288-40a4-a175-bf8a517fdaac admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:27.665427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6cffb4-0288-40a4-a175-bf8a517fdaac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:27.668957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6cffb4-0288-40a4-a175-bf8a517fdaac admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:27.689248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 954/1916] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:19:27.699982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152e36-c60a-483b-994d-2f3952dc0618 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:27.701005 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152e36-c60a-483b-994d-2f3952dc0618 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:27.701904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4152e36-c60a-483b-994d-2f3952dc0618 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:27.720279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 963/1917] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:27.725389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cffb4-0288-40a4-a175-bf8a517fdaac admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:27.740500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a4152e36-c60a-483b-994d-2f3952dc0618 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:27.743999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a4152e36-c60a-483b-994d-2f3952dc0618 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:27.749770 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6cffb4-0288-40a4-a175-bf8a517fdaac admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:27.766114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 955/1918] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:27.770034 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d9eb9-437e-4176-868b-38dea1e9e61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:27.770857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152e36-c60a-483b-994d-2f3952dc0618 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:27.772641 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9eb9-437e-4176-868b-38dea1e9e61a admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:27.775045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9eb9-437e-4176-868b-38dea1e9e61a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:27.775470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d9eb9-437e-4176-868b-38dea1e9e61a admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:27.776267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d9eb9-437e-4176-868b-38dea1e9e61a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:27.780282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976d9eb9-437e-4176-868b-38dea1e9e61a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:27.792027 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4152e36-c60a-483b-994d-2f3952dc0618 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:27.805882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 964/1919] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:27 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:27.806173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40f489-3147-41a6-979a-0c4346d12253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:27.806723 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40f489-3147-41a6-979a-0c4346d12253 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:27.807806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d9eb9-437e-4176-868b-38dea1e9e61a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:27.808131 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40f489-3147-41a6-979a-0c4346d12253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:27.808907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec40f489-3147-41a6-979a-0c4346d12253 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:27.810225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40f489-3147-41a6-979a-0c4346d12253 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:27.810895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40f489-3147-41a6-979a-0c4346d12253 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:27.817543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec40f489-3147-41a6-979a-0c4346d12253 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:27.821993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d9eb9-437e-4176-868b-38dea1e9e61a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:27.840843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 956/1920] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:27.841117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b073b714-348d-4eda-b2f0-3c0257557796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:27.841117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073b714-348d-4eda-b2f0-3c0257557796 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:27.841117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073b714-348d-4eda-b2f0-3c0257557796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:27.841628 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b073b714-348d-4eda-b2f0-3c0257557796 admin admin] PATH_INFO: `/v3/projects/68f3de332d674c30a60722bff530855f/users/7641aa28d2914c84bdbdfe8d52ad7f8a/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:27.853178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40f489-3147-41a6-979a-0c4346d12253 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:27.875558 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073b714-348d-4eda-b2f0-3c0257557796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f3de332d674c30a60722bff530855f, user_id=7641aa28d2914c84bdbdfe8d52ad7f8a, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:27.878409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b073b714-348d-4eda-b2f0-3c0257557796 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:27.886525 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec40f489-3147-41a6-979a-0c4346d12253 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:27.894269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff102e-977d-4af0-bcc8-d853f4e7ef5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:27.895211 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff102e-977d-4af0-bcc8-d853f4e7ef5c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:27.895497 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff102e-977d-4af0-bcc8-d853f4e7ef5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:27.895767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ff102e-977d-4af0-bcc8-d853f4e7ef5c admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:27.896410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff102e-977d-4af0-bcc8-d853f4e7ef5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:27.900166 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ff102e-977d-4af0-bcc8-d853f4e7ef5c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:27.928875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 965/1921] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:27 2022] PUT /identity/v3/projects/68f3de332d674c30a60722bff530855f/users/7641aa28d2914c84bdbdfe8d52ad7f8a/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:27.947695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd65cc-ed82-4cde-96f4-0828aa7a1897 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:27.947902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd65cc-ed82-4cde-96f4-0828aa7a1897 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:27.951437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fd65cc-ed82-4cde-96f4-0828aa7a1897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:27.958979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 957/1922] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:27 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:27.958979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff102e-977d-4af0-bcc8-d853f4e7ef5c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:28.006957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-07fd65cc-ed82-4cde-96f4-0828aa7a1897 None None] MFA Rules not processed for user `7641aa28d2914c84bdbdfe8d52ad7f8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:28.008386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-07fd65cc-ed82-4cde-96f4-0828aa7a1897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:28.087945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ff102e-977d-4af0-bcc8-d853f4e7ef5c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:28.094490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bd36e-2cfd-4050-8c6b-c197b47cad43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:28.095652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bd36e-2cfd-4050-8c6b-c197b47cad43 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:28.095652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bd36e-2cfd-4050-8c6b-c197b47cad43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:28.096104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bd36e-2cfd-4050-8c6b-c197b47cad43 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:28.096861 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bd36e-2cfd-4050-8c6b-c197b47cad43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:28.099072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bd36e-2cfd-4050-8c6b-c197b47cad43 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:28.130132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 966/1923] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:27 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:28.132475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 958/1924] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:27 2022] POST /identity/v3/users => generated 288 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:28.134662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd65cc-ed82-4cde-96f4-0828aa7a1897 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:28.137766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bd36e-2cfd-4050-8c6b-c197b47cad43 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:28.146472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fd65cc-ed82-4cde-96f4-0828aa7a1897 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:28.152457 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86febf-7838-4897-900f-3ec00011f157 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:28.153088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86febf-7838-4897-900f-3ec00011f157 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:28.153374 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86febf-7838-4897-900f-3ec00011f157 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:28.153754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f86febf-7838-4897-900f-3ec00011f157 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:28.154377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86febf-7838-4897-900f-3ec00011f157 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:28.156437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f86febf-7838-4897-900f-3ec00011f157 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:28.158782 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bd36e-2cfd-4050-8c6b-c197b47cad43 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:28.167411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d76c0-9086-4cde-9372-6b30614291ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:28.168633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d76c0-9086-4cde-9372-6b30614291ab admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:28.169019 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d76c0-9086-4cde-9372-6b30614291ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:28.169585 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949d76c0-9086-4cde-9372-6b30614291ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:28.170839 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d76c0-9086-4cde-9372-6b30614291ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:28.174175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949d76c0-9086-4cde-9372-6b30614291ab admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:28.192608 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 967/1925] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:28 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:19:28.196363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86febf-7838-4897-900f-3ec00011f157 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:28.196687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 959/1926] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:28.200588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d76c0-9086-4cde-9372-6b30614291ab admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:28.220461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949d76c0-9086-4cde-9372-6b30614291ab admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:28.309823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a009d-5e30-4b14-8120-3790f488957e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:28.311932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a009d-5e30-4b14-8120-3790f488957e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:28.313220 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a009d-5e30-4b14-8120-3790f488957e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:28.315120 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4a009d-5e30-4b14-8120-3790f488957e admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:28.317761 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a009d-5e30-4b14-8120-3790f488957e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:28.321843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4a009d-5e30-4b14-8120-3790f488957e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:28.337910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f86febf-7838-4897-900f-3ec00011f157 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:28.340519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 960/1927] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:28.349007 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a009d-5e30-4b14-8120-3790f488957e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:28.353358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df6256-73ed-4328-897e-ecdcaf359bdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:28.354172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df6256-73ed-4328-897e-ecdcaf359bdf admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:28.354593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df6256-73ed-4328-897e-ecdcaf359bdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:28.354969 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df6256-73ed-4328-897e-ecdcaf359bdf admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:28.355959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df6256-73ed-4328-897e-ecdcaf359bdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:28.359285 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df6256-73ed-4328-897e-ecdcaf359bdf admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:28.378517 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:28.415551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4a009d-5e30-4b14-8120-3790f488957e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:28.415551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb59cc-84f4-4461-86d4-c1fcb35b75e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:28.416410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 968/1928] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:28 2022] POST /identity/v3/users => generated 299 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:19:28.416668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb59cc-84f4-4461-86d4-c1fcb35b75e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:28.416668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb59cc-84f4-4461-86d4-c1fcb35b75e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:28.416668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb59cc-84f4-4461-86d4-c1fcb35b75e5 admin admin] PATH_INFO: `/v3/projects/688a2c5a1d22412ebd6fe5d2e9878363/users/654ff3e90ef945fdb28580792852d6b3/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:28.416908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df6256-73ed-4328-897e-ecdcaf359bdf admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:28.425208 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:28.442548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df6256-73ed-4328-897e-ecdcaf359bdf admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:28.451892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb59cc-84f4-4461-86d4-c1fcb35b75e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=688a2c5a1d22412ebd6fe5d2e9878363, user_id=654ff3e90ef945fdb28580792852d6b3, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:28.456773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51eb59cc-84f4-4461-86d4-c1fcb35b75e5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:28.471705 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f511b-3eef-4aea-8527-2e5efd7ca126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:28.474686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f511b-3eef-4aea-8527-2e5efd7ca126 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:28.478106 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f511b-3eef-4aea-8527-2e5efd7ca126 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:28.478802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b5f511b-3eef-4aea-8527-2e5efd7ca126 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:28.480976 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f511b-3eef-4aea-8527-2e5efd7ca126 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:28.484862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b5f511b-3eef-4aea-8527-2e5efd7ca126 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:28.493103 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 961/1929] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:28 2022] PUT /identity/v3/projects/688a2c5a1d22412ebd6fe5d2e9878363/users/654ff3e90ef945fdb28580792852d6b3/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:28.507495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619e440-9dd0-4dc2-8ea1-542df865eaa8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:28.507779 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619e440-9dd0-4dc2-8ea1-542df865eaa8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:28.508125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0619e440-9dd0-4dc2-8ea1-542df865eaa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:28.519104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 969/1930] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:19:28.523773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f511b-3eef-4aea-8527-2e5efd7ca126 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:28.544613 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b5f511b-3eef-4aea-8527-2e5efd7ca126 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:28.596081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0619e440-9dd0-4dc2-8ea1-542df865eaa8 None None] MFA Rules not processed for user `654ff3e90ef945fdb28580792852d6b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:28.597133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0619e440-9dd0-4dc2-8ea1-542df865eaa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:28.674914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b8db3-043f-4ad9-844b-257f0652b4de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:28.681887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b8db3-043f-4ad9-844b-257f0652b4de admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:28.682156 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b8db3-043f-4ad9-844b-257f0652b4de admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:28.683288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034b8db3-043f-4ad9-844b-257f0652b4de admin admin] PATH_INFO: `/v3/projects/1db4d79277d44d80a2cb591993c07b3d/users/f304d93232604084b0620c82efea272e/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:28.734447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b8db3-043f-4ad9-844b-257f0652b4de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db4d79277d44d80a2cb591993c07b3d, user_id=f304d93232604084b0620c82efea272e, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:28.738312 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034b8db3-043f-4ad9-844b-257f0652b4de admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:28.742970 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 962/1931] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:19:28.750657 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619e440-9dd0-4dc2-8ea1-542df865eaa8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:28.771298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 970/1932] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:28 2022] PUT /identity/v3/projects/1db4d79277d44d80a2cb591993c07b3d/users/f304d93232604084b0620c82efea272e/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:28.777456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b8db3-043f-4ad9-844b-257f0652b4de admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:28.799317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0619e440-9dd0-4dc2-8ea1-542df865eaa8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:28.901458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034b8db3-043f-4ad9-844b-257f0652b4de admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:28.911700 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56be7e-d18d-4ee2-958c-4c10b0d2346d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:28.912909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56be7e-d18d-4ee2-958c-4c10b0d2346d admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:28.913437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56be7e-d18d-4ee2-958c-4c10b0d2346d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:28.914124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d56be7e-d18d-4ee2-958c-4c10b0d2346d admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:28.915940 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56be7e-d18d-4ee2-958c-4c10b0d2346d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:28.920184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d56be7e-d18d-4ee2-958c-4c10b0d2346d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:28.931910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f3f93-18d5-4dff-8476-2eb2069d2315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:28.932821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f3f93-18d5-4dff-8476-2eb2069d2315 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:28.933464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f3f93-18d5-4dff-8476-2eb2069d2315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:28.933923 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357f3f93-18d5-4dff-8476-2eb2069d2315 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:28.936165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f3f93-18d5-4dff-8476-2eb2069d2315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:28.945952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357f3f93-18d5-4dff-8476-2eb2069d2315 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:28.948838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 971/1933] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:28 2022] GET /identity/v3/roles => generated 1420 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:28.954311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56be7e-d18d-4ee2-958c-4c10b0d2346d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:28.983117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d56be7e-d18d-4ee2-958c-4c10b0d2346d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:29.003996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9e01ce-c6ae-4770-affe-0211a39be17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:29.004753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e01ce-c6ae-4770-affe-0211a39be17f admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:29.005040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e01ce-c6ae-4770-affe-0211a39be17f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:29.005319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9e01ce-c6ae-4770-affe-0211a39be17f admin admin] PATH_INFO: `/v3/projects/1db4d79277d44d80a2cb591993c07b3d/users/f304d93232604084b0620c82efea272e/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:29.009200 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e01ce-c6ae-4770-affe-0211a39be17f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1db4d79277d44d80a2cb591993c07b3d, user_id=f304d93232604084b0620c82efea272e, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:29.012903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9e01ce-c6ae-4770-affe-0211a39be17f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:29.022950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 963/1934] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:28 2022] POST /identity/v3/projects => generated 373 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:29.027385 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f3f93-18d5-4dff-8476-2eb2069d2315 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:29.050193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 972/1935] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:28 2022] PUT /identity/v3/projects/1db4d79277d44d80a2cb591993c07b3d/users/f304d93232604084b0620c82efea272e/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:29.061330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e7c59-89db-4389-a333-406553977dcd None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:29.061616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e7c59-89db-4389-a333-406553977dcd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:29.061935 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601e7c59-89db-4389-a333-406553977dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:29.124089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-601e7c59-89db-4389-a333-406553977dcd None None] MFA Rules not processed for user `f304d93232604084b0620c82efea272e`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:29.126680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-601e7c59-89db-4389-a333-406553977dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:29.206018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:29.262587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 973/1936] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:29 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:29.281238 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:29.286801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357f3f93-18d5-4dff-8476-2eb2069d2315 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:29.287428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e7c59-89db-4389-a333-406553977dcd None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:29.289084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-601e7c59-89db-4389-a333-406553977dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:29.410283 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601e7c59-89db-4389-a333-406553977dcd None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:29.424725 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58a555-6d71-4c3c-bac7-a2de2bc1b0a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:29.427501 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a555-6d71-4c3c-bac7-a2de2bc1b0a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:29.427975 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a555-6d71-4c3c-bac7-a2de2bc1b0a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:29.428395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca58a555-6d71-4c3c-bac7-a2de2bc1b0a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:29.433812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ca58a555-6d71-4c3c-bac7-a2de2bc1b0a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:29.485019 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e2016-31e6-4852-8df9-d17088b96a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:29.485712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e2016-31e6-4852-8df9-d17088b96a20 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:29.486031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e2016-31e6-4852-8df9-d17088b96a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:29.486301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3e2016-31e6-4852-8df9-d17088b96a20 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:29.486941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e2016-31e6-4852-8df9-d17088b96a20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:29.489125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3e2016-31e6-4852-8df9-d17088b96a20 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:29.527097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 964/1937] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:29 2022] POST /identity/v3/users => generated 293 bytes in 501 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:29.531323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e2016-31e6-4852-8df9-d17088b96a20 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:29.540993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58a555-6d71-4c3c-bac7-a2de2bc1b0a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:29.544035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca58a555-6d71-4c3c-bac7-a2de2bc1b0a1 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:29.547757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3e2016-31e6-4852-8df9-d17088b96a20 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:29.553136 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788536b-407e-4a37-8dbd-4b8831276125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:29.554068 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788536b-407e-4a37-8dbd-4b8831276125 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:29.554798 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788536b-407e-4a37-8dbd-4b8831276125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:29.555315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2788536b-407e-4a37-8dbd-4b8831276125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:29.556205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788536b-407e-4a37-8dbd-4b8831276125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:29.558054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2788536b-407e-4a37-8dbd-4b8831276125 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:29.566889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 974/1938] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:29.577101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 965/1939] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:29.581988 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58a555-6d71-4c3c-bac7-a2de2bc1b0a1 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:29.598741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca58a555-6d71-4c3c-bac7-a2de2bc1b0a1 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:29.606918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a5f9f-b35a-43f6-a8db-7f3ea531e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:29.607762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a5f9f-b35a-43f6-a8db-7f3ea531e3db admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:29.608111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a5f9f-b35a-43f6-a8db-7f3ea531e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:29.608351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a5f9f-b35a-43f6-a8db-7f3ea531e3db admin admin] PATH_INFO: `/v3/projects/3991f5dc876144e88efff3146467ad33/users/2e5999eb6e294479aa3704d048237902/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:29.634144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a5f9f-b35a-43f6-a8db-7f3ea531e3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=3991f5dc876144e88efff3146467ad33, user_id=2e5999eb6e294479aa3704d048237902, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:29.637862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a5f9f-b35a-43f6-a8db-7f3ea531e3db admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:29.659024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 975/1940] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:29 2022] PUT /identity/v3/projects/3991f5dc876144e88efff3146467ad33/users/2e5999eb6e294479aa3704d048237902/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:29.663523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788536b-407e-4a37-8dbd-4b8831276125 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:29.680455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2788536b-407e-4a37-8dbd-4b8831276125 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:29.787829 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395d61fe-686b-4a0c-9be0-2209a17bd586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:29.789005 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d61fe-686b-4a0c-9be0-2209a17bd586 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:29.789925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d61fe-686b-4a0c-9be0-2209a17bd586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:29.790660 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395d61fe-686b-4a0c-9be0-2209a17bd586 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:29.792102 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d61fe-686b-4a0c-9be0-2209a17bd586 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:29.795384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-395d61fe-686b-4a0c-9be0-2209a17bd586 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:29.819531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 966/1941] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:29 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:29.825442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a5f9f-b35a-43f6-a8db-7f3ea531e3db admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:29.846182 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a5f9f-b35a-43f6-a8db-7f3ea531e3db admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:29.852279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98eff7-f370-4157-a963-f990d757b7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:29.853103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98eff7-f370-4157-a963-f990d757b7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:29.853757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98eff7-f370-4157-a963-f990d757b7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:29.854150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff98eff7-f370-4157-a963-f990d757b7cd admin admin] PATH_INFO: `/v3/projects/3991f5dc876144e88efff3146467ad33/users/2e5999eb6e294479aa3704d048237902/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:29.856349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98eff7-f370-4157-a963-f990d757b7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3991f5dc876144e88efff3146467ad33, user_id=2e5999eb6e294479aa3704d048237902, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:29.859603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff98eff7-f370-4157-a963-f990d757b7cd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:29.883999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 976/1942] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:29 2022] PUT /identity/v3/projects/3991f5dc876144e88efff3146467ad33/users/2e5999eb6e294479aa3704d048237902/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:29.890518 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127076e-e8f7-4528-a8b3-28fc21975dac None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:29.891004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127076e-e8f7-4528-a8b3-28fc21975dac None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:29.891470 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d127076e-e8f7-4528-a8b3-28fc21975dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:29.928901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d127076e-e8f7-4528-a8b3-28fc21975dac None None] MFA Rules not processed for user `2e5999eb6e294479aa3704d048237902`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:29.933944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d127076e-e8f7-4528-a8b3-28fc21975dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:30.070362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 967/1943] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:29 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:30.085040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98eff7-f370-4157-a963-f990d757b7cd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:30.172145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff98eff7-f370-4157-a963-f990d757b7cd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:30.177473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a842a7-f494-4cb0-b566-8535bdbaafff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:30.178592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a842a7-f494-4cb0-b566-8535bdbaafff service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:30.179037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a842a7-f494-4cb0-b566-8535bdbaafff service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:30.179417 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a842a7-f494-4cb0-b566-8535bdbaafff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:30.185689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:30.269159 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a842a7-f494-4cb0-b566-8535bdbaafff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:30.270976 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a842a7-f494-4cb0-b566-8535bdbaafff service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:30.282654 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 977/1944] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:31.323368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127076e-e8f7-4528-a8b3-28fc21975dac None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:31.326843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d127076e-e8f7-4528-a8b3-28fc21975dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:31.342376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:31.347339 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d127076e-e8f7-4528-a8b3-28fc21975dac None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:31.353420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e18bf3-9667-4e84-a715-ef02972cd487 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:31.354416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e18bf3-9667-4e84-a715-ef02972cd487 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:31.354758 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e18bf3-9667-4e84-a715-ef02972cd487 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:31.354947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e18bf3-9667-4e84-a715-ef02972cd487 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:31.451586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e18bf3-9667-4e84-a715-ef02972cd487 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:31.453381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e18bf3-9667-4e84-a715-ef02972cd487 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:31.466372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 968/1945] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:31 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:32.440528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a842a7-f494-4cb0-b566-8535bdbaafff service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:32.440528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a842a7-f494-4cb0-b566-8535bdbaafff service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:32.458876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aee25b-0ba6-461d-beee-3230de4073bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:32.460297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aee25b-0ba6-461d-beee-3230de4073bb service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:32.461040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aee25b-0ba6-461d-beee-3230de4073bb service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:32.461725 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aee25b-0ba6-461d-beee-3230de4073bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:32.570154 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aee25b-0ba6-461d-beee-3230de4073bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:32.571627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7aee25b-0ba6-461d-beee-3230de4073bb service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:32.593527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 978/1946] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:32 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:33.216678 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e18bf3-9667-4e84-a715-ef02972cd487 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:33.322842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e18bf3-9667-4e84-a715-ef02972cd487 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:33.332278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:33.332515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:33.332686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:33.332952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] PATH_INFO: `/v3/users/654ff3e90ef945fdb28580792852d6b3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:33.337175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=654ff3e90ef945fdb28580792852d6b3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:33.340436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:33.414923 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '654ff3e90ef945fdb28580792852d6b3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:33.425205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '654ff3e90ef945fdb28580792852d6b3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:33.426178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '654ff3e90ef945fdb28580792852d6b3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:33.427070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '654ff3e90ef945fdb28580792852d6b3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:33.437855 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '654ff3e90ef945fdb28580792852d6b3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:33.467492 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 969/1947] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:33 2022] DELETE /identity/v3/users/654ff3e90ef945fdb28580792852d6b3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:33.481074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd167ba-d8d1-4fd3-8de6-3eb3c29ab0e0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:33.481917 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd167ba-d8d1-4fd3-8de6-3eb3c29ab0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:33.481917 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd167ba-d8d1-4fd3-8de6-3eb3c29ab0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:33.507055 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6fd167ba-d8d1-4fd3-8de6-3eb3c29ab0e0 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:33.508376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6fd167ba-d8d1-4fd3-8de6-3eb3c29ab0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:33.599657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 979/1948] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:19:33.615901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:33.617563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:33.663670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:33.698422 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626612ff-8312-47d5-b681-478e5318d6c2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:33.702397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812b349-bd01-4e65-9b8a-62184baf51f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:33.703026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812b349-bd01-4e65-9b8a-62184baf51f7 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:33.703302 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812b349-bd01-4e65-9b8a-62184baf51f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:33.703573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5812b349-bd01-4e65-9b8a-62184baf51f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:33.714251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812b349-bd01-4e65-9b8a-62184baf51f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:33.715739 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5812b349-bd01-4e65-9b8a-62184baf51f7 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:33.727135 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 970/1949] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:34.109906 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd167ba-d8d1-4fd3-8de6-3eb3c29ab0e0 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:34.112695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6fd167ba-d8d1-4fd3-8de6-3eb3c29ab0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:34.127487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd167ba-d8d1-4fd3-8de6-3eb3c29ab0e0 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:34.132403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:34.133210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:34.133491 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:34.133762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] PATH_INFO: `/v3/projects/688a2c5a1d22412ebd6fe5d2e9878363` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:34.135084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] RBAC: Authorizing `identity:delete_project(project_id=688a2c5a1d22412ebd6fe5d2e9878363)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:34.137403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:34.265837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:34.270387 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '688a2c5a1d22412ebd6fe5d2e9878363', 'request_id': 'req-1bfa893e-5380-4b65-935e-647199ce768f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:34.278687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '688a2c5a1d22412ebd6fe5d2e9878363', 'request_id': 'req-1bfa893e-5380-4b65-935e-647199ce768f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:34.289546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '688a2c5a1d22412ebd6fe5d2e9878363', 'request_id': 'req-1bfa893e-5380-4b65-935e-647199ce768f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:34.305297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] The token cache is being invalidate because project 688a2c5a1d22412ebd6fe5d2e9878363 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:34.305601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:34.307005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:34.309616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 980/1950] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:34 2022] DELETE /identity/v3/projects/688a2c5a1d22412ebd6fe5d2e9878363 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:34.313529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812b349-bd01-4e65-9b8a-62184baf51f7 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:34.324197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5812b349-bd01-4e65-9b8a-62184baf51f7 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:34.411696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d15709-e110-4ebd-bbba-db9dc449c741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:34.412696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15709-e110-4ebd-bbba-db9dc449c741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:34.412993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15709-e110-4ebd-bbba-db9dc449c741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:34.413321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d15709-e110-4ebd-bbba-db9dc449c741 admin admin] PATH_INFO: `/v3/users/2e5999eb6e294479aa3704d048237902` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:34.414806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d15709-e110-4ebd-bbba-db9dc449c741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e5999eb6e294479aa3704d048237902)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:34.417072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d15709-e110-4ebd-bbba-db9dc449c741 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:34.508341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e3d15709-e110-4ebd-bbba-db9dc449c741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e5999eb6e294479aa3704d048237902'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:34.521278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e3d15709-e110-4ebd-bbba-db9dc449c741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e5999eb6e294479aa3704d048237902'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:34.522400 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e3d15709-e110-4ebd-bbba-db9dc449c741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e5999eb6e294479aa3704d048237902'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:34.523386 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e3d15709-e110-4ebd-bbba-db9dc449c741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e5999eb6e294479aa3704d048237902'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:34.540113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-e3d15709-e110-4ebd-bbba-db9dc449c741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e5999eb6e294479aa3704d048237902'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:34.569946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 971/1951] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:34 2022] DELETE /identity/v3/users/2e5999eb6e294479aa3704d048237902 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:35.135456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:35.137073 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:35.159305 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfa893e-5380-4b65-935e-647199ce768f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:35.241815 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:35.242501 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:35.242843 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:35.243255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a admin admin] PATH_INFO: `/v3/projects/3991f5dc876144e88efff3146467ad33` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:35.244500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3991f5dc876144e88efff3146467ad33)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:35.246631 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:35.407010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3991f5dc876144e88efff3146467ad33', 'request_id': 'req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:35.422237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3991f5dc876144e88efff3146467ad33', 'request_id': 'req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:35.433641 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3991f5dc876144e88efff3146467ad33', 'request_id': 'req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:35.450887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a admin admin] The token cache is being invalidate because project 3991f5dc876144e88efff3146467ad33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:35.451243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:35.451987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ac01271f-e281-41ae-b8f4-fe2490eb0f3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:35.453896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 981/1952] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:35 2022] DELETE /identity/v3/projects/3991f5dc876144e88efff3146467ad33 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:35.460392 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06332475-6172-4649-9025-bef2f63819f8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:35.461143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06332475-6172-4649-9025-bef2f63819f8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:35.461143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06332475-6172-4649-9025-bef2f63819f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:35.495220 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-06332475-6172-4649-9025-bef2f63819f8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:35.496457 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-06332475-6172-4649-9025-bef2f63819f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:35.566783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:35.607298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 972/1953] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:35.618520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283010c2-3665-437d-9bc8-014e86a8d96d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:35.618703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283010c2-3665-437d-9bc8-014e86a8d96d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:35.618883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283010c2-3665-437d-9bc8-014e86a8d96d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:35.643248 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-283010c2-3665-437d-9bc8-014e86a8d96d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:35.645459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-283010c2-3665-437d-9bc8-014e86a8d96d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:35.657433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 982/1954] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:35.661965 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06332475-6172-4649-9025-bef2f63819f8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:35.675279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06332475-6172-4649-9025-bef2f63819f8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:35.682090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33008a6b-49a9-4a48-acf3-b71f23f9aab7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:35.683373 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008a6b-49a9-4a48-acf3-b71f23f9aab7 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:35.683651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008a6b-49a9-4a48-acf3-b71f23f9aab7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:35.683923 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33008a6b-49a9-4a48-acf3-b71f23f9aab7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:35.684640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008a6b-49a9-4a48-acf3-b71f23f9aab7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:35.684945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008a6b-49a9-4a48-acf3-b71f23f9aab7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:35.686600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33008a6b-49a9-4a48-acf3-b71f23f9aab7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:35.704346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 973/1955] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:35.706023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283010c2-3665-437d-9bc8-014e86a8d96d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:35.721234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283010c2-3665-437d-9bc8-014e86a8d96d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:35.731240 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d8037-c801-449c-896d-cce97984c927 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:35.731960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d8037-c801-449c-896d-cce97984c927 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:35.732463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22d8037-c801-449c-896d-cce97984c927 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:35.734603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 974/1956] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:19:35 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:19:35.753066 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc078d-5730-418f-b28b-53c801c4ffac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:35.753713 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc078d-5730-418f-b28b-53c801c4ffac admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:35.754020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc078d-5730-418f-b28b-53c801c4ffac admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:35.754314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fc078d-5730-418f-b28b-53c801c4ffac admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:35.756986 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc078d-5730-418f-b28b-53c801c4ffac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:35.759026 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fc078d-5730-418f-b28b-53c801c4ffac admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:35.766642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece695-406e-498b-9d5e-7c7551e42c8f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:35.766942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece695-406e-498b-9d5e-7c7551e42c8f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:35.767179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aece695-406e-498b-9d5e-7c7551e42c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:35.796828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5aece695-406e-498b-9d5e-7c7551e42c8f None None] MFA Rules not processed for user `35d5f3ec00844cf28c01a14f8a071a69`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:35.798403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5aece695-406e-498b-9d5e-7c7551e42c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:35.843985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 983/1957] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:35 2022] POST /identity/v3/projects => generated 377 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:35.843985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc078d-5730-418f-b28b-53c801c4ffac admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:35.847009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d1fc078d-5730-418f-b28b-53c801c4ffac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:35.896124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:35.962740 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 975/1958] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:19:35 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:35.964852 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aece695-406e-498b-9d5e-7c7551e42c8f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:35.979500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fc078d-5730-418f-b28b-53c801c4ffac admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:35.986775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:35.987445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:35.987729 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:35.988003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] PATH_INFO: `/v3/users/0e1fee2d310542a2aa47bd33d769e42d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:35.989657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e1fee2d310542a2aa47bd33d769e42d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:35.991232 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:36.002214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aece695-406e-498b-9d5e-7c7551e42c8f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:36.011174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88308fec-0bc7-4c47-b603-c5cda8524c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:36.012282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308fec-0bc7-4c47-b603-c5cda8524c50 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:36.012983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308fec-0bc7-4c47-b603-c5cda8524c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:36.013566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88308fec-0bc7-4c47-b603-c5cda8524c50 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:36.014813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88308fec-0bc7-4c47-b603-c5cda8524c50 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:36.020123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88308fec-0bc7-4c47-b603-c5cda8524c50 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:36.055341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 976/1959] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:35 2022] POST /identity/v3/users => generated 289 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:36.056381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88308fec-0bc7-4c47-b603-c5cda8524c50 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:36.063036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-88308fec-0bc7-4c47-b603-c5cda8524c50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:36.075712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e1fee2d310542a2aa47bd33d769e42d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:36.092683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e1fee2d310542a2aa47bd33d769e42d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:36.093337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e1fee2d310542a2aa47bd33d769e42d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:36.094064 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e1fee2d310542a2aa47bd33d769e42d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:36.103623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e1fee2d310542a2aa47bd33d769e42d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:36.130175 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 984/1960] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:35 2022] DELETE /identity/v3/users/0e1fee2d310542a2aa47bd33d769e42d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:36.131714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:36.132797 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:36.183198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88308fec-0bc7-4c47-b603-c5cda8524c50 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:36.219644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a201c21-52ec-4bdb-a61f-5f627941c6f9 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:36.226025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9f6ca-2696-4705-afea-0acfd7084b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:36.226854 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9f6ca-2696-4705-afea-0acfd7084b8b admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:36.227183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9f6ca-2696-4705-afea-0acfd7084b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:36.227405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11a9f6ca-2696-4705-afea-0acfd7084b8b admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:36.228065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9f6ca-2696-4705-afea-0acfd7084b8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:36.229675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11a9f6ca-2696-4705-afea-0acfd7084b8b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:36.254615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 985/1961] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:36.256494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9f6ca-2696-4705-afea-0acfd7084b8b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:36.257814 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:36.281981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11a9f6ca-2696-4705-afea-0acfd7084b8b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:36.283621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ce8be-d9d7-4a1e-955c-24670686ccef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d5f3ec00844cf28c01a14f8a071a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:36.284571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ce8be-d9d7-4a1e-955c-24670686ccef service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:36.284792 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ce8be-d9d7-4a1e-955c-24670686ccef service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:36.285064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499ce8be-d9d7-4a1e-955c-24670686ccef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:36.287119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-499ce8be-d9d7-4a1e-955c-24670686ccef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:36.287608 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b6f50-5161-4a08-88ee-82932b30f1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:36.288375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b6f50-5161-4a08-88ee-82932b30f1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:36.288855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b6f50-5161-4a08-88ee-82932b30f1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:36.289201 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5b6f50-5161-4a08-88ee-82932b30f1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:36.290000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b6f50-5161-4a08-88ee-82932b30f1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:36.291720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d5b6f50-5161-4a08-88ee-82932b30f1e2 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:36.300859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ce8be-d9d7-4a1e-955c-24670686ccef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:36.302408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499ce8be-d9d7-4a1e-955c-24670686ccef service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:36.308766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 986/1962] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:36.313404 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b6f50-5161-4a08-88ee-82932b30f1e2 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:36.326187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5b6f50-5161-4a08-88ee-82932b30f1e2 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:36.328018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 977/1963] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 272 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:36.344518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058b91e8-381e-4082-b0de-906aa6df17de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:36.345979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b91e8-381e-4082-b0de-906aa6df17de admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:36.345979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b91e8-381e-4082-b0de-906aa6df17de admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:36.345979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058b91e8-381e-4082-b0de-906aa6df17de admin admin] PATH_INFO: `/v3/projects/1393e81f6ce3451caeecb6617a6de938/users/936e670b6d464f7eab27be6bf089a2aa/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:36.364994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b91e8-381e-4082-b0de-906aa6df17de admin admin] RBAC: Authorizing `identity:create_grant(project_id=1393e81f6ce3451caeecb6617a6de938, user_id=936e670b6d464f7eab27be6bf089a2aa, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:36.367830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058b91e8-381e-4082-b0de-906aa6df17de admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:36.377126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ce8be-d9d7-4a1e-955c-24670686ccef service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:36.379046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-499ce8be-d9d7-4a1e-955c-24670686ccef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:36.393673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 987/1964] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:36 2022] PUT /identity/v3/projects/1393e81f6ce3451caeecb6617a6de938/users/936e670b6d464f7eab27be6bf089a2aa/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:36.400162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499ce8be-d9d7-4a1e-955c-24670686ccef service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:36.408698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f458a28-304d-467e-9d20-b0ad0337e5d3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:36.408698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f458a28-304d-467e-9d20-b0ad0337e5d3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:36.408948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f458a28-304d-467e-9d20-b0ad0337e5d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:36.429553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:36.459636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4f458a28-304d-467e-9d20-b0ad0337e5d3 None None] MFA Rules not processed for user `936e670b6d464f7eab27be6bf089a2aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:36.460970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4f458a28-304d-467e-9d20-b0ad0337e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:36.485267 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfa251f-d26d-443e-8dee-4e8a0e503101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:36.486277 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa251f-d26d-443e-8dee-4e8a0e503101 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:36.486277 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa251f-d26d-443e-8dee-4e8a0e503101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:36.486585 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa251f-d26d-443e-8dee-4e8a0e503101 admin admin] PATH_INFO: `/v3/projects/e84c69851ae748f78d67331b22af84b8` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:36.487625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa251f-d26d-443e-8dee-4e8a0e503101 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e84c69851ae748f78d67331b22af84b8)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:36.489510 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfa251f-d26d-443e-8dee-4e8a0e503101 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:36.544638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 988/1965] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:36.548155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbfa251f-d26d-443e-8dee-4e8a0e503101 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e84c69851ae748f78d67331b22af84b8', 'request_id': 'req-bbfa251f-d26d-443e-8dee-4e8a0e503101'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:36.555530 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbfa251f-d26d-443e-8dee-4e8a0e503101 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e84c69851ae748f78d67331b22af84b8', 'request_id': 'req-bbfa251f-d26d-443e-8dee-4e8a0e503101'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:36.560516 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f458a28-304d-467e-9d20-b0ad0337e5d3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:36.562554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4f458a28-304d-467e-9d20-b0ad0337e5d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:36.566243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbfa251f-d26d-443e-8dee-4e8a0e503101 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e84c69851ae748f78d67331b22af84b8', 'request_id': 'req-bbfa251f-d26d-443e-8dee-4e8a0e503101'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:36.579247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbfa251f-d26d-443e-8dee-4e8a0e503101 admin admin] The token cache is being invalidate because project e84c69851ae748f78d67331b22af84b8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:36.579539 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbfa251f-d26d-443e-8dee-4e8a0e503101 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:36.580236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbfa251f-d26d-443e-8dee-4e8a0e503101 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:36.582186 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 978/1966] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:36 2022] DELETE /identity/v3/projects/e84c69851ae748f78d67331b22af84b8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:36.587029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29202df9-04c0-434f-9952-277ebb7f1aab None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:36.587307 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29202df9-04c0-434f-9952-277ebb7f1aab None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:36.587578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29202df9-04c0-434f-9952-277ebb7f1aab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:36.610027 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-29202df9-04c0-434f-9952-277ebb7f1aab None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:36.611686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-29202df9-04c0-434f-9952-277ebb7f1aab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:36.633530 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f458a28-304d-467e-9d20-b0ad0337e5d3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:36.695597 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57414d4-b56f-46b7-b8d7-6e423efbea6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:36.696249 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57414d4-b56f-46b7-b8d7-6e423efbea6a service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:36.696527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57414d4-b56f-46b7-b8d7-6e423efbea6a service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:36.696796 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57414d4-b56f-46b7-b8d7-6e423efbea6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:36.697427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 979/1967] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:19:36.698908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f57414d4-b56f-46b7-b8d7-6e423efbea6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:36.706614 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85422-5f61-4ece-a358-5a2a2c390ca8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:36.707305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85422-5f61-4ece-a358-5a2a2c390ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:36.707729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b85422-5f61-4ece-a358-5a2a2c390ca8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:36.732321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d9b85422-5f61-4ece-a358-5a2a2c390ca8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:36.733440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d9b85422-5f61-4ece-a358-5a2a2c390ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:36.741689 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 980/1968] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:19:36.745997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b85422-5f61-4ece-a358-5a2a2c390ca8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:36.755185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b85422-5f61-4ece-a358-5a2a2c390ca8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:36.759913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bd974-a7b9-4bda-8c9a-f8c9fd51a5bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:36.760722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bd974-a7b9-4bda-8c9a-f8c9fd51a5bc admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:36.761007 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bd974-a7b9-4bda-8c9a-f8c9fd51a5bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:36.761263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815bd974-a7b9-4bda-8c9a-f8c9fd51a5bc admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:36.761951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bd974-a7b9-4bda-8c9a-f8c9fd51a5bc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:36.762252 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bd974-a7b9-4bda-8c9a-f8c9fd51a5bc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:36.763985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815bd974-a7b9-4bda-8c9a-f8c9fd51a5bc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:36.765693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:36.774834 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57414d4-b56f-46b7-b8d7-6e423efbea6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:36.776795 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57414d4-b56f-46b7-b8d7-6e423efbea6a service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:36.777849 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 981/1969] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:19:36.782699 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bd974-a7b9-4bda-8c9a-f8c9fd51a5bc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:36.789601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 989/1970] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:19:36.794286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815bd974-a7b9-4bda-8c9a-f8c9fd51a5bc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:36.799728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dffb2-06fc-4043-8e88-0a5b9203c22f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:36.800405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dffb2-06fc-4043-8e88-0a5b9203c22f admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:36.800676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dffb2-06fc-4043-8e88-0a5b9203c22f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:36.800942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0dffb2-06fc-4043-8e88-0a5b9203c22f admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:36.801574 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dffb2-06fc-4043-8e88-0a5b9203c22f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:36.803562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0dffb2-06fc-4043-8e88-0a5b9203c22f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:36.851972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 982/1971] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:36 2022] POST /identity/v3/projects => generated 405 bytes in 70 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:19:36.860244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57414d4-b56f-46b7-b8d7-6e423efbea6a service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:36.865646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:36.871656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57414d4-b56f-46b7-b8d7-6e423efbea6a service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:36.953646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641cd13-e72b-4754-afd1-64f77234f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:36.954420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641cd13-e72b-4754-afd1-64f77234f858 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:36.954762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641cd13-e72b-4754-afd1-64f77234f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:36.955060 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d641cd13-e72b-4754-afd1-64f77234f858 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:36.955714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641cd13-e72b-4754-afd1-64f77234f858 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:36.957936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d641cd13-e72b-4754-afd1-64f77234f858 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:36.983059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 990/1972] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:36 2022] POST /identity/v3/users => generated 303 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:36.989982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dffb2-06fc-4043-8e88-0a5b9203c22f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:37.009605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0dffb2-06fc-4043-8e88-0a5b9203c22f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:37.021905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1ab04-c66a-48ec-9bdc-ee804d0fa896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:37.022688 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1ab04-c66a-48ec-9bdc-ee804d0fa896 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.022924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1ab04-c66a-48ec-9bdc-ee804d0fa896 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.023206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd1ab04-c66a-48ec-9bdc-ee804d0fa896 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.024064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1ab04-c66a-48ec-9bdc-ee804d0fa896 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:37.026044 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd1ab04-c66a-48ec-9bdc-ee804d0fa896 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:37.041047 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 983/1973] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:36 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:19:37.042466 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641cd13-e72b-4754-afd1-64f77234f858 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:37.064516 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d641cd13-e72b-4754-afd1-64f77234f858 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:37.078636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831b564-13b8-4b28-9016-18884f1c55c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:37.079358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831b564-13b8-4b28-9016-18884f1c55c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.079710 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831b564-13b8-4b28-9016-18884f1c55c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.080629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4831b564-13b8-4b28-9016-18884f1c55c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.081678 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831b564-13b8-4b28-9016-18884f1c55c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:37.083728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4831b564-13b8-4b28-9016-18884f1c55c9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:37.096856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1ab04-c66a-48ec-9bdc-ee804d0fa896 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:37.100618 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-afd1ab04-c66a-48ec-9bdc-ee804d0fa896 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:37.102665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 991/1974] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:37.108965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831b564-13b8-4b28-9016-18884f1c55c9 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:37.119364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd1ab04-c66a-48ec-9bdc-ee804d0fa896 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:37.124122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4831b564-13b8-4b28-9016-18884f1c55c9 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:37.126084 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5265316f-d5c3-4268-a671-984f9192f909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:37.126886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265316f-d5c3-4268-a671-984f9192f909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.127199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265316f-d5c3-4268-a671-984f9192f909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.127544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5265316f-d5c3-4268-a671-984f9192f909 admin admin] PATH_INFO: `/v3/users/e6de3fa7d93a410bb6d3e3b2f193cbfa` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.129094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265316f-d5c3-4268-a671-984f9192f909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6de3fa7d93a410bb6d3e3b2f193cbfa)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:37.130299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c7ba88-d5fc-41c9-944a-ce91c03c0e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:37.131241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7ba88-d5fc-41c9-944a-ce91c03c0e7f admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.131415 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5265316f-d5c3-4268-a671-984f9192f909 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:37.131656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7ba88-d5fc-41c9-944a-ce91c03c0e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.131999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c7ba88-d5fc-41c9-944a-ce91c03c0e7f admin admin] PATH_INFO: `/v3/projects/a3aca8cc0ba34699bddabf380592925e/users/689d7bf88ac54e1a82a5faaa55a51aa0/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.161845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7ba88-d5fc-41c9-944a-ce91c03c0e7f admin admin] RBAC: Authorizing `identity:create_grant(project_id=a3aca8cc0ba34699bddabf380592925e, user_id=689d7bf88ac54e1a82a5faaa55a51aa0, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:37.162748 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c7ba88-d5fc-41c9-944a-ce91c03c0e7f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:37.187726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 992/1975] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:37 2022] PUT /identity/v3/projects/a3aca8cc0ba34699bddabf380592925e/users/689d7bf88ac54e1a82a5faaa55a51aa0/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:37.205409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07820266-70cc-44f6-8026-5a7382b0996d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.206411 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07820266-70cc-44f6-8026-5a7382b0996d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.207732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07820266-70cc-44f6-8026-5a7382b0996d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.228650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5265316f-d5c3-4268-a671-984f9192f909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6de3fa7d93a410bb6d3e3b2f193cbfa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:37.243652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5265316f-d5c3-4268-a671-984f9192f909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6de3fa7d93a410bb6d3e3b2f193cbfa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:37.245413 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5265316f-d5c3-4268-a671-984f9192f909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6de3fa7d93a410bb6d3e3b2f193cbfa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:37.246437 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5265316f-d5c3-4268-a671-984f9192f909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6de3fa7d93a410bb6d3e3b2f193cbfa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:37.264966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-07820266-70cc-44f6-8026-5a7382b0996d None None] MFA Rules not processed for user `689d7bf88ac54e1a82a5faaa55a51aa0`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:37.267709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-07820266-70cc-44f6-8026-5a7382b0996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:37.276257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5265316f-d5c3-4268-a671-984f9192f909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6de3fa7d93a410bb6d3e3b2f193cbfa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:37.318801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 984/1976] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:37 2022] DELETE /identity/v3/users/e6de3fa7d93a410bb6d3e3b2f193cbfa => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:37.323514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5c45e-ab69-4174-b522-e509a8824809 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.325072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5c45e-ab69-4174-b522-e509a8824809 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.325537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c5c45e-ab69-4174-b522-e509a8824809 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.356300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-65c5c45e-ab69-4174-b522-e509a8824809 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:37.356300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-65c5c45e-ab69-4174-b522-e509a8824809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:37.382889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 993/1977] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:37 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:37.387616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07820266-70cc-44f6-8026-5a7382b0996d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:37.389232 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-07820266-70cc-44f6-8026-5a7382b0996d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:37.426635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 985/1978] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:19:37.438676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5c45e-ab69-4174-b522-e509a8824809 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:37.440128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-65c5c45e-ab69-4174-b522-e509a8824809 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:37.444613 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:37.466965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07820266-70cc-44f6-8026-5a7382b0996d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:37.472454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b06e7-d96d-4b1d-aa97-5df8480e330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:37.473295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b06e7-d96d-4b1d-aa97-5df8480e330f admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.473665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b06e7-d96d-4b1d-aa97-5df8480e330f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.474081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338b06e7-d96d-4b1d-aa97-5df8480e330f admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.474904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b06e7-d96d-4b1d-aa97-5df8480e330f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:37.477070 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338b06e7-d96d-4b1d-aa97-5df8480e330f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:37.483446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:37.510422 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c5c45e-ab69-4174-b522-e509a8824809 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:37.514496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 994/1979] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:37 2022] POST /identity/v3/projects => generated 405 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:19:37.519243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b06e7-d96d-4b1d-aa97-5df8480e330f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:37.565844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13321aeb-0df1-4dfa-a71f-1d18248e3763 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:37.566472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321aeb-0df1-4dfa-a71f-1d18248e3763 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.566751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321aeb-0df1-4dfa-a71f-1d18248e3763 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.567023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13321aeb-0df1-4dfa-a71f-1d18248e3763 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.595478 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338b06e7-d96d-4b1d-aa97-5df8480e330f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:37.601498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf748-8009-4c85-95e2-2e06a3c2d7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:37.602180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf748-8009-4c85-95e2-2e06a3c2d7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.602456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf748-8009-4c85-95e2-2e06a3c2d7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.603007 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cbf748-8009-4c85-95e2-2e06a3c2d7d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.603658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbf748-8009-4c85-95e2-2e06a3c2d7d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:37.605644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cbf748-8009-4c85-95e2-2e06a3c2d7d5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:37.629213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 995/1980] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:37 2022] POST /identity/v3/users => generated 309 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:19:37.633667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf748-8009-4c85-95e2-2e06a3c2d7d5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:37.643183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13321aeb-0df1-4dfa-a71f-1d18248e3763 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:37.644727 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13321aeb-0df1-4dfa-a71f-1d18248e3763 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:37.644931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cbf748-8009-4c85-95e2-2e06a3c2d7d5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:37.649611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758f459-4936-48ec-a209-77c161a67a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:37.650285 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758f459-4936-48ec-a209-77c161a67a43 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.650623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758f459-4936-48ec-a209-77c161a67a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.650925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f758f459-4936-48ec-a209-77c161a67a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.651580 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758f459-4936-48ec-a209-77c161a67a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:37.653350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f758f459-4936-48ec-a209-77c161a67a43 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:37.655348 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 986/1981] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:19:37.664691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 996/1982] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:19:37.669210 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13321aeb-0df1-4dfa-a71f-1d18248e3763 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:37.679304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13321aeb-0df1-4dfa-a71f-1d18248e3763 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:37.685849 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e7a6e-0c6a-4d85-b0aa-8bb172290a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:37.692015 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e7a6e-0c6a-4d85-b0aa-8bb172290a80 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.692015 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e7a6e-0c6a-4d85-b0aa-8bb172290a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.692015 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0e7a6e-0c6a-4d85-b0aa-8bb172290a80 admin admin] PATH_INFO: `/v3/projects/220734e213b74b47989ddf57ac865130/users/7718c8c7a470495195bbd5c99d724ece/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.705539 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e7a6e-0c6a-4d85-b0aa-8bb172290a80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=220734e213b74b47989ddf57ac865130, user_id=7718c8c7a470495195bbd5c99d724ece, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:37.708237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0e7a6e-0c6a-4d85-b0aa-8bb172290a80 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:37.723074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 987/1983] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:37 2022] PUT /identity/v3/projects/220734e213b74b47989ddf57ac865130/users/7718c8c7a470495195bbd5c99d724ece/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:37.727302 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758f459-4936-48ec-a209-77c161a67a43 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:37.738408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f758f459-4936-48ec-a209-77c161a67a43 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:37.805225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45802cf-cb8e-4e07-ae2f-6ee352a2d1ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:37.805897 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45802cf-cb8e-4e07-ae2f-6ee352a2d1ab admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.806193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45802cf-cb8e-4e07-ae2f-6ee352a2d1ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.806471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45802cf-cb8e-4e07-ae2f-6ee352a2d1ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.807128 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45802cf-cb8e-4e07-ae2f-6ee352a2d1ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:37.809016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45802cf-cb8e-4e07-ae2f-6ee352a2d1ab admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:37.825052 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 997/1984] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:37 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:37.829958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e7a6e-0c6a-4d85-b0aa-8bb172290a80 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:37.841477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0e7a6e-0c6a-4d85-b0aa-8bb172290a80 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:37.846751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31609792-0838-421c-8a1c-91019cf52fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:37.847546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31609792-0838-421c-8a1c-91019cf52fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.847825 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31609792-0838-421c-8a1c-91019cf52fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.848099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31609792-0838-421c-8a1c-91019cf52fd0 admin admin] PATH_INFO: `/v3/projects/220734e213b74b47989ddf57ac865130/users/7718c8c7a470495195bbd5c99d724ece/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.850083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31609792-0838-421c-8a1c-91019cf52fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=220734e213b74b47989ddf57ac865130, user_id=7718c8c7a470495195bbd5c99d724ece, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:37.852963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31609792-0838-421c-8a1c-91019cf52fd0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:37.864653 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 988/1985] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:37 2022] PUT /identity/v3/projects/220734e213b74b47989ddf57ac865130/users/7718c8c7a470495195bbd5c99d724ece/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:37.876830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5055f-bcbe-48e7-8e4f-f55c4d8f12e6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:37.877114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5055f-bcbe-48e7-8e4f-f55c4d8f12e6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:37.877391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f5055f-bcbe-48e7-8e4f-f55c4d8f12e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:37.907564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-60f5055f-bcbe-48e7-8e4f-f55c4d8f12e6 None None] MFA Rules not processed for user `7718c8c7a470495195bbd5c99d724ece`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:37.908835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-60f5055f-bcbe-48e7-8e4f-f55c4d8f12e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:37.957970 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31609792-0838-421c-8a1c-91019cf52fd0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:37.960626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:37.964908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-31609792-0838-421c-8a1c-91019cf52fd0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:38.011049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 998/1986] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:37 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:38.025180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5055f-bcbe-48e7-8e4f-f55c4d8f12e6 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:38.027170 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-60f5055f-bcbe-48e7-8e4f-f55c4d8f12e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:38.049018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31609792-0838-421c-8a1c-91019cf52fd0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:38.053818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:38.054468 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:38.054747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:38.055018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] PATH_INFO: `/v3/projects/1208a133d31348b08d8100590992ac4b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:38.056145 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1208a133d31348b08d8100590992ac4b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:38.058106 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:38.060855 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:38.090064 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f5055f-bcbe-48e7-8e4f-f55c4d8f12e6 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:38.094318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d250e49-d88d-4f81-8a0e-9bebd5c072a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:38.094961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d250e49-d88d-4f81-8a0e-9bebd5c072a6 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:38.095241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d250e49-d88d-4f81-8a0e-9bebd5c072a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:38.095516 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d250e49-d88d-4f81-8a0e-9bebd5c072a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:38.107067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d250e49-d88d-4f81-8a0e-9bebd5c072a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:38.108416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d250e49-d88d-4f81-8a0e-9bebd5c072a6 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:38.111896 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1208a133d31348b08d8100590992ac4b', 'request_id': 'req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.119348 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1208a133d31348b08d8100590992ac4b', 'request_id': 'req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.120846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 999/1987] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:38 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:19:38.130121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1208a133d31348b08d8100590992ac4b', 'request_id': 'req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.143196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] The token cache is being invalidate because project 1208a133d31348b08d8100590992ac4b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:38.143579 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.144503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.146221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 989/1988] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:37 2022] DELETE /identity/v3/projects/1208a133d31348b08d8100590992ac4b => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:38.151079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d250e49-d88d-4f81-8a0e-9bebd5c072a6 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:38.163339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d250e49-d88d-4f81-8a0e-9bebd5c072a6 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:38.235286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfd29ef-a93b-41dc-aa4e-1d6542b71184 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:38.235967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd29ef-a93b-41dc-aa4e-1d6542b71184 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:38.236246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd29ef-a93b-41dc-aa4e-1d6542b71184 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:38.236521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfd29ef-a93b-41dc-aa4e-1d6542b71184 admin admin] PATH_INFO: `/v3/users/7641aa28d2914c84bdbdfe8d52ad7f8a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:38.237806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd29ef-a93b-41dc-aa4e-1d6542b71184 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7641aa28d2914c84bdbdfe8d52ad7f8a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:38.239939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfd29ef-a93b-41dc-aa4e-1d6542b71184 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:38.281216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:38.285209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:38.307251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ecfd29ef-a93b-41dc-aa4e-1d6542b71184 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7641aa28d2914c84bdbdfe8d52ad7f8a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.318120 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b5e7b9-617a-46f9-b265-3e6b7fb5aa55 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:38.322344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ecfd29ef-a93b-41dc-aa4e-1d6542b71184 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7641aa28d2914c84bdbdfe8d52ad7f8a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.323471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ecfd29ef-a93b-41dc-aa4e-1d6542b71184 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7641aa28d2914c84bdbdfe8d52ad7f8a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.324104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ecfd29ef-a93b-41dc-aa4e-1d6542b71184 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7641aa28d2914c84bdbdfe8d52ad7f8a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.333188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ecfd29ef-a93b-41dc-aa4e-1d6542b71184 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7641aa28d2914c84bdbdfe8d52ad7f8a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.340626 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:38.341988 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:38.342286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:38.342554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] PATH_INFO: `/v3/users/689d7bf88ac54e1a82a5faaa55a51aa0` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:38.344108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=689d7bf88ac54e1a82a5faaa55a51aa0)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:38.346089 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:38.351009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:38.364960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1000/1989] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:38 2022] DELETE /identity/v3/users/7641aa28d2914c84bdbdfe8d52ad7f8a => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:38.425957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '689d7bf88ac54e1a82a5faaa55a51aa0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.436881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '689d7bf88ac54e1a82a5faaa55a51aa0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.437751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '689d7bf88ac54e1a82a5faaa55a51aa0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.439290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '689d7bf88ac54e1a82a5faaa55a51aa0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.463364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '689d7bf88ac54e1a82a5faaa55a51aa0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.520429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15555488-59d6-4e3c-8a2c-a14b6644614f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:38.520738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15555488-59d6-4e3c-8a2c-a14b6644614f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:38.521015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15555488-59d6-4e3c-8a2c-a14b6644614f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:38.521226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 990/1990] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:38 2022] DELETE /identity/v3/users/689d7bf88ac54e1a82a5faaa55a51aa0 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:38.547590 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-15555488-59d6-4e3c-8a2c-a14b6644614f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:38.549703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-15555488-59d6-4e3c-8a2c-a14b6644614f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:38.646439 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1001/1991] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:19:38.658079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:38.665531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:38.728021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15555488-59d6-4e3c-8a2c-a14b6644614f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:38.730504 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-15555488-59d6-4e3c-8a2c-a14b6644614f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:38.732454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b8e07c-01e6-4def-8b77-43f76ab215ab admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:38.737816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3970981-c656-4961-ad09-f12492dd660e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:38.738594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3970981-c656-4961-ad09-f12492dd660e service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:38.739031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3970981-c656-4961-ad09-f12492dd660e service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:38.739364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3970981-c656-4961-ad09-f12492dd660e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:38.747098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15555488-59d6-4e3c-8a2c-a14b6644614f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:38.752988 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3970981-c656-4961-ad09-f12492dd660e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:38.754319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:38.754773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3970981-c656-4961-ad09-f12492dd660e service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:38.755006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:38.755259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:38.755514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] PATH_INFO: `/v3/projects/68f3de332d674c30a60722bff530855f` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:38.756673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f3de332d674c30a60722bff530855f)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:38.758610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:38.767419 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 991/1992] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:38.815310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f3de332d674c30a60722bff530855f', 'request_id': 'req-ea9d8385-bc8c-4103-93ef-54c43880f98e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.829201 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f3de332d674c30a60722bff530855f', 'request_id': 'req-ea9d8385-bc8c-4103-93ef-54c43880f98e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.838650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f3de332d674c30a60722bff530855f', 'request_id': 'req-ea9d8385-bc8c-4103-93ef-54c43880f98e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.852195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] The token cache is being invalidate because project 68f3de332d674c30a60722bff530855f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:38.852477 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.853183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:38.854724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1002/1993] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:38 2022] DELETE /identity/v3/projects/68f3de332d674c30a60722bff530855f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:38.859341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3970981-c656-4961-ad09-f12492dd660e service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:38.870001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3970981-c656-4961-ad09-f12492dd660e service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:38.874268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:38.946612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:38.947270 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:38.947548 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:38.947835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] PATH_INFO: `/v3/users/f304d93232604084b0620c82efea272e` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:38.949221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f304d93232604084b0620c82efea272e)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:38.951124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:39.018253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f304d93232604084b0620c82efea272e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.029690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f304d93232604084b0620c82efea272e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.030421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f304d93232604084b0620c82efea272e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.031182 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f304d93232604084b0620c82efea272e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.039898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f304d93232604084b0620c82efea272e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.068413 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 992/1994] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:38 2022] DELETE /identity/v3/users/f304d93232604084b0620c82efea272e => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:39.098817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:39.101010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:39.117494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9d8385-bc8c-4103-93ef-54c43880f98e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:39.196299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:39.196954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:39.197226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:39.197496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] PATH_INFO: `/v3/projects/a3aca8cc0ba34699bddabf380592925e` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:39.198648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a3aca8cc0ba34699bddabf380592925e)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:39.200639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:39.224875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:39.263470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a3aca8cc0ba34699bddabf380592925e', 'request_id': 'req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.271261 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a3aca8cc0ba34699bddabf380592925e', 'request_id': 'req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.281418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a3aca8cc0ba34699bddabf380592925e', 'request_id': 'req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.296455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] The token cache is being invalidate because project a3aca8cc0ba34699bddabf380592925e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:39.296693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.297603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.299533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1003/1995] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:39 2022] DELETE /identity/v3/projects/a3aca8cc0ba34699bddabf380592925e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:39.303684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:39.305968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:39.321383 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f26d8206-ecb4-4f2c-8af5-5e2a2336ed72 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:39.384053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d3c98d-b1bb-4695-839d-fe055908dc2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:39.384766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3c98d-b1bb-4695-839d-fe055908dc2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:39.385045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3c98d-b1bb-4695-839d-fe055908dc2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:39.385351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d3c98d-b1bb-4695-839d-fe055908dc2f admin admin] PATH_INFO: `/v3/users/7718c8c7a470495195bbd5c99d724ece` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:39.386665 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3c98d-b1bb-4695-839d-fe055908dc2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7718c8c7a470495195bbd5c99d724ece)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:39.388795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d3c98d-b1bb-4695-839d-fe055908dc2f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:39.397197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:39.399295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:39.415909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c40ef4b6-f007-4da5-a1d7-1bc09dbf6fa8 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:39.422102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de6985b-139b-4240-b237-0d84096de882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:39.422965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6985b-139b-4240-b237-0d84096de882 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:39.423288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6985b-139b-4240-b237-0d84096de882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:39.423561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de6985b-139b-4240-b237-0d84096de882 admin admin] PATH_INFO: `/v3/projects/1db4d79277d44d80a2cb591993c07b3d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:39.424997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6985b-139b-4240-b237-0d84096de882 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1db4d79277d44d80a2cb591993c07b3d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:39.427118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de6985b-139b-4240-b237-0d84096de882 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:39.429215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:39.454813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44d3c98d-b1bb-4695-839d-fe055908dc2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7718c8c7a470495195bbd5c99d724ece'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.464713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44d3c98d-b1bb-4695-839d-fe055908dc2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7718c8c7a470495195bbd5c99d724ece'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.465343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44d3c98d-b1bb-4695-839d-fe055908dc2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7718c8c7a470495195bbd5c99d724ece'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.466042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44d3c98d-b1bb-4695-839d-fe055908dc2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7718c8c7a470495195bbd5c99d724ece'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.474282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44d3c98d-b1bb-4695-839d-fe055908dc2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7718c8c7a470495195bbd5c99d724ece'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.492114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5de6985b-139b-4240-b237-0d84096de882 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1db4d79277d44d80a2cb591993c07b3d', 'request_id': 'req-5de6985b-139b-4240-b237-0d84096de882'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.499437 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 993/1996] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:39 2022] DELETE /identity/v3/users/7718c8c7a470495195bbd5c99d724ece => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:39.504028 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5de6985b-139b-4240-b237-0d84096de882 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1db4d79277d44d80a2cb591993c07b3d', 'request_id': 'req-5de6985b-139b-4240-b237-0d84096de882'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.515792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5de6985b-139b-4240-b237-0d84096de882 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1db4d79277d44d80a2cb591993c07b3d', 'request_id': 'req-5de6985b-139b-4240-b237-0d84096de882'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.528937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5de6985b-139b-4240-b237-0d84096de882 admin admin] The token cache is being invalidate because project 1db4d79277d44d80a2cb591993c07b3d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:39.529322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5de6985b-139b-4240-b237-0d84096de882 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.530469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5de6985b-139b-4240-b237-0d84096de882 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:39.535417 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1004/1997] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:39 2022] DELETE /identity/v3/projects/1db4d79277d44d80a2cb591993c07b3d => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:39.537627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598f8ba-a1d9-4590-ac43-b9229161df15 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:39.538287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598f8ba-a1d9-4590-ac43-b9229161df15 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:39.538287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9598f8ba-a1d9-4590-ac43-b9229161df15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:39.560700 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9598f8ba-a1d9-4590-ac43-b9229161df15 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:39.562249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9598f8ba-a1d9-4590-ac43-b9229161df15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:39.647167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 994/1998] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:39.649106 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c31b59-2919-403e-8ee9-4f04b5dcc3d7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:39.649701 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c31b59-2919-403e-8ee9-4f04b5dcc3d7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:39.650007 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c31b59-2919-403e-8ee9-4f04b5dcc3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:39.696565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-12c31b59-2919-403e-8ee9-4f04b5dcc3d7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:39.697003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-12c31b59-2919-403e-8ee9-4f04b5dcc3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:39.705738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1005/1999] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:39.711062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598f8ba-a1d9-4590-ac43-b9229161df15 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:39.724909 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9598f8ba-a1d9-4590-ac43-b9229161df15 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:39.730804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4a560-5a61-4c08-a758-3ae150576616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:39.731928 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4a560-5a61-4c08-a758-3ae150576616 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:39.732316 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4a560-5a61-4c08-a758-3ae150576616 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:39.732588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f4a560-5a61-4c08-a758-3ae150576616 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:39.733256 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4a560-5a61-4c08-a758-3ae150576616 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:39.733688 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4a560-5a61-4c08-a758-3ae150576616 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:39.735495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f4a560-5a61-4c08-a758-3ae150576616 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:39.752838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 995/2000] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:39.757687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c31b59-2919-403e-8ee9-4f04b5dcc3d7 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:39.769648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c31b59-2919-403e-8ee9-4f04b5dcc3d7 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:39.776600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb119f9c-21bc-4550-9d07-1a6d812a791c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:39.778586 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb119f9c-21bc-4550-9d07-1a6d812a791c admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:39.778902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb119f9c-21bc-4550-9d07-1a6d812a791c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:39.779315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb119f9c-21bc-4550-9d07-1a6d812a791c admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:39.780022 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb119f9c-21bc-4550-9d07-1a6d812a791c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:39.782047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb119f9c-21bc-4550-9d07-1a6d812a791c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:39.822570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1006/2001] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:39 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:39.823794 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4a560-5a61-4c08-a758-3ae150576616 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:39.835761 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f4a560-5a61-4c08-a758-3ae150576616 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:39.924650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb119f9c-21bc-4550-9d07-1a6d812a791c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:39.926896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cb119f9c-21bc-4550-9d07-1a6d812a791c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:39.941720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0b45f-df66-42ed-aa94-760395750f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:39.943119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0b45f-df66-42ed-aa94-760395750f5f admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:39.943857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0b45f-df66-42ed-aa94-760395750f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:39.943857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e0b45f-df66-42ed-aa94-760395750f5f admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:39.944606 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0b45f-df66-42ed-aa94-760395750f5f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:39.947071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e0b45f-df66-42ed-aa94-760395750f5f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:39.978226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 996/2002] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:39 2022] POST /identity/v3/users => generated 288 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:39.980180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0b45f-df66-42ed-aa94-760395750f5f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:39.991164 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e0b45f-df66-42ed-aa94-760395750f5f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:39.996181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd2d56-20b7-4aca-a153-70a0c297384f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:39.996951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd2d56-20b7-4aca-a153-70a0c297384f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:39.997338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd2d56-20b7-4aca-a153-70a0c297384f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:39.997641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fd2d56-20b7-4aca-a153-70a0c297384f admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:39.999085 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd2d56-20b7-4aca-a153-70a0c297384f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:40.000743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fd2d56-20b7-4aca-a153-70a0c297384f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:40.014868 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 997/2003] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:19:40.015979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb119f9c-21bc-4550-9d07-1a6d812a791c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:40.019586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd2d56-20b7-4aca-a153-70a0c297384f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:40.022321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2aedce6-b993-48f1-aba9-f3c002ee7728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:40.023258 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aedce6-b993-48f1-aba9-f3c002ee7728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.023567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aedce6-b993-48f1-aba9-f3c002ee7728 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.023809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2aedce6-b993-48f1-aba9-f3c002ee7728 admin admin] PATH_INFO: `/v3/projects/220734e213b74b47989ddf57ac865130` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.025116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aedce6-b993-48f1-aba9-f3c002ee7728 admin admin] RBAC: Authorizing `identity:delete_project(project_id=220734e213b74b47989ddf57ac865130)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:40.027228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2aedce6-b993-48f1-aba9-f3c002ee7728 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:40.031704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fd2d56-20b7-4aca-a153-70a0c297384f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:40.035004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:40.036899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56efd9-c880-47fc-bd85-32cf4df72114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:40.037551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56efd9-c880-47fc-bd85-32cf4df72114 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.037859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56efd9-c880-47fc-bd85-32cf4df72114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.038295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb56efd9-c880-47fc-bd85-32cf4df72114 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.039110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56efd9-c880-47fc-bd85-32cf4df72114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:40.040906 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb56efd9-c880-47fc-bd85-32cf4df72114 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:40.047196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:40.054847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 998/2004] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:40.058006 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56efd9-c880-47fc-bd85-32cf4df72114 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:40.070152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb56efd9-c880-47fc-bd85-32cf4df72114 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:40.076285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff70837-46f4-4ca1-aba7-68d3d933669e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:40.076981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff70837-46f4-4ca1-aba7-68d3d933669e admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.077354 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff70837-46f4-4ca1-aba7-68d3d933669e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.077647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff70837-46f4-4ca1-aba7-68d3d933669e admin admin] PATH_INFO: `/v3/projects/d50996fa3471457e865c93789499a2ca/users/af8b06e7c08f4fb6ae7c384cc1f2ea09/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.095405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b2aedce6-b993-48f1-aba9-f3c002ee7728 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '220734e213b74b47989ddf57ac865130', 'request_id': 'req-b2aedce6-b993-48f1-aba9-f3c002ee7728'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:40.104501 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b2aedce6-b993-48f1-aba9-f3c002ee7728 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '220734e213b74b47989ddf57ac865130', 'request_id': 'req-b2aedce6-b993-48f1-aba9-f3c002ee7728'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:40.105968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff70837-46f4-4ca1-aba7-68d3d933669e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d50996fa3471457e865c93789499a2ca, user_id=af8b06e7c08f4fb6ae7c384cc1f2ea09, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:40.108919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff70837-46f4-4ca1-aba7-68d3d933669e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:40.127495 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b2aedce6-b993-48f1-aba9-f3c002ee7728 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '220734e213b74b47989ddf57ac865130', 'request_id': 'req-b2aedce6-b993-48f1-aba9-f3c002ee7728'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:40.134149 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 999/2005] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:40 2022] PUT /identity/v3/projects/d50996fa3471457e865c93789499a2ca/users/af8b06e7c08f4fb6ae7c384cc1f2ea09/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:40.139254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8ca3e-337a-41ff-bde1-ef3da097cca9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.139531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8ca3e-337a-41ff-bde1-ef3da097cca9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.139797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a8ca3e-337a-41ff-bde1-ef3da097cca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.140176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b2aedce6-b993-48f1-aba9-f3c002ee7728 admin admin] The token cache is being invalidate because project 220734e213b74b47989ddf57ac865130 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:40.140539 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b2aedce6-b993-48f1-aba9-f3c002ee7728 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:40.141278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b2aedce6-b993-48f1-aba9-f3c002ee7728 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:40.143543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1007/2006] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:39 2022] DELETE /identity/v3/projects/220734e213b74b47989ddf57ac865130 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:40.149108 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffa78a-8a24-4f5b-8353-b774ceaeb7df None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.149371 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffa78a-8a24-4f5b-8353-b774ceaeb7df None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.149635 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffa78a-8a24-4f5b-8353-b774ceaeb7df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.169875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b1a8ca3e-337a-41ff-bde1-ef3da097cca9 None None] MFA Rules not processed for user `af8b06e7c08f4fb6ae7c384cc1f2ea09`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:40.171003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b1a8ca3e-337a-41ff-bde1-ef3da097cca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:40.172958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a1ffa78a-8a24-4f5b-8353-b774ceaeb7df None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:40.174292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a1ffa78a-8a24-4f5b-8353-b774ceaeb7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:40.245966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1000/2007] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:19:40.246230 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1008/2008] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:40.254841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f773ff-632f-4782-928a-215d576ff6af None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.255209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f773ff-632f-4782-928a-215d576ff6af None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.255377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f773ff-632f-4782-928a-215d576ff6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.263456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffa78a-8a24-4f5b-8353-b774ceaeb7df None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:40.265478 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a1ffa78a-8a24-4f5b-8353-b774ceaeb7df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:40.277673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-30f773ff-632f-4782-928a-215d576ff6af None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:40.279246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-30f773ff-632f-4782-928a-215d576ff6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:40.287232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1001/2009] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:40.291571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f773ff-632f-4782-928a-215d576ff6af None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:40.303602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f773ff-632f-4782-928a-215d576ff6af None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:40.310272 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54da55b-cb2e-43ae-85f4-47ee469f6f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:40.310918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54da55b-cb2e-43ae-85f4-47ee469f6f0a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.311196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54da55b-cb2e-43ae-85f4-47ee469f6f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.311466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54da55b-cb2e-43ae-85f4-47ee469f6f0a admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.312197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54da55b-cb2e-43ae-85f4-47ee469f6f0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:40.312505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54da55b-cb2e-43ae-85f4-47ee469f6f0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:40.314184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54da55b-cb2e-43ae-85f4-47ee469f6f0a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:40.330908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1002/2010] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:40.335354 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54da55b-cb2e-43ae-85f4-47ee469f6f0a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:40.337396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffa78a-8a24-4f5b-8353-b774ceaeb7df None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:40.341601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bec6e9-a19c-440a-a520-82ebd0679664 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:40.342249 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bec6e9-a19c-440a-a520-82ebd0679664 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.342591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bec6e9-a19c-440a-a520-82ebd0679664 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.342864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bec6e9-a19c-440a-a520-82ebd0679664 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.346392 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54da55b-cb2e-43ae-85f4-47ee469f6f0a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:40.351679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23052126-df4d-4fe7-ae2b-76c25ac40f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:40.352072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bec6e9-a19c-440a-a520-82ebd0679664 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:40.352329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23052126-df4d-4fe7-ae2b-76c25ac40f43 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.352577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23052126-df4d-4fe7-ae2b-76c25ac40f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.353532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23052126-df4d-4fe7-ae2b-76c25ac40f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.353532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23052126-df4d-4fe7-ae2b-76c25ac40f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:40.353703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bec6e9-a19c-440a-a520-82ebd0679664 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:40.355437 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23052126-df4d-4fe7-ae2b-76c25ac40f43 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:40.363471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1009/2011] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:40.388573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1003/2012] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:40 2022] POST /identity/v3/projects => generated 357 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:19:40.393045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bec6e9-a19c-440a-a520-82ebd0679664 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:40.404655 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bec6e9-a19c-440a-a520-82ebd0679664 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:40.450048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:40.484051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ac6e-1a8e-4915-b00a-3cf697c55aac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:40.484702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ac6e-1a8e-4915-b00a-3cf697c55aac admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.484998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ac6e-1a8e-4915-b00a-3cf697c55aac admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.485264 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983ac6e-1a8e-4915-b00a-3cf697c55aac admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.485964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983ac6e-1a8e-4915-b00a-3cf697c55aac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:40.487912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983ac6e-1a8e-4915-b00a-3cf697c55aac admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:40.517947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1010/2013] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:40 2022] POST /identity/v3/users => generated 279 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:40.520278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23052126-df4d-4fe7-ae2b-76c25ac40f43 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:40.531907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23052126-df4d-4fe7-ae2b-76c25ac40f43 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:40.537366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a41a6-0562-40ae-aebe-c0c1625899a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:40.538144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a41a6-0562-40ae-aebe-c0c1625899a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.538694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a41a6-0562-40ae-aebe-c0c1625899a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.538694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535a41a6-0562-40ae-aebe-c0c1625899a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.539474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a41a6-0562-40ae-aebe-c0c1625899a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:40.541471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535a41a6-0562-40ae-aebe-c0c1625899a7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:40.553985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1004/2014] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:40.560595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ac6e-1a8e-4915-b00a-3cf697c55aac admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:40.572038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983ac6e-1a8e-4915-b00a-3cf697c55aac admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:40.578392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58ffd2a-5e6f-4b68-8d4e-94204fdec191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:40.579032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ffd2a-5e6f-4b68-8d4e-94204fdec191 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.579335 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ffd2a-5e6f-4b68-8d4e-94204fdec191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.579638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58ffd2a-5e6f-4b68-8d4e-94204fdec191 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.580416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ffd2a-5e6f-4b68-8d4e-94204fdec191 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:40.582399 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58ffd2a-5e6f-4b68-8d4e-94204fdec191 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:40.593839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1011/2015] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:40.598171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a41a6-0562-40ae-aebe-c0c1625899a7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:40.610767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535a41a6-0562-40ae-aebe-c0c1625899a7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:40.619883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d884c88-0359-49a7-8642-a3f40612a81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:40.620592 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884c88-0359-49a7-8642-a3f40612a81a admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.622112 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884c88-0359-49a7-8642-a3f40612a81a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.622390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d884c88-0359-49a7-8642-a3f40612a81a admin admin] PATH_INFO: `/v3/projects/d29d7875469e48ad8364713325d0b018/users/fe6053781b34483db60512c7c3cc4667/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.642313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d884c88-0359-49a7-8642-a3f40612a81a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d29d7875469e48ad8364713325d0b018, user_id=fe6053781b34483db60512c7c3cc4667, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:40.645413 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d884c88-0359-49a7-8642-a3f40612a81a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:40.664111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1005/2016] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:40 2022] PUT /identity/v3/projects/d29d7875469e48ad8364713325d0b018/users/fe6053781b34483db60512c7c3cc4667/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:40.681037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a3ce5-22fe-4417-a4d4-6b8a35730008 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.681316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a3ce5-22fe-4417-a4d4-6b8a35730008 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.681596 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0a3ce5-22fe-4417-a4d4-6b8a35730008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.729232 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-3b0a3ce5-22fe-4417-a4d4-6b8a35730008 None None] MFA Rules not processed for user `fe6053781b34483db60512c7c3cc4667`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:40.730617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3b0a3ce5-22fe-4417-a4d4-6b8a35730008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:40.832037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1012/2017] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:40 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:40.836714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d884c88-0359-49a7-8642-a3f40612a81a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:40.900947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:40.927292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d884c88-0359-49a7-8642-a3f40612a81a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:40.933836 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c0457-3643-4f51-b95d-8764b36fd632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:40.934544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c0457-3643-4f51-b95d-8764b36fd632 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:40.934823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c0457-3643-4f51-b95d-8764b36fd632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:40.935089 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc6c0457-3643-4f51-b95d-8764b36fd632 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:40.935886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c0457-3643-4f51-b95d-8764b36fd632 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:40.937813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc6c0457-3643-4f51-b95d-8764b36fd632 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:40.975851 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1006/2018] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:40 2022] POST /identity/v3/projects => generated 355 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:40.980436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a3ce5-22fe-4417-a4d4-6b8a35730008 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:40.995017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0a3ce5-22fe-4417-a4d4-6b8a35730008 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:41.086364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d116d-9ecd-40f3-9082-7bca4ba97261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:41.087101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d116d-9ecd-40f3-9082-7bca4ba97261 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:41.087385 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d116d-9ecd-40f3-9082-7bca4ba97261 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:41.087658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437d116d-9ecd-40f3-9082-7bca4ba97261 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:41.088422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d116d-9ecd-40f3-9082-7bca4ba97261 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:41.091181 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437d116d-9ecd-40f3-9082-7bca4ba97261 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:41.126920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1013/2019] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:40 2022] POST /identity/v3/users => generated 284 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:41.133576 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c0457-3643-4f51-b95d-8764b36fd632 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:41.145758 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc6c0457-3643-4f51-b95d-8764b36fd632 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:41.150924 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68d808-feab-4f93-b1ce-2ed2f792bda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:41.151612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68d808-feab-4f93-b1ce-2ed2f792bda9 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:41.151886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68d808-feab-4f93-b1ce-2ed2f792bda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:41.152285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d68d808-feab-4f93-b1ce-2ed2f792bda9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:41.153572 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68d808-feab-4f93-b1ce-2ed2f792bda9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:41.155502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d68d808-feab-4f93-b1ce-2ed2f792bda9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:41.167599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1007/2020] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:41.172614 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d116d-9ecd-40f3-9082-7bca4ba97261 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:41.188787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437d116d-9ecd-40f3-9082-7bca4ba97261 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:41.194444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468592-1a59-43dc-a2ea-f35d573d7dcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:41.195144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468592-1a59-43dc-a2ea-f35d573d7dcb admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:41.195422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468592-1a59-43dc-a2ea-f35d573d7dcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:41.195691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16468592-1a59-43dc-a2ea-f35d573d7dcb admin admin] PATH_INFO: `/v3/projects/f414bde1c9e04c1cb9cb0afe93fab9a2/users/9d659d5df88e4857a378de3d1204d223/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:41.215343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468592-1a59-43dc-a2ea-f35d573d7dcb admin admin] RBAC: Authorizing `identity:create_grant(project_id=f414bde1c9e04c1cb9cb0afe93fab9a2, user_id=9d659d5df88e4857a378de3d1204d223, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:41.218084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16468592-1a59-43dc-a2ea-f35d573d7dcb admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:41.238571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1014/2021] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:41 2022] PUT /identity/v3/projects/f414bde1c9e04c1cb9cb0afe93fab9a2/users/9d659d5df88e4857a378de3d1204d223/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:41.242681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68d808-feab-4f93-b1ce-2ed2f792bda9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:41.253959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d68d808-feab-4f93-b1ce-2ed2f792bda9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:41.321355 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8516f51b-fe93-463d-b5cb-c72e0ab8ccf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:41.322170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516f51b-fe93-463d-b5cb-c72e0ab8ccf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:41.322511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516f51b-fe93-463d-b5cb-c72e0ab8ccf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:41.322865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8516f51b-fe93-463d-b5cb-c72e0ab8ccf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:41.323593 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516f51b-fe93-463d-b5cb-c72e0ab8ccf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:41.326615 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8516f51b-fe93-463d-b5cb-c72e0ab8ccf4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:41.338254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1008/2022] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:41 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:41.344257 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468592-1a59-43dc-a2ea-f35d573d7dcb admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:41.355524 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16468592-1a59-43dc-a2ea-f35d573d7dcb admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:41.361156 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b83f92-783c-4eb3-826a-97d093c88cb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:41.361957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b83f92-783c-4eb3-826a-97d093c88cb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:41.362238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b83f92-783c-4eb3-826a-97d093c88cb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:41.362511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b83f92-783c-4eb3-826a-97d093c88cb3 admin admin] PATH_INFO: `/v3/projects/f414bde1c9e04c1cb9cb0afe93fab9a2/users/9d659d5df88e4857a378de3d1204d223/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:41.364484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b83f92-783c-4eb3-826a-97d093c88cb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f414bde1c9e04c1cb9cb0afe93fab9a2, user_id=9d659d5df88e4857a378de3d1204d223, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:41.367933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b83f92-783c-4eb3-826a-97d093c88cb3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:41.376372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:41.383791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1015/2023] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:41 2022] PUT /identity/v3/projects/f414bde1c9e04c1cb9cb0afe93fab9a2/users/9d659d5df88e4857a378de3d1204d223/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:41.397603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa5361-e26a-4729-bbb7-f1a0efc8b6d6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:41.398078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa5361-e26a-4729-bbb7-f1a0efc8b6d6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:41.398562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7aa5361-e26a-4729-bbb7-f1a0efc8b6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:41.438584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e7aa5361-e26a-4729-bbb7-f1a0efc8b6d6 None None] MFA Rules not processed for user `9d659d5df88e4857a378de3d1204d223`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:41.440029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e7aa5361-e26a-4729-bbb7-f1a0efc8b6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:41.525794 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1009/2024] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:41.537852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b83f92-783c-4eb3-826a-97d093c88cb3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:41.608687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b83f92-783c-4eb3-826a-97d093c88cb3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:41.613160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da68996-9255-4a4c-8007-67d9bc83151b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:41.613864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da68996-9255-4a4c-8007-67d9bc83151b service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:41.614859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da68996-9255-4a4c-8007-67d9bc83151b service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:41.614859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da68996-9255-4a4c-8007-67d9bc83151b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:41.635606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da68996-9255-4a4c-8007-67d9bc83151b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:41.637046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da68996-9255-4a4c-8007-67d9bc83151b service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:41.648473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1016/2025] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:41.742156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa5361-e26a-4729-bbb7-f1a0efc8b6d6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:41.742156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e7aa5361-e26a-4729-bbb7-f1a0efc8b6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:41.752934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7aa5361-e26a-4729-bbb7-f1a0efc8b6d6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:41.757834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ec422-3402-4121-ae62-02bc7b852662 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:41.758547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ec422-3402-4121-ae62-02bc7b852662 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:41.759024 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ec422-3402-4121-ae62-02bc7b852662 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:41.759294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306ec422-3402-4121-ae62-02bc7b852662 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:41.791595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff00d7-b0cb-4cbf-8d88-d5800e5c77af None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:41.791996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff00d7-b0cb-4cbf-8d88-d5800e5c77af None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:41.792363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ff00d7-b0cb-4cbf-8d88-d5800e5c77af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:41.820242 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:41.826411 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e9ff00d7-b0cb-4cbf-8d88-d5800e5c77af None None] MFA Rules not processed for user `af8b06e7c08f4fb6ae7c384cc1f2ea09`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:41.828033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e9ff00d7-b0cb-4cbf-8d88-d5800e5c77af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:41.841812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ec422-3402-4121-ae62-02bc7b852662 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:41.843913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306ec422-3402-4121-ae62-02bc7b852662 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:41.856892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1010/2026] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:41 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:41.910346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1017/2027] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:19:48.992132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ec422-3402-4121-ae62-02bc7b852662 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:48.993569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-306ec422-3402-4121-ae62-02bc7b852662 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:49.068604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306ec422-3402-4121-ae62-02bc7b852662 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:49.073985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:49.074707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:49.074981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:49.075246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] PATH_INFO: `/v3/users/936e670b6d464f7eab27be6bf089a2aa` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:49.076378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] RBAC: Authorizing `identity:delete_user(user_id=936e670b6d464f7eab27be6bf089a2aa)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:49.078394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:49.139760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '936e670b6d464f7eab27be6bf089a2aa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:49.148637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '936e670b6d464f7eab27be6bf089a2aa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:49.149396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '936e670b6d464f7eab27be6bf089a2aa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:49.150041 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '936e670b6d464f7eab27be6bf089a2aa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:49.157804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '936e670b6d464f7eab27be6bf089a2aa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:49.177682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1011/2028] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:48 2022] DELETE /identity/v3/users/936e670b6d464f7eab27be6bf089a2aa => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:49.182771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76084fd1-911d-4550-8933-260704552915 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:49.183337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76084fd1-911d-4550-8933-260704552915 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:49.183337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76084fd1-911d-4550-8933-260704552915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:49.203556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-76084fd1-911d-4550-8933-260704552915 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:49.204781 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-76084fd1-911d-4550-8933-260704552915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:49.269237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1018/2029] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:49.284250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:49.285724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:49.347991 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5756a5e-4193-4135-9edb-5357adc6887e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:49.352869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce356b2-12e2-4763-ae31-cc36dda6e856 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:49.353590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce356b2-12e2-4763-ae31-cc36dda6e856 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:49.353901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce356b2-12e2-4763-ae31-cc36dda6e856 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:49.354199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce356b2-12e2-4763-ae31-cc36dda6e856 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:49.365456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce356b2-12e2-4763-ae31-cc36dda6e856 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:49.367029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce356b2-12e2-4763-ae31-cc36dda6e856 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:49.379176 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1012/2030] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:49.729964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76084fd1-911d-4550-8933-260704552915 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:49.731695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-76084fd1-911d-4550-8933-260704552915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:49.750411 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76084fd1-911d-4550-8933-260704552915 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:49.766721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443230cc-39c2-4311-ab28-a4db061e30e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:49.767457 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443230cc-39c2-4311-ab28-a4db061e30e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:49.768353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443230cc-39c2-4311-ab28-a4db061e30e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:49.768635 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443230cc-39c2-4311-ab28-a4db061e30e2 admin admin] PATH_INFO: `/v3/projects/1393e81f6ce3451caeecb6617a6de938` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:49.770109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443230cc-39c2-4311-ab28-a4db061e30e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1393e81f6ce3451caeecb6617a6de938)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:49.772037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443230cc-39c2-4311-ab28-a4db061e30e2 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:49.836386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:49.848006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-443230cc-39c2-4311-ab28-a4db061e30e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1393e81f6ce3451caeecb6617a6de938', 'request_id': 'req-443230cc-39c2-4311-ab28-a4db061e30e2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:49.858194 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-443230cc-39c2-4311-ab28-a4db061e30e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1393e81f6ce3451caeecb6617a6de938', 'request_id': 'req-443230cc-39c2-4311-ab28-a4db061e30e2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:49.868377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-443230cc-39c2-4311-ab28-a4db061e30e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1393e81f6ce3451caeecb6617a6de938', 'request_id': 'req-443230cc-39c2-4311-ab28-a4db061e30e2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:49.882813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-443230cc-39c2-4311-ab28-a4db061e30e2 admin admin] The token cache is being invalidate because project 1393e81f6ce3451caeecb6617a6de938 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:49.883126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-443230cc-39c2-4311-ab28-a4db061e30e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:49.883788 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-443230cc-39c2-4311-ab28-a4db061e30e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:49.885537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1019/2031] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:49 2022] DELETE /identity/v3/projects/1393e81f6ce3451caeecb6617a6de938 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:49.890649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed3b7a-a6bb-4ddc-8845-8b230ed4a083 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:49.891408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed3b7a-a6bb-4ddc-8845-8b230ed4a083 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:49.891693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed3b7a-a6bb-4ddc-8845-8b230ed4a083 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:49.901038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:49.914651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-abed3b7a-a6bb-4ddc-8845-8b230ed4a083 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:49.917165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-abed3b7a-a6bb-4ddc-8845-8b230ed4a083 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:49.990405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1013/2032] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:49.999887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee40fb-ec4b-443a-8aa3-4fc7b4bc5a68 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:50.000247 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee40fb-ec4b-443a-8aa3-4fc7b4bc5a68 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:50.000596 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bee40fb-ec4b-443a-8aa3-4fc7b4bc5a68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:50.024783 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4bee40fb-ec4b-443a-8aa3-4fc7b4bc5a68 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:50.026309 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4bee40fb-ec4b-443a-8aa3-4fc7b4bc5a68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:50.034655 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1020/2033] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:50.038872 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed3b7a-a6bb-4ddc-8845-8b230ed4a083 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:50.049280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed3b7a-a6bb-4ddc-8845-8b230ed4a083 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:50.054152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44664fe5-b831-4f09-8d78-f597f677dea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:50.054772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44664fe5-b831-4f09-8d78-f597f677dea1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:50.055042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44664fe5-b831-4f09-8d78-f597f677dea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:50.055306 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44664fe5-b831-4f09-8d78-f597f677dea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:50.055978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44664fe5-b831-4f09-8d78-f597f677dea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:50.056295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44664fe5-b831-4f09-8d78-f597f677dea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:50.057892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44664fe5-b831-4f09-8d78-f597f677dea1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:50.070643 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1014/2034] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:50.075444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee40fb-ec4b-443a-8aa3-4fc7b4bc5a68 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:50.085658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bee40fb-ec4b-443a-8aa3-4fc7b4bc5a68 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:50.091271 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31816e25-652c-430e-896e-4293ed2b2a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:50.091896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31816e25-652c-430e-896e-4293ed2b2a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:50.092174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31816e25-652c-430e-896e-4293ed2b2a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:50.092445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31816e25-652c-430e-896e-4293ed2b2a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:50.093086 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31816e25-652c-430e-896e-4293ed2b2a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:50.095037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31816e25-652c-430e-896e-4293ed2b2a01 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:50.128292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1021/2035] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:50 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:50.129573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44664fe5-b831-4f09-8d78-f597f677dea1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:50.141666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44664fe5-b831-4f09-8d78-f597f677dea1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:50.214600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d44bef-8602-4a61-a30b-8482740b36d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:50.215550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d44bef-8602-4a61-a30b-8482740b36d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:50.215915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d44bef-8602-4a61-a30b-8482740b36d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:50.216251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d44bef-8602-4a61-a30b-8482740b36d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:50.217011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d44bef-8602-4a61-a30b-8482740b36d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:50.220056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d44bef-8602-4a61-a30b-8482740b36d1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:50.250297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1015/2036] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:50 2022] POST /identity/v3/users => generated 293 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:50.252059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31816e25-652c-430e-896e-4293ed2b2a01 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:50.262716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31816e25-652c-430e-896e-4293ed2b2a01 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:50.267727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0bff8-1a9b-4c82-8077-8e14d223980f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:50.268279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0bff8-1a9b-4c82-8077-8e14d223980f admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:50.268726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0bff8-1a9b-4c82-8077-8e14d223980f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:50.269140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e0bff8-1a9b-4c82-8077-8e14d223980f admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:50.269957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0bff8-1a9b-4c82-8077-8e14d223980f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:50.271699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e0bff8-1a9b-4c82-8077-8e14d223980f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:50.284347 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1022/2037] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:50.288495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d44bef-8602-4a61-a30b-8482740b36d1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:50.300983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d44bef-8602-4a61-a30b-8482740b36d1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:50.310825 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23b9336-a11e-499c-8c51-6959d1d02f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:50.311469 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b9336-a11e-499c-8c51-6959d1d02f3f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:50.311744 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b9336-a11e-499c-8c51-6959d1d02f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:50.312017 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23b9336-a11e-499c-8c51-6959d1d02f3f admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:50.312677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b9336-a11e-499c-8c51-6959d1d02f3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:50.314383 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23b9336-a11e-499c-8c51-6959d1d02f3f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:50.326920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1016/2038] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:50.331681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0bff8-1a9b-4c82-8077-8e14d223980f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:50.344766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e0bff8-1a9b-4c82-8077-8e14d223980f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:50.350284 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f2e52-2464-41a7-b293-3be8805f9d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:50.350976 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f2e52-2464-41a7-b293-3be8805f9d29 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:50.351259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f2e52-2464-41a7-b293-3be8805f9d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:50.351688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f2e52-2464-41a7-b293-3be8805f9d29 admin admin] PATH_INFO: `/v3/projects/68854bcf6f944b98876849e6c2c58284/users/1bd6eb81b89a4bf59826c96207ec6213/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:50.368538 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f2e52-2464-41a7-b293-3be8805f9d29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68854bcf6f944b98876849e6c2c58284, user_id=1bd6eb81b89a4bf59826c96207ec6213, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:50.371303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f2e52-2464-41a7-b293-3be8805f9d29 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:50.387634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1023/2039] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:50 2022] PUT /identity/v3/projects/68854bcf6f944b98876849e6c2c58284/users/1bd6eb81b89a4bf59826c96207ec6213/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:50.396929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a440e0-1eb7-4e8e-a8cd-cdf6a42491d7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:50.397212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a440e0-1eb7-4e8e-a8cd-cdf6a42491d7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:50.398139 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a440e0-1eb7-4e8e-a8cd-cdf6a42491d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:50.430139 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-38a440e0-1eb7-4e8e-a8cd-cdf6a42491d7 None None] MFA Rules not processed for user `1bd6eb81b89a4bf59826c96207ec6213`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:50.431563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-38a440e0-1eb7-4e8e-a8cd-cdf6a42491d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:50.517379 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:50.542725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1017/2040] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:50.544288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f2e52-2464-41a7-b293-3be8805f9d29 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:50.546284 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8e2f2e52-2464-41a7-b293-3be8805f9d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:50.615442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f2e52-2464-41a7-b293-3be8805f9d29 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:50.619116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696c3d81-b747-4435-bb47-9ffbf652cd0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:50.619744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c3d81-b747-4435-bb47-9ffbf652cd0c service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:50.620022 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c3d81-b747-4435-bb47-9ffbf652cd0c service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:50.620293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696c3d81-b747-4435-bb47-9ffbf652cd0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:50.629019 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c3d81-b747-4435-bb47-9ffbf652cd0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:50.630494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696c3d81-b747-4435-bb47-9ffbf652cd0c service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:50.640274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1024/2041] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:50 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:19:53.316852 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a440e0-1eb7-4e8e-a8cd-cdf6a42491d7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:53.391431 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a440e0-1eb7-4e8e-a8cd-cdf6a42491d7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:53.395970 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:53.396614 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:53.396887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:53.397160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] PATH_INFO: `/v3/users/1bd6eb81b89a4bf59826c96207ec6213` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:53.398302 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd6eb81b89a4bf59826c96207ec6213)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:53.400214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:53.450221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd6eb81b89a4bf59826c96207ec6213'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:53.460353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd6eb81b89a4bf59826c96207ec6213'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:53.461008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd6eb81b89a4bf59826c96207ec6213'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:53.461620 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd6eb81b89a4bf59826c96207ec6213'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:53.469459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd6eb81b89a4bf59826c96207ec6213'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:53.488584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1018/2042] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:53 2022] DELETE /identity/v3/users/1bd6eb81b89a4bf59826c96207ec6213 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:53.493532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16e733-ac80-407a-8631-bdb67f810447 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:53.494035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16e733-ac80-407a-8631-bdb67f810447 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:53.494267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa16e733-ac80-407a-8631-bdb67f810447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:53.514868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fa16e733-ac80-407a-8631-bdb67f810447 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:53.516115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fa16e733-ac80-407a-8631-bdb67f810447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:53.593241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1025/2043] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:53.604243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:53.606385 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:53.674638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807254c8-17a0-4bf3-b9a3-a22f4fa7602a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:53.679349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e2e12-e3bf-4443-aa32-f8a1240105ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:53.679967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e2e12-e3bf-4443-aa32-f8a1240105ce service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:53.680247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e2e12-e3bf-4443-aa32-f8a1240105ce service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:53.680539 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4e2e12-e3bf-4443-aa32-f8a1240105ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:53.690324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e2e12-e3bf-4443-aa32-f8a1240105ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:53.691811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b4e2e12-e3bf-4443-aa32-f8a1240105ce service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:53.702982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1019/2044] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:53.993202 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16e733-ac80-407a-8631-bdb67f810447 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:53.994675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fa16e733-ac80-407a-8631-bdb67f810447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:54.007646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa16e733-ac80-407a-8631-bdb67f810447 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:54.013681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e3b770-e6ee-49de-8ae4-f9ada8df7271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:54.014368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3b770-e6ee-49de-8ae4-f9ada8df7271 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:54.014646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3b770-e6ee-49de-8ae4-f9ada8df7271 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:54.014910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e3b770-e6ee-49de-8ae4-f9ada8df7271 admin admin] PATH_INFO: `/v3/projects/68854bcf6f944b98876849e6c2c58284` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:54.016139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3b770-e6ee-49de-8ae4-f9ada8df7271 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68854bcf6f944b98876849e6c2c58284)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:54.018275 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e3b770-e6ee-49de-8ae4-f9ada8df7271 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:54.021211 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:54.072677 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-76e3b770-e6ee-49de-8ae4-f9ada8df7271 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68854bcf6f944b98876849e6c2c58284', 'request_id': 'req-76e3b770-e6ee-49de-8ae4-f9ada8df7271'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:54.079412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-76e3b770-e6ee-49de-8ae4-f9ada8df7271 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68854bcf6f944b98876849e6c2c58284', 'request_id': 'req-76e3b770-e6ee-49de-8ae4-f9ada8df7271'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:54.089117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-76e3b770-e6ee-49de-8ae4-f9ada8df7271 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68854bcf6f944b98876849e6c2c58284', 'request_id': 'req-76e3b770-e6ee-49de-8ae4-f9ada8df7271'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:54.100362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-76e3b770-e6ee-49de-8ae4-f9ada8df7271 admin admin] The token cache is being invalidate because project 68854bcf6f944b98876849e6c2c58284 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:54.100648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-76e3b770-e6ee-49de-8ae4-f9ada8df7271 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:54.101364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-76e3b770-e6ee-49de-8ae4-f9ada8df7271 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:54.102845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1026/2045] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:53 2022] DELETE /identity/v3/projects/68854bcf6f944b98876849e6c2c58284 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:55.558960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e2e12-e3bf-4443-aa32-f8a1240105ce service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:55.561223 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7b4e2e12-e3bf-4443-aa32-f8a1240105ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:55.576193 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b4e2e12-e3bf-4443-aa32-f8a1240105ce service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:55.601732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:55.644443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:55.645101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:55.645380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:55.645652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] PATH_INFO: `/v3/users/d3b413a1f59f4b74ab549dbc7cd18809` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:55.646994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3b413a1f59f4b74ab549dbc7cd18809)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:55.648961 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:55.704656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3b413a1f59f4b74ab549dbc7cd18809'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:55.717988 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3b413a1f59f4b74ab549dbc7cd18809'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:55.717988 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3b413a1f59f4b74ab549dbc7cd18809'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:55.717988 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3b413a1f59f4b74ab549dbc7cd18809'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:55.723030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3b413a1f59f4b74ab549dbc7cd18809'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:55.742754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1020/2046] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:55 2022] DELETE /identity/v3/users/d3b413a1f59f4b74ab549dbc7cd18809 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:55.747850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448816d-a193-407d-9f31-c70e06f180bd None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:55.748347 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448816d-a193-407d-9f31-c70e06f180bd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:55.748424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b448816d-a193-407d-9f31-c70e06f180bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:55.768094 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b448816d-a193-407d-9f31-c70e06f180bd None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:55.769340 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b448816d-a193-407d-9f31-c70e06f180bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:55.833380 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1027/2047] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:55.844163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:55.845752 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:55.910110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6d9c6-c11f-4eac-88f4-c02ff3b32e7a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:55.914157 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28adb987-d9fd-4f01-886a-457f83885913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:55.914789 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adb987-d9fd-4f01-886a-457f83885913 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:55.915105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adb987-d9fd-4f01-886a-457f83885913 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:55.915360 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28adb987-d9fd-4f01-886a-457f83885913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:55.925106 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adb987-d9fd-4f01-886a-457f83885913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:55.926584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28adb987-d9fd-4f01-886a-457f83885913 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:55.936784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1021/2048] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:19:56.257428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448816d-a193-407d-9f31-c70e06f180bd None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:56.259081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b448816d-a193-407d-9f31-c70e06f180bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:56.272246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b448816d-a193-407d-9f31-c70e06f180bd None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:56.279250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08279b2-566b-444e-b517-37973083d32d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:56.279911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08279b2-566b-444e-b517-37973083d32d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:56.280259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08279b2-566b-444e-b517-37973083d32d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:56.280469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08279b2-566b-444e-b517-37973083d32d admin admin] PATH_INFO: `/v3/projects/d95b323e8023413188f6d3b76657517e` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:56.281835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08279b2-566b-444e-b517-37973083d32d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d95b323e8023413188f6d3b76657517e)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:56.283795 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08279b2-566b-444e-b517-37973083d32d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:56.351519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b08279b2-566b-444e-b517-37973083d32d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd95b323e8023413188f6d3b76657517e', 'request_id': 'req-b08279b2-566b-444e-b517-37973083d32d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:56.358444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b08279b2-566b-444e-b517-37973083d32d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd95b323e8023413188f6d3b76657517e', 'request_id': 'req-b08279b2-566b-444e-b517-37973083d32d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:56.367950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b08279b2-566b-444e-b517-37973083d32d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd95b323e8023413188f6d3b76657517e', 'request_id': 'req-b08279b2-566b-444e-b517-37973083d32d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:56.379606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b08279b2-566b-444e-b517-37973083d32d admin admin] The token cache is being invalidate because project d95b323e8023413188f6d3b76657517e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:56.379930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b08279b2-566b-444e-b517-37973083d32d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:56.380684 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b08279b2-566b-444e-b517-37973083d32d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:56.382419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1028/2049] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:56 2022] DELETE /identity/v3/projects/d95b323e8023413188f6d3b76657517e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:56.387722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060ec21-b7bb-4605-98de-c5c08ffa32b7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:56.388033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060ec21-b7bb-4605-98de-c5c08ffa32b7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:56.388317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f060ec21-b7bb-4605-98de-c5c08ffa32b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:56.409496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f060ec21-b7bb-4605-98de-c5c08ffa32b7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:56.410769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f060ec21-b7bb-4605-98de-c5c08ffa32b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:56.454874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:56.483331 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1022/2050] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:56.492492 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efab9cb-358d-4dcb-be66-0086a4b3636c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:56.492859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efab9cb-358d-4dcb-be66-0086a4b3636c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:56.493082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efab9cb-358d-4dcb-be66-0086a4b3636c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:56.516004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-2efab9cb-358d-4dcb-be66-0086a4b3636c None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:56.517473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2efab9cb-358d-4dcb-be66-0086a4b3636c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:56.526054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1029/2051] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:56.530760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060ec21-b7bb-4605-98de-c5c08ffa32b7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:56.540434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f060ec21-b7bb-4605-98de-c5c08ffa32b7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:56.545633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d993ba-d025-46de-9759-1e94e70ac16a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:56.546390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d993ba-d025-46de-9759-1e94e70ac16a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:56.546661 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d993ba-d025-46de-9759-1e94e70ac16a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:56.546928 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d993ba-d025-46de-9759-1e94e70ac16a admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:56.547707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d993ba-d025-46de-9759-1e94e70ac16a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:56.548075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d993ba-d025-46de-9759-1e94e70ac16a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:56.549956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d993ba-d025-46de-9759-1e94e70ac16a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:56.564571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1023/2052] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:56.569589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efab9cb-358d-4dcb-be66-0086a4b3636c None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:56.580178 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efab9cb-358d-4dcb-be66-0086a4b3636c None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:56.590932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e04edc-8477-4c88-bd87-726584c9dc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:56.590932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e04edc-8477-4c88-bd87-726584c9dc6b admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:56.590932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e04edc-8477-4c88-bd87-726584c9dc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:56.590932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e04edc-8477-4c88-bd87-726584c9dc6b admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:56.591408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e04edc-8477-4c88-bd87-726584c9dc6b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:56.592834 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e04edc-8477-4c88-bd87-726584c9dc6b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:56.599361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:56.627467 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1030/2053] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:56 2022] POST /identity/v3/projects => generated 371 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:19:56.631728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d993ba-d025-46de-9759-1e94e70ac16a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:56.642792 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d993ba-d025-46de-9759-1e94e70ac16a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:56.700554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edd371-5c95-4b7d-80f4-20304ca87767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:56.701184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edd371-5c95-4b7d-80f4-20304ca87767 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:56.701462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edd371-5c95-4b7d-80f4-20304ca87767 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:56.701730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8edd371-5c95-4b7d-80f4-20304ca87767 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:56.702405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edd371-5c95-4b7d-80f4-20304ca87767 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:56.704310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8edd371-5c95-4b7d-80f4-20304ca87767 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:56.728811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1024/2054] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:56 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:56.733985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e04edc-8477-4c88-bd87-726584c9dc6b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:56.744919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e04edc-8477-4c88-bd87-726584c9dc6b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:56.757670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de21a25-ff40-46b3-aaca-1ddcdfe35cca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:56.758413 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de21a25-ff40-46b3-aaca-1ddcdfe35cca admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:56.758669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de21a25-ff40-46b3-aaca-1ddcdfe35cca admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:56.758939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de21a25-ff40-46b3-aaca-1ddcdfe35cca admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:56.759592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de21a25-ff40-46b3-aaca-1ddcdfe35cca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:56.761195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de21a25-ff40-46b3-aaca-1ddcdfe35cca admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:56.771945 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1031/2055] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:56.776369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edd371-5c95-4b7d-80f4-20304ca87767 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:56.787226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8edd371-5c95-4b7d-80f4-20304ca87767 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:56.792493 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ec87ef-e625-472a-94ac-18192c5a493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:56.793814 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec87ef-e625-472a-94ac-18192c5a493b admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:56.794128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec87ef-e625-472a-94ac-18192c5a493b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:56.794402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ec87ef-e625-472a-94ac-18192c5a493b admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:56.795052 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec87ef-e625-472a-94ac-18192c5a493b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:56.796650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ec87ef-e625-472a-94ac-18192c5a493b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:56.808708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1025/2056] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:56.813456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de21a25-ff40-46b3-aaca-1ddcdfe35cca admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:56.824242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de21a25-ff40-46b3-aaca-1ddcdfe35cca admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:56.830045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae01467-116b-4c85-863f-14a08d803063 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:56.830653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae01467-116b-4c85-863f-14a08d803063 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:56.830928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae01467-116b-4c85-863f-14a08d803063 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:56.831194 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae01467-116b-4c85-863f-14a08d803063 admin admin] PATH_INFO: `/v3/projects/ba8c8155267948a99eafaceb0f6305f4/users/aee9e37550904aaf8b9276d86c78b2f5/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:56.849394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae01467-116b-4c85-863f-14a08d803063 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ba8c8155267948a99eafaceb0f6305f4, user_id=aee9e37550904aaf8b9276d86c78b2f5, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:56.852168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae01467-116b-4c85-863f-14a08d803063 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:56.867642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1032/2057] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:56 2022] PUT /identity/v3/projects/ba8c8155267948a99eafaceb0f6305f4/users/aee9e37550904aaf8b9276d86c78b2f5/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:56.879034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c072b65-6c68-4b80-801e-a705d09457cc None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:56.879248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c072b65-6c68-4b80-801e-a705d09457cc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:56.879504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c072b65-6c68-4b80-801e-a705d09457cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:56.910315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1c072b65-6c68-4b80-801e-a705d09457cc None None] MFA Rules not processed for user `aee9e37550904aaf8b9276d86c78b2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:56.911534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1c072b65-6c68-4b80-801e-a705d09457cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:56.981094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1026/2058] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:56 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:56.993777 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae01467-116b-4c85-863f-14a08d803063 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:56.995836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5ae01467-116b-4c85-863f-14a08d803063 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:57.057468 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae01467-116b-4c85-863f-14a08d803063 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:57.062877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4b316-bc51-4c62-9331-f2e81bc0668b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06d8a144ecf43fc8de82346758b6065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:57.063531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4b316-bc51-4c62-9331-f2e81bc0668b service glance] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:57.063809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4b316-bc51-4c62-9331-f2e81bc0668b service glance] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:57.064104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4b316-bc51-4c62-9331-f2e81bc0668b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:57.075135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4b316-bc51-4c62-9331-f2e81bc0668b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:57.076692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4b316-bc51-4c62-9331-f2e81bc0668b service glance] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:57.086617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1033/2059] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:57.451073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c072b65-6c68-4b80-801e-a705d09457cc None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:57.453292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1c072b65-6c68-4b80-801e-a705d09457cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:57.513225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:57.566637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c072b65-6c68-4b80-801e-a705d09457cc None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:57.573016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:57.573771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:57.574538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:57.574886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] PATH_INFO: `/v3/users/fe6053781b34483db60512c7c3cc4667` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:57.576487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe6053781b34483db60512c7c3cc4667)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:57.578788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:57.676935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe6053781b34483db60512c7c3cc4667'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:57.688821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe6053781b34483db60512c7c3cc4667'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:57.689959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe6053781b34483db60512c7c3cc4667'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:57.690864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe6053781b34483db60512c7c3cc4667'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:57.703349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe6053781b34483db60512c7c3cc4667'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:57.735990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1027/2060] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:57 2022] DELETE /identity/v3/users/fe6053781b34483db60512c7c3cc4667 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:19:57.741846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d4663-f3c0-4f29-ad1c-c8e77a936c3b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:57.742368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d4663-f3c0-4f29-ad1c-c8e77a936c3b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:57.742767 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592d4663-f3c0-4f29-ad1c-c8e77a936c3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:57.804653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-592d4663-f3c0-4f29-ad1c-c8e77a936c3b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:57.806736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-592d4663-f3c0-4f29-ad1c-c8e77a936c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:57.892037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1034/2061] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:57.900738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:57.902622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:57.978891 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63830c2-c111-4355-a1e8-b9004255c2b0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:57.982896 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2d0b3-e3b5-464c-9de8-5496b3be6e64 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:57.983788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2d0b3-e3b5-464c-9de8-5496b3be6e64 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:57.984197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2d0b3-e3b5-464c-9de8-5496b3be6e64 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:57.984339 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a2d0b3-e3b5-464c-9de8-5496b3be6e64 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:57.994524 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2d0b3-e3b5-464c-9de8-5496b3be6e64 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:57.996825 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a2d0b3-e3b5-464c-9de8-5496b3be6e64 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:58.007520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1028/2062] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:19:58.301983 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d4663-f3c0-4f29-ad1c-c8e77a936c3b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:58.304291 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-592d4663-f3c0-4f29-ad1c-c8e77a936c3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:58.324194 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592d4663-f3c0-4f29-ad1c-c8e77a936c3b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:58.330968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:58.332028 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:58.332334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:58.332591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] PATH_INFO: `/v3/projects/d29d7875469e48ad8364713325d0b018` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:58.333817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d29d7875469e48ad8364713325d0b018)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:58.335761 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:58.390353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd29d7875469e48ad8364713325d0b018', 'request_id': 'req-bc0d4f10-96af-4fca-86c3-6efdec8f018e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:58.391477 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:58.399192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd29d7875469e48ad8364713325d0b018', 'request_id': 'req-bc0d4f10-96af-4fca-86c3-6efdec8f018e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:58.408579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd29d7875469e48ad8364713325d0b018', 'request_id': 'req-bc0d4f10-96af-4fca-86c3-6efdec8f018e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:58.419664 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] The token cache is being invalidate because project d29d7875469e48ad8364713325d0b018 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:58.419948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:58.420624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:58.422304 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1035/2063] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:58 2022] DELETE /identity/v3/projects/d29d7875469e48ad8364713325d0b018 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:58.426553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2d0b3-e3b5-464c-9de8-5496b3be6e64 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:58.436915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a2d0b3-e3b5-464c-9de8-5496b3be6e64 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:58.503738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b29495-6f80-40c2-8079-e2dbbfc18402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:58.504592 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b29495-6f80-40c2-8079-e2dbbfc18402 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:58.504857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b29495-6f80-40c2-8079-e2dbbfc18402 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:58.505337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b29495-6f80-40c2-8079-e2dbbfc18402 admin admin] PATH_INFO: `/v3/users/9d659d5df88e4857a378de3d1204d223` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:58.506981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b29495-6f80-40c2-8079-e2dbbfc18402 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d659d5df88e4857a378de3d1204d223)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:58.508969 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b29495-6f80-40c2-8079-e2dbbfc18402 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:58.512325 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:58.576720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c4b29495-6f80-40c2-8079-e2dbbfc18402 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d659d5df88e4857a378de3d1204d223'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:58.590494 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c4b29495-6f80-40c2-8079-e2dbbfc18402 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d659d5df88e4857a378de3d1204d223'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:58.591483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c4b29495-6f80-40c2-8079-e2dbbfc18402 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d659d5df88e4857a378de3d1204d223'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:58.594241 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c4b29495-6f80-40c2-8079-e2dbbfc18402 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d659d5df88e4857a378de3d1204d223'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:58.604856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c4b29495-6f80-40c2-8079-e2dbbfc18402 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d659d5df88e4857a378de3d1204d223'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:58.632080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1029/2064] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:19:58 2022] DELETE /identity/v3/users/9d659d5df88e4857a378de3d1204d223 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:58.971377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:58.975751 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:58.992892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d4f10-96af-4fca-86c3-6efdec8f018e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:59.000156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d11ef-21a8-44b9-93e4-1aefae9d7332 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:59.000519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d11ef-21a8-44b9-93e4-1aefae9d7332 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:59.000705 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3d11ef-21a8-44b9-93e4-1aefae9d7332 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:59.027367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3b3d11ef-21a8-44b9-93e4-1aefae9d7332 None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:59.029541 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3b3d11ef-21a8-44b9-93e4-1aefae9d7332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:59.069574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ae5dea-3cdd-4334-811a-d5c228d93338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:59.070791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5dea-3cdd-4334-811a-d5c228d93338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:59.071085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5dea-3cdd-4334-811a-d5c228d93338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:59.071444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ae5dea-3cdd-4334-811a-d5c228d93338 admin admin] PATH_INFO: `/v3/projects/f414bde1c9e04c1cb9cb0afe93fab9a2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:59.072715 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae5dea-3cdd-4334-811a-d5c228d93338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f414bde1c9e04c1cb9cb0afe93fab9a2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:59.074945 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ae5dea-3cdd-4334-811a-d5c228d93338 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:59.103014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1030/2065] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:19:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:59.141851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-44ae5dea-3cdd-4334-811a-d5c228d93338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f414bde1c9e04c1cb9cb0afe93fab9a2', 'request_id': 'req-44ae5dea-3cdd-4334-811a-d5c228d93338'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:59.150363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-44ae5dea-3cdd-4334-811a-d5c228d93338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f414bde1c9e04c1cb9cb0afe93fab9a2', 'request_id': 'req-44ae5dea-3cdd-4334-811a-d5c228d93338'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:59.151163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d11ef-21a8-44b9-93e4-1aefae9d7332 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:59.152703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3b3d11ef-21a8-44b9-93e4-1aefae9d7332 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:59.161238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-44ae5dea-3cdd-4334-811a-d5c228d93338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f414bde1c9e04c1cb9cb0afe93fab9a2', 'request_id': 'req-44ae5dea-3cdd-4334-811a-d5c228d93338'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:59.173950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-44ae5dea-3cdd-4334-811a-d5c228d93338 admin admin] The token cache is being invalidate because project f414bde1c9e04c1cb9cb0afe93fab9a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:19:59.174341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-44ae5dea-3cdd-4334-811a-d5c228d93338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:59.175561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-44ae5dea-3cdd-4334-811a-d5c228d93338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:19:59.177255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1036/2066] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:19:58 2022] DELETE /identity/v3/projects/f414bde1c9e04c1cb9cb0afe93fab9a2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:59.182124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e880fb-530c-462a-9931-d09c45dea725 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:59.182403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e880fb-530c-462a-9931-d09c45dea725 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:59.182659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e880fb-530c-462a-9931-d09c45dea725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:59.203966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a6e880fb-530c-462a-9931-d09c45dea725 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:59.205234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a6e880fb-530c-462a-9931-d09c45dea725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:59.245443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3d11ef-21a8-44b9-93e4-1aefae9d7332 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:59.272253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1037/2067] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:19:59.277938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:59.280346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ffa38-5c8e-48cb-8bae-6a96806a843f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:59.280525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ffa38-5c8e-48cb-8bae-6a96806a843f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:59.280806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ffa38-5c8e-48cb-8bae-6a96806a843f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:59.308118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-440ffa38-5c8e-48cb-8bae-6a96806a843f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:59.309544 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-440ffa38-5c8e-48cb-8bae-6a96806a843f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:59.320592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1038/2068] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:19:59.324778 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fc1d3-db79-4ac4-914c-3d5dcde77927 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:59.325748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc1d3-db79-4ac4-914c-3d5dcde77927 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:59.326064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc1d3-db79-4ac4-914c-3d5dcde77927 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:59.326332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fc1d3-db79-4ac4-914c-3d5dcde77927 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:59.326860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ffa38-5c8e-48cb-8bae-6a96806a843f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:59.328474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-843fc1d3-db79-4ac4-914c-3d5dcde77927 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:59.338922 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:59.341105 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ffa38-5c8e-48cb-8bae-6a96806a843f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:59.350493 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4d203-e14c-4cff-89a9-8538a9f9063d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:59.351184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4d203-e14c-4cff-89a9-8538a9f9063d admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:59.351470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4d203-e14c-4cff-89a9-8538a9f9063d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:59.351941 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b4d203-e14c-4cff-89a9-8538a9f9063d admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:59.352710 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4d203-e14c-4cff-89a9-8538a9f9063d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:19:59.353180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4d203-e14c-4cff-89a9-8538a9f9063d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:59.354993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b4d203-e14c-4cff-89a9-8538a9f9063d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:59.370571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1039/2069] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:19:59.375931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4d203-e14c-4cff-89a9-8538a9f9063d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:59.387402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b4d203-e14c-4cff-89a9-8538a9f9063d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:59.392582 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dd81a-b40c-4a9e-bcf6-c3bd3ad458ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:59.393374 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dd81a-b40c-4a9e-bcf6-c3bd3ad458ce admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:59.393814 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dd81a-b40c-4a9e-bcf6-c3bd3ad458ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:59.394168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731dd81a-b40c-4a9e-bcf6-c3bd3ad458ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:59.394999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dd81a-b40c-4a9e-bcf6-c3bd3ad458ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:59.397008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731dd81a-b40c-4a9e-bcf6-c3bd3ad458ce admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:59.406097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fc1d3-db79-4ac4-914c-3d5dcde77927 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:59.407805 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fc1d3-db79-4ac4-914c-3d5dcde77927 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:59.417433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1031/2070] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:19:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 19:19:59.442230 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1040/2071] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:59 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:19:59.446523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fc1d3-db79-4ac4-914c-3d5dcde77927 service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:59.459872 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fc1d3-db79-4ac4-914c-3d5dcde77927 service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:59.544078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693e6d8-7ea8-4e2c-8432-15f379fff827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:59.544719 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693e6d8-7ea8-4e2c-8432-15f379fff827 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:59.544995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693e6d8-7ea8-4e2c-8432-15f379fff827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:59.545290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6693e6d8-7ea8-4e2c-8432-15f379fff827 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:59.545961 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693e6d8-7ea8-4e2c-8432-15f379fff827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:59.547907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6693e6d8-7ea8-4e2c-8432-15f379fff827 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:59.572896 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1032/2072] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:19:59 2022] POST /identity/v3/users => generated 293 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:19:59.577074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dd81a-b40c-4a9e-bcf6-c3bd3ad458ce admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:59.589464 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731dd81a-b40c-4a9e-bcf6-c3bd3ad458ce admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:59.595742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c4ec1-1715-4701-ad0e-5a1dd6253e9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:59.596379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c4ec1-1715-4701-ad0e-5a1dd6253e9a admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:59.596663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c4ec1-1715-4701-ad0e-5a1dd6253e9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:59.596926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264c4ec1-1715-4701-ad0e-5a1dd6253e9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:59.597577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c4ec1-1715-4701-ad0e-5a1dd6253e9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:59.599254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264c4ec1-1715-4701-ad0e-5a1dd6253e9a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:59.615645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1041/2073] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:19:59.617096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693e6d8-7ea8-4e2c-8432-15f379fff827 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:59.629301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6693e6d8-7ea8-4e2c-8432-15f379fff827 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:59.635400 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6c732c-34d9-45ae-b461-3d0aa5d62999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:59.635997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c732c-34d9-45ae-b461-3d0aa5d62999 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:59.636459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c732c-34d9-45ae-b461-3d0aa5d62999 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:59.637568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6c732c-34d9-45ae-b461-3d0aa5d62999 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:59.638291 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c732c-34d9-45ae-b461-3d0aa5d62999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:59.639913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6c732c-34d9-45ae-b461-3d0aa5d62999 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:59.650949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1033/2074] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:19:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:19:59.656410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c4ec1-1715-4701-ad0e-5a1dd6253e9a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:59.666771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264c4ec1-1715-4701-ad0e-5a1dd6253e9a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:59.673757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a7f65-0ca7-46b8-badb-8fbdac466af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:59.674487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a7f65-0ca7-46b8-badb-8fbdac466af8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:59.674764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a7f65-0ca7-46b8-badb-8fbdac466af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:59.675035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a7f65-0ca7-46b8-badb-8fbdac466af8 admin admin] PATH_INFO: `/v3/projects/b79aa4de989c4885b320f5f5c438759e/users/bb2a1729d5a740698b603b5d62b0f73a/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:59.692432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a7f65-0ca7-46b8-badb-8fbdac466af8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b79aa4de989c4885b320f5f5c438759e, user_id=bb2a1729d5a740698b603b5d62b0f73a, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:59.695493 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a7f65-0ca7-46b8-badb-8fbdac466af8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:19:59.714665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1042/2075] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:19:59 2022] PUT /identity/v3/projects/b79aa4de989c4885b320f5f5c438759e/users/bb2a1729d5a740698b603b5d62b0f73a/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:19:59.726289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6657a-09e1-476e-8eeb-1f168bece8e9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:59.726577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6657a-09e1-476e-8eeb-1f168bece8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:59.726845 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6657a-09e1-476e-8eeb-1f168bece8e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:59.757472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-05f6657a-09e1-476e-8eeb-1f168bece8e9 None None] MFA Rules not processed for user `bb2a1729d5a740698b603b5d62b0f73a`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:19:59.758752 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-05f6657a-09e1-476e-8eeb-1f168bece8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:19:59.812897 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:19:59.867856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1034/2076] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:19:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:19:59.874073 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a7f65-0ca7-46b8-badb-8fbdac466af8 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:19:59.968226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a7f65-0ca7-46b8-badb-8fbdac466af8 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:19:59.973259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ee741-3e1a-4f68-8251-a043787c3425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:19:59.974099 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ee741-3e1a-4f68-8251-a043787c3425 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:19:59.974254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ee741-3e1a-4f68-8251-a043787c3425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:19:59.974528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ee741-3e1a-4f68-8251-a043787c3425 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:19:59.975208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ee741-3e1a-4f68-8251-a043787c3425 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:19:59.978839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ee741-3e1a-4f68-8251-a043787c3425 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:00.009216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1043/2077] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:19:59 2022] POST /identity/v3/projects => generated 387 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:20:00.014497 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6657a-09e1-476e-8eeb-1f168bece8e9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:00.027963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6657a-09e1-476e-8eeb-1f168bece8e9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:00.047519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b6dcd-b208-44c3-a0a4-22b240c25109 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:00.047920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b6dcd-b208-44c3-a0a4-22b240c25109 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:00.048140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290b6dcd-b208-44c3-a0a4-22b240c25109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:00.071816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-290b6dcd-b208-44c3-a0a4-22b240c25109 None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:00.073180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-290b6dcd-b208-44c3-a0a4-22b240c25109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:00.096470 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9beb-c7db-435f-a954-4b5d6cbfeedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:00.097195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9beb-c7db-435f-a954-4b5d6cbfeedc admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:00.097536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9beb-c7db-435f-a954-4b5d6cbfeedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:00.097895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2b9beb-c7db-435f-a954-4b5d6cbfeedc admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:00.098602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b9beb-c7db-435f-a954-4b5d6cbfeedc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:00.100619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2b9beb-c7db-435f-a954-4b5d6cbfeedc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:00.126111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1035/2078] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:20:00 2022] POST /identity/v3/users => generated 300 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:20:00.130354 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9beb-c7db-435f-a954-4b5d6cbfeedc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:00.139618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1044/2079] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 15 19:20:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:20:00.141270 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2b9beb-c7db-435f-a954-4b5d6cbfeedc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:00.145986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95f68b-9a42-40e1-b5f3-22b7403a4dae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:00.146595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f68b-9a42-40e1-b5f3-22b7403a4dae admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:00.146903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f68b-9a42-40e1-b5f3-22b7403a4dae admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:00.147171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f68b-9a42-40e1-b5f3-22b7403a4dae admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:00.147823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95f68b-9a42-40e1-b5f3-22b7403a4dae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:00.149415 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95f68b-9a42-40e1-b5f3-22b7403a4dae admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:00.153429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b6dcd-b208-44c3-a0a4-22b240c25109 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:00.155237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-290b6dcd-b208-44c3-a0a4-22b240c25109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:00.160667 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1036/2080] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:20:00.165135 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95f68b-9a42-40e1-b5f3-22b7403a4dae admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:00.176542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95f68b-9a42-40e1-b5f3-22b7403a4dae admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:00.181243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d92c7-f6fa-49be-826d-6f4cac525b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:00.181945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d92c7-f6fa-49be-826d-6f4cac525b86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:00.182230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d92c7-f6fa-49be-826d-6f4cac525b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:00.182505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d92c7-f6fa-49be-826d-6f4cac525b86 admin admin] PATH_INFO: `/v3/projects/d598a494fe2243a29eafa844834956a1/users/7df9859f1ec4403cb65341739414bbfa/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:00.183863 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:00.200589 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d92c7-f6fa-49be-826d-6f4cac525b86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d598a494fe2243a29eafa844834956a1, user_id=7df9859f1ec4403cb65341739414bbfa, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:00.203326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d92c7-f6fa-49be-826d-6f4cac525b86 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:00.221978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1037/2081] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:20:00 2022] PUT /identity/v3/projects/d598a494fe2243a29eafa844834956a1/users/7df9859f1ec4403cb65341739414bbfa/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:20:00.225989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d92c7-f6fa-49be-826d-6f4cac525b86 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:00.236914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290b6dcd-b208-44c3-a0a4-22b240c25109 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:00.300907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d92c7-f6fa-49be-826d-6f4cac525b86 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:00.306779 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eefa3e-cba6-4cad-accb-154d61bc8c77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:00.307484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eefa3e-cba6-4cad-accb-154d61bc8c77 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:00.307762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eefa3e-cba6-4cad-accb-154d61bc8c77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:00.308032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5eefa3e-cba6-4cad-accb-154d61bc8c77 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:00.309480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eefa3e-cba6-4cad-accb-154d61bc8c77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:00.311195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5eefa3e-cba6-4cad-accb-154d61bc8c77 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:00.314785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f989789-aa24-41ff-89d0-3edcb54ebe8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:00.315616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f989789-aa24-41ff-89d0-3edcb54ebe8d service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:00.315925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f989789-aa24-41ff-89d0-3edcb54ebe8d service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:00.316196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f989789-aa24-41ff-89d0-3edcb54ebe8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:00.322476 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1038/2082] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:00 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:20:00.327122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eefa3e-cba6-4cad-accb-154d61bc8c77 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:00.337346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5eefa3e-cba6-4cad-accb-154d61bc8c77 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:00.342586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8693bc72-a69c-4244-82ce-680d967abcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:00.343268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693bc72-a69c-4244-82ce-680d967abcff admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:00.343550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693bc72-a69c-4244-82ce-680d967abcff admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:00.344032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8693bc72-a69c-4244-82ce-680d967abcff admin admin] PATH_INFO: `/v3/projects/d598a494fe2243a29eafa844834956a1/users/7df9859f1ec4403cb65341739414bbfa/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:00.345874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693bc72-a69c-4244-82ce-680d967abcff admin admin] RBAC: Authorizing `identity:create_grant(project_id=d598a494fe2243a29eafa844834956a1, user_id=7df9859f1ec4403cb65341739414bbfa, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:00.348674 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8693bc72-a69c-4244-82ce-680d967abcff admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:00.361834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1039/2083] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:20:00 2022] PUT /identity/v3/projects/d598a494fe2243a29eafa844834956a1/users/7df9859f1ec4403cb65341739414bbfa/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:20:00.373497 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91e7ce-8469-41b5-988a-a813efb62552 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:00.373984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91e7ce-8469-41b5-988a-a813efb62552 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:00.374264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a91e7ce-8469-41b5-988a-a813efb62552 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:00.381119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f989789-aa24-41ff-89d0-3edcb54ebe8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:00.382871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f989789-aa24-41ff-89d0-3edcb54ebe8d service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:00.395208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1045/2084] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:20:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 19:20:00.409113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6a91e7ce-8469-41b5-988a-a813efb62552 None None] MFA Rules not processed for user `7df9859f1ec4403cb65341739414bbfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:00.410398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6a91e7ce-8469-41b5-988a-a813efb62552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:00.414668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:00.495107 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1040/2085] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:00 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:20:00.508948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f989789-aa24-41ff-89d0-3edcb54ebe8d service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:00.510564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3f989789-aa24-41ff-89d0-3edcb54ebe8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:00.584768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f989789-aa24-41ff-89d0-3edcb54ebe8d service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:00.606595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:00.644006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2ed6f-e242-43af-8af9-abf30a010845 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:00.644623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2ed6f-e242-43af-8af9-abf30a010845 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:00.644895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2ed6f-e242-43af-8af9-abf30a010845 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:00.645233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b2ed6f-e242-43af-8af9-abf30a010845 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:00.656460 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2ed6f-e242-43af-8af9-abf30a010845 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:00.657952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b2ed6f-e242-43af-8af9-abf30a010845 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:00.674003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1046/2086] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:00 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:00.681735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccc28e-5069-4106-8987-7b0054b992fe None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:00.682254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccc28e-5069-4106-8987-7b0054b992fe None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:00.682254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fccc28e-5069-4106-8987-7b0054b992fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:00.704844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2fccc28e-5069-4106-8987-7b0054b992fe None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:00.706406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2fccc28e-5069-4106-8987-7b0054b992fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:00.709639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2ed6f-e242-43af-8af9-abf30a010845 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:00.771122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1041/2087] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:20:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:00.779058 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b2ed6f-e242-43af-8af9-abf30a010845 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:00.784824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccc28e-5069-4106-8987-7b0054b992fe None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:00.785383 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196c7ff-fb24-4893-9abd-d40d6685447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:00.786082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196c7ff-fb24-4893-9abd-d40d6685447f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:00.786589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196c7ff-fb24-4893-9abd-d40d6685447f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:00.786867 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196c7ff-fb24-4893-9abd-d40d6685447f admin admin] PATH_INFO: `/v3/users/bb2a1729d5a740698b603b5d62b0f73a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:00.788043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196c7ff-fb24-4893-9abd-d40d6685447f admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb2a1729d5a740698b603b5d62b0f73a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:00.790160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196c7ff-fb24-4893-9abd-d40d6685447f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:00.845388 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c196c7ff-fb24-4893-9abd-d40d6685447f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb2a1729d5a740698b603b5d62b0f73a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:00.856062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c196c7ff-fb24-4893-9abd-d40d6685447f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb2a1729d5a740698b603b5d62b0f73a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:00.856955 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c196c7ff-fb24-4893-9abd-d40d6685447f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb2a1729d5a740698b603b5d62b0f73a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:00.857659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c196c7ff-fb24-4893-9abd-d40d6685447f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb2a1729d5a740698b603b5d62b0f73a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:00.866901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-c196c7ff-fb24-4893-9abd-d40d6685447f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb2a1729d5a740698b603b5d62b0f73a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:00.871533 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fccc28e-5069-4106-8987-7b0054b992fe None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:00.875108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebf4c6-69a9-4c7c-9c23-aa5a0bac8172 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:00.875441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf4c6-69a9-4c7c-9c23-aa5a0bac8172 service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:00.875718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf4c6-69a9-4c7c-9c23-aa5a0bac8172 service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:00.875989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ebf4c6-69a9-4c7c-9c23-aa5a0bac8172 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:00.878168 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c7ebf4c6-69a9-4c7c-9c23-aa5a0bac8172 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:00.892172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1047/2088] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:20:00 2022] DELETE /identity/v3/users/bb2a1729d5a740698b603b5d62b0f73a => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:00.892758 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebf4c6-69a9-4c7c-9c23-aa5a0bac8172 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:00.895056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ebf4c6-69a9-4c7c-9c23-aa5a0bac8172 service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:00.899326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f393b1-5cad-467c-9c9b-05f24fa490e9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:00.899326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f393b1-5cad-467c-9c9b-05f24fa490e9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:00.899326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f393b1-5cad-467c-9c9b-05f24fa490e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:00.904851 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1042/2089] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:20:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 19:20:00.921703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-93f393b1-5cad-467c-9c9b-05f24fa490e9 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:00.923453 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-93f393b1-5cad-467c-9c9b-05f24fa490e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:00.989008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:01.026139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1048/2090] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:01.040265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebf4c6-69a9-4c7c-9c23-aa5a0bac8172 service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:01.042000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c7ebf4c6-69a9-4c7c-9c23-aa5a0bac8172 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:01.092927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:01.118113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ebf4c6-69a9-4c7c-9c23-aa5a0bac8172 service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:01.183709 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c742c-4691-4223-964f-4c4269b96b44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:01.184893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c742c-4691-4223-964f-4c4269b96b44 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:01.185044 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c742c-4691-4223-964f-4c4269b96b44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:01.185316 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926c742c-4691-4223-964f-4c4269b96b44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:01.201055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c742c-4691-4223-964f-4c4269b96b44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:01.202616 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926c742c-4691-4223-964f-4c4269b96b44 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:01.217105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1043/2091] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:01.365936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcaffd-8103-4988-9cf0-17d400f537a5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:01.366221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcaffd-8103-4988-9cf0-17d400f537a5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:01.366506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dcaffd-8103-4988-9cf0-17d400f537a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:01.390695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e7dcaffd-8103-4988-9cf0-17d400f537a5 None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:01.392233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e7dcaffd-8103-4988-9cf0-17d400f537a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:01.465262 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1049/2092] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 15 19:20:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:01.479586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c742c-4691-4223-964f-4c4269b96b44 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:01.482068 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-926c742c-4691-4223-964f-4c4269b96b44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:01.556577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcaffd-8103-4988-9cf0-17d400f537a5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:01.558387 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e7dcaffd-8103-4988-9cf0-17d400f537a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:01.574702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dcaffd-8103-4988-9cf0-17d400f537a5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:01.575165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926c742c-4691-4223-964f-4c4269b96b44 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:01.584395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c3cd5-8533-422f-a51a-7c277d527d1b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:01.584991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:01.585282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c3cd5-8533-422f-a51a-7c277d527d1b service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:01.585562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c3cd5-8533-422f-a51a-7c277d527d1b service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:01.585720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:01.585886 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2c3cd5-8533-422f-a51a-7c277d527d1b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:01.586012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:01.586198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] PATH_INFO: `/v3/projects/b79aa4de989c4885b320f5f5c438759e` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:01.587353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b79aa4de989c4885b320f5f5c438759e)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:01.590746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:01.603838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c3cd5-8533-422f-a51a-7c277d527d1b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:01.607828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2c3cd5-8533-422f-a51a-7c277d527d1b service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:01.618069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1044/2093] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:20:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 19:20:01.658981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b79aa4de989c4885b320f5f5c438759e', 'request_id': 'req-245b5fb0-455c-415f-a48a-5dbc77eea9e1'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:01.666111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b79aa4de989c4885b320f5f5c438759e', 'request_id': 'req-245b5fb0-455c-415f-a48a-5dbc77eea9e1'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:01.675967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b79aa4de989c4885b320f5f5c438759e', 'request_id': 'req-245b5fb0-455c-415f-a48a-5dbc77eea9e1'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:01.689455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] The token cache is being invalidate because project b79aa4de989c4885b320f5f5c438759e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:20:01.689866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:01.690908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:01.692381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1050/2094] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:20:01 2022] DELETE /identity/v3/projects/b79aa4de989c4885b320f5f5c438759e => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:20:01.696974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c3cd5-8533-422f-a51a-7c277d527d1b service swift] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:01.709065 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2c3cd5-8533-422f-a51a-7c277d527d1b service swift] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:01.775316 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768c2f24-fa8a-474c-b666-bff62fbdbee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:01.775961 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c2f24-fa8a-474c-b666-bff62fbdbee8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:01.776254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c2f24-fa8a-474c-b666-bff62fbdbee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:01.776511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768c2f24-fa8a-474c-b666-bff62fbdbee8 admin admin] PATH_INFO: `/v3/users/7df9859f1ec4403cb65341739414bbfa` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:01.777768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c2f24-fa8a-474c-b666-bff62fbdbee8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7df9859f1ec4403cb65341739414bbfa)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:01.779755 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768c2f24-fa8a-474c-b666-bff62fbdbee8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:01.821126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:01.853854 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-768c2f24-fa8a-474c-b666-bff62fbdbee8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7df9859f1ec4403cb65341739414bbfa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:01.864885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-768c2f24-fa8a-474c-b666-bff62fbdbee8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7df9859f1ec4403cb65341739414bbfa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:01.866075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-768c2f24-fa8a-474c-b666-bff62fbdbee8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7df9859f1ec4403cb65341739414bbfa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:01.866831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-768c2f24-fa8a-474c-b666-bff62fbdbee8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7df9859f1ec4403cb65341739414bbfa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:01.876708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-768c2f24-fa8a-474c-b666-bff62fbdbee8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7df9859f1ec4403cb65341739414bbfa'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:01.915542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1045/2095] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:20:01 2022] DELETE /identity/v3/users/7df9859f1ec4403cb65341739414bbfa => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:02.318919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:02.321109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:02.339077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245b5fb0-455c-415f-a48a-5dbc77eea9e1 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:02.434676 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aaf542c-2417-4cf3-9165-02344728c85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:02.435347 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf542c-2417-4cf3-9165-02344728c85e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:02.435634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf542c-2417-4cf3-9165-02344728c85e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:02.435916 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aaf542c-2417-4cf3-9165-02344728c85e admin admin] PATH_INFO: `/v3/projects/d598a494fe2243a29eafa844834956a1` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:02.437474 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf542c-2417-4cf3-9165-02344728c85e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d598a494fe2243a29eafa844834956a1)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:02.439505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aaf542c-2417-4cf3-9165-02344728c85e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:02.458579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:02.504030 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5aaf542c-2417-4cf3-9165-02344728c85e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd598a494fe2243a29eafa844834956a1', 'request_id': 'req-5aaf542c-2417-4cf3-9165-02344728c85e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:02.512679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5aaf542c-2417-4cf3-9165-02344728c85e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd598a494fe2243a29eafa844834956a1', 'request_id': 'req-5aaf542c-2417-4cf3-9165-02344728c85e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:02.522525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5aaf542c-2417-4cf3-9165-02344728c85e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd598a494fe2243a29eafa844834956a1', 'request_id': 'req-5aaf542c-2417-4cf3-9165-02344728c85e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:02.535265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5aaf542c-2417-4cf3-9165-02344728c85e admin admin] The token cache is being invalidate because project d598a494fe2243a29eafa844834956a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:20:02.535559 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5aaf542c-2417-4cf3-9165-02344728c85e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:02.536225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5aaf542c-2417-4cf3-9165-02344728c85e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:02.537911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1051/2096] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:20:02 2022] DELETE /identity/v3/projects/d598a494fe2243a29eafa844834956a1 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:02.544068 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0f3eb-c5bb-41c8-bd07-182d004147e9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:02.544352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0f3eb-c5bb-41c8-bd07-182d004147e9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:02.544621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c0f3eb-c5bb-41c8-bd07-182d004147e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:02.568950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-56c0f3eb-c5bb-41c8-bd07-182d004147e9 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:02.570931 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-56c0f3eb-c5bb-41c8-bd07-182d004147e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:02.653964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1046/2097] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:02.661122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f232a5-f226-4c52-93c5-98ce67cb1fde None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:02.661547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f232a5-f226-4c52-93c5-98ce67cb1fde None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:02.661915 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f232a5-f226-4c52-93c5-98ce67cb1fde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:02.687818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-10f232a5-f226-4c52-93c5-98ce67cb1fde None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:02.689018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-10f232a5-f226-4c52-93c5-98ce67cb1fde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:02.698632 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1052/2098] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:02.703950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0f3eb-c5bb-41c8-bd07-182d004147e9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:02.717118 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c0f3eb-c5bb-41c8-bd07-182d004147e9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:02.722094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c4739-2169-49a4-8958-61e68699f81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:02.722713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c4739-2169-49a4-8958-61e68699f81f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:02.722993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c4739-2169-49a4-8958-61e68699f81f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:02.723261 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5c4739-2169-49a4-8958-61e68699f81f admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:02.724015 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c4739-2169-49a4-8958-61e68699f81f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:20:02.724317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c4739-2169-49a4-8958-61e68699f81f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:02.726119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5c4739-2169-49a4-8958-61e68699f81f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:02.738989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1047/2099] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:20:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:20:02.745969 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f232a5-f226-4c52-93c5-98ce67cb1fde None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:02.755999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f232a5-f226-4c52-93c5-98ce67cb1fde None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:02.760855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296ce3b-7d3c-44c3-8041-5e30d8607e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:02.761635 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296ce3b-7d3c-44c3-8041-5e30d8607e47 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:02.762050 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296ce3b-7d3c-44c3-8041-5e30d8607e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:02.762326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5296ce3b-7d3c-44c3-8041-5e30d8607e47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:02.762963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296ce3b-7d3c-44c3-8041-5e30d8607e47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:02.764877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5296ce3b-7d3c-44c3-8041-5e30d8607e47 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:02.807031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1053/2100] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:20:02 2022] POST /identity/v3/projects => generated 389 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:20:02.814641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c4739-2169-49a4-8958-61e68699f81f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:02.831687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5c4739-2169-49a4-8958-61e68699f81f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:02.905940 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1842da2-e5b1-443c-a06e-6ded8f7a78f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:02.906637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1842da2-e5b1-443c-a06e-6ded8f7a78f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:02.906847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1842da2-e5b1-443c-a06e-6ded8f7a78f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:02.907107 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1842da2-e5b1-443c-a06e-6ded8f7a78f4 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:02.907750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1842da2-e5b1-443c-a06e-6ded8f7a78f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:02.909884 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1842da2-e5b1-443c-a06e-6ded8f7a78f4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:02.933505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1048/2101] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:20:02 2022] POST /identity/v3/users => generated 295 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:20:02.938360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296ce3b-7d3c-44c3-8041-5e30d8607e47 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:02.950905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5296ce3b-7d3c-44c3-8041-5e30d8607e47 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:02.956714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c4b26-50b7-4bf8-87db-85edb01fa723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:02.957481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c4b26-50b7-4bf8-87db-85edb01fa723 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:02.958023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c4b26-50b7-4bf8-87db-85edb01fa723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:02.958343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0c4b26-50b7-4bf8-87db-85edb01fa723 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:02.959125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c4b26-50b7-4bf8-87db-85edb01fa723 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:02.960791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0c4b26-50b7-4bf8-87db-85edb01fa723 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:02.973297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1054/2102] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:20:02.977946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1842da2-e5b1-443c-a06e-6ded8f7a78f4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:02.989244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1842da2-e5b1-443c-a06e-6ded8f7a78f4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:02.995053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e6afb3-a25a-4e35-8396-add7b5bf3285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:02.995937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6afb3-a25a-4e35-8396-add7b5bf3285 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:02.996208 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6afb3-a25a-4e35-8396-add7b5bf3285 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:02.996486 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e6afb3-a25a-4e35-8396-add7b5bf3285 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:02.997265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6afb3-a25a-4e35-8396-add7b5bf3285 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:02.998912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e6afb3-a25a-4e35-8396-add7b5bf3285 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:03.010536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1049/2103] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:02 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:20:03.015902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c4b26-50b7-4bf8-87db-85edb01fa723 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:03.029334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0c4b26-50b7-4bf8-87db-85edb01fa723 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:03.034899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96f586-0b3b-4482-b02f-152701781bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:03.035584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96f586-0b3b-4482-b02f-152701781bcd admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:03.035861 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96f586-0b3b-4482-b02f-152701781bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:03.036131 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a96f586-0b3b-4482-b02f-152701781bcd admin admin] PATH_INFO: `/v3/projects/7232dac4c0db4f5590325e005049745f/users/785a31d0392942a08362cf7b8014be90/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:03.054379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96f586-0b3b-4482-b02f-152701781bcd admin admin] RBAC: Authorizing `identity:create_grant(project_id=7232dac4c0db4f5590325e005049745f, user_id=785a31d0392942a08362cf7b8014be90, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:03.057476 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a96f586-0b3b-4482-b02f-152701781bcd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:03.079063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1055/2104] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:20:03 2022] PUT /identity/v3/projects/7232dac4c0db4f5590325e005049745f/users/785a31d0392942a08362cf7b8014be90/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:03.091942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960243-104b-45cf-9247-7b0790b84f79 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:03.092222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960243-104b-45cf-9247-7b0790b84f79 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:03.092544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da960243-104b-45cf-9247-7b0790b84f79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:03.131437 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:03.146257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-da960243-104b-45cf-9247-7b0790b84f79 None None] MFA Rules not processed for user `785a31d0392942a08362cf7b8014be90`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:03.147642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-da960243-104b-45cf-9247-7b0790b84f79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:03.225524 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1050/2105] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:03 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:03.230569 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96f586-0b3b-4482-b02f-152701781bcd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:03.319679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a96f586-0b3b-4482-b02f-152701781bcd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:03.325510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fbcbf-d08b-4e2f-8dd9-fa007a660200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:03.326163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fbcbf-d08b-4e2f-8dd9-fa007a660200 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:03.326442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fbcbf-d08b-4e2f-8dd9-fa007a660200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:03.326710 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b4fbcbf-d08b-4e2f-8dd9-fa007a660200 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:03.327355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fbcbf-d08b-4e2f-8dd9-fa007a660200 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:03.329290 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b4fbcbf-d08b-4e2f-8dd9-fa007a660200 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:03.358886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1056/2106] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:20:03 2022] POST /identity/v3/projects => generated 389 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:20:03.363012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da960243-104b-45cf-9247-7b0790b84f79 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:03.374845 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da960243-104b-45cf-9247-7b0790b84f79 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:03.439095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe438c-72cc-4b0f-9133-488839637f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:03.439752 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe438c-72cc-4b0f-9133-488839637f7e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:03.440026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe438c-72cc-4b0f-9133-488839637f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:03.440294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fe438c-72cc-4b0f-9133-488839637f7e admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:03.440992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe438c-72cc-4b0f-9133-488839637f7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:03.443010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29fe438c-72cc-4b0f-9133-488839637f7e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:03.467175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1051/2107] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:20:03 2022] POST /identity/v3/users => generated 301 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:20:03.471339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fbcbf-d08b-4e2f-8dd9-fa007a660200 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:03.482946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b4fbcbf-d08b-4e2f-8dd9-fa007a660200 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:03.491239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33af66-befe-4b13-bb6e-dd66538bdec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:03.491846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33af66-befe-4b13-bb6e-dd66538bdec9 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:03.492107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33af66-befe-4b13-bb6e-dd66538bdec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:03.492414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc33af66-befe-4b13-bb6e-dd66538bdec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:03.493054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33af66-befe-4b13-bb6e-dd66538bdec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:03.494706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc33af66-befe-4b13-bb6e-dd66538bdec9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:03.507311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1057/2108] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:20:03.512598 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe438c-72cc-4b0f-9133-488839637f7e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:03.522974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fe438c-72cc-4b0f-9133-488839637f7e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:03.528418 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8bc7e-9dc7-45b5-9654-b92e0ce779a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:03.529101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8bc7e-9dc7-45b5-9654-b92e0ce779a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:03.529437 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8bc7e-9dc7-45b5-9654-b92e0ce779a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:03.529705 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe8bc7e-9dc7-45b5-9654-b92e0ce779a5 admin admin] PATH_INFO: `/v3/projects/aa11ab77dfa442b08d3f3ff695556fb9/users/72e0b74073704ee7b58089e43f1ab1ff/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:03.547417 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8bc7e-9dc7-45b5-9654-b92e0ce779a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa11ab77dfa442b08d3f3ff695556fb9, user_id=72e0b74073704ee7b58089e43f1ab1ff, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:03.550410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe8bc7e-9dc7-45b5-9654-b92e0ce779a5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:03.568671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1052/2109] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:20:03 2022] PUT /identity/v3/projects/aa11ab77dfa442b08d3f3ff695556fb9/users/72e0b74073704ee7b58089e43f1ab1ff/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:03.572911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33af66-befe-4b13-bb6e-dd66538bdec9 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:03.583445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc33af66-befe-4b13-bb6e-dd66538bdec9 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:03.596219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:03.661693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80247fa8-0a38-4645-90af-b3071751aa04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:03.662367 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247fa8-0a38-4645-90af-b3071751aa04 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:03.662618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247fa8-0a38-4645-90af-b3071751aa04 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:03.662883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80247fa8-0a38-4645-90af-b3071751aa04 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:03.663528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80247fa8-0a38-4645-90af-b3071751aa04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:03.665186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80247fa8-0a38-4645-90af-b3071751aa04 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:03.677829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1058/2110] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:03 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:20:03.682181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8bc7e-9dc7-45b5-9654-b92e0ce779a5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:03.693716 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe8bc7e-9dc7-45b5-9654-b92e0ce779a5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:03.698944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fa581-8dce-4df3-9678-d36e50eded93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:03.699645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fa581-8dce-4df3-9678-d36e50eded93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:03.699853 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fa581-8dce-4df3-9678-d36e50eded93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:03.700340 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2fa581-8dce-4df3-9678-d36e50eded93 admin admin] PATH_INFO: `/v3/projects/aa11ab77dfa442b08d3f3ff695556fb9/users/72e0b74073704ee7b58089e43f1ab1ff/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:03.702337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fa581-8dce-4df3-9678-d36e50eded93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa11ab77dfa442b08d3f3ff695556fb9, user_id=72e0b74073704ee7b58089e43f1ab1ff, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:03.704967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2fa581-8dce-4df3-9678-d36e50eded93 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:03.717227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1053/2111] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:20:03 2022] PUT /identity/v3/projects/aa11ab77dfa442b08d3f3ff695556fb9/users/72e0b74073704ee7b58089e43f1ab1ff/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:20:03.727623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1105c1a-8f40-4670-9e5a-9ce02d841553 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:03.727927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1105c1a-8f40-4670-9e5a-9ce02d841553 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:03.728174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1105c1a-8f40-4670-9e5a-9ce02d841553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:03.757808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c1105c1a-8f40-4670-9e5a-9ce02d841553 None None] MFA Rules not processed for user `72e0b74073704ee7b58089e43f1ab1ff`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:03.759048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c1105c1a-8f40-4670-9e5a-9ce02d841553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:03.835647 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1059/2112] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:03.848219 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fa581-8dce-4df3-9678-d36e50eded93 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:03.850461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4f2fa581-8dce-4df3-9678-d36e50eded93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:03.914269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2fa581-8dce-4df3-9678-d36e50eded93 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:03.920713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87e22a-d5c2-4307-9e25-b4610470c734 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:03.921346 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87e22a-d5c2-4307-9e25-b4610470c734 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:03.921679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87e22a-d5c2-4307-9e25-b4610470c734 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:03.921992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a87e22a-d5c2-4307-9e25-b4610470c734 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:03.929004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:03.934156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87e22a-d5c2-4307-9e25-b4610470c734 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:03.936226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a87e22a-d5c2-4307-9e25-b4610470c734 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:03.947642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1054/2113] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:03.993904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1105c1a-8f40-4670-9e5a-9ce02d841553 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:03.995824 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c1105c1a-8f40-4670-9e5a-9ce02d841553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:04.105943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1105c1a-8f40-4670-9e5a-9ce02d841553 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:04.112914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108e2bf6-6596-4103-aa30-73799d9dac22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:04.113756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e2bf6-6596-4103-aa30-73799d9dac22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:04.114076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e2bf6-6596-4103-aa30-73799d9dac22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:04.114312 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108e2bf6-6596-4103-aa30-73799d9dac22 admin admin] PATH_INFO: `/v3/users/af8b06e7c08f4fb6ae7c384cc1f2ea09` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:04.115645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e2bf6-6596-4103-aa30-73799d9dac22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=af8b06e7c08f4fb6ae7c384cc1f2ea09)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:04.118008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-108e2bf6-6596-4103-aa30-73799d9dac22 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:04.144648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87e22a-d5c2-4307-9e25-b4610470c734 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:04.162085 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a87e22a-d5c2-4307-9e25-b4610470c734 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:04.167534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a01bd2-3c4f-49fd-af0b-0cb3e73723c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:04.168281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a01bd2-3c4f-49fd-af0b-0cb3e73723c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:04.168572 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a01bd2-3c4f-49fd-af0b-0cb3e73723c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:04.168893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a01bd2-3c4f-49fd-af0b-0cb3e73723c0 admin admin] PATH_INFO: `/v3/users/785a31d0392942a08362cf7b8014be90` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:04.170157 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a01bd2-3c4f-49fd-af0b-0cb3e73723c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=785a31d0392942a08362cf7b8014be90)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:04.172317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a01bd2-3c4f-49fd-af0b-0cb3e73723c0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:04.229371 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:04.233612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-108e2bf6-6596-4103-aa30-73799d9dac22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af8b06e7c08f4fb6ae7c384cc1f2ea09'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.244210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-108e2bf6-6596-4103-aa30-73799d9dac22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af8b06e7c08f4fb6ae7c384cc1f2ea09'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.245254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-108e2bf6-6596-4103-aa30-73799d9dac22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af8b06e7c08f4fb6ae7c384cc1f2ea09'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.246169 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-108e2bf6-6596-4103-aa30-73799d9dac22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af8b06e7c08f4fb6ae7c384cc1f2ea09'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.255246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-108e2bf6-6596-4103-aa30-73799d9dac22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af8b06e7c08f4fb6ae7c384cc1f2ea09'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.272016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-76a01bd2-3c4f-49fd-af0b-0cb3e73723c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '785a31d0392942a08362cf7b8014be90'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.277731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1060/2114] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:20:03 2022] DELETE /identity/v3/users/af8b06e7c08f4fb6ae7c384cc1f2ea09 => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:20:04.281532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-76a01bd2-3c4f-49fd-af0b-0cb3e73723c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '785a31d0392942a08362cf7b8014be90'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.282329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-76a01bd2-3c4f-49fd-af0b-0cb3e73723c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '785a31d0392942a08362cf7b8014be90'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.282750 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae768b12-629c-4393-ab59-94d1293edb5b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:04.283093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-76a01bd2-3c4f-49fd-af0b-0cb3e73723c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '785a31d0392942a08362cf7b8014be90'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.283189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae768b12-629c-4393-ab59-94d1293edb5b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:04.283330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae768b12-629c-4393-ab59-94d1293edb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:04.294655 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-76a01bd2-3c4f-49fd-af0b-0cb3e73723c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '785a31d0392942a08362cf7b8014be90'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.307667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ae768b12-629c-4393-ab59-94d1293edb5b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:04.308997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ae768b12-629c-4393-ab59-94d1293edb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:04.329827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1055/2115] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:20:04 2022] DELETE /identity/v3/users/785a31d0392942a08362cf7b8014be90 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:04.334421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ee411-dbc4-448f-89a0-26d2d5197274 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:04.334815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ee411-dbc4-448f-89a0-26d2d5197274 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:04.335160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614ee411-dbc4-448f-89a0-26d2d5197274 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:04.358839 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-614ee411-dbc4-448f-89a0-26d2d5197274 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:04.360070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-614ee411-dbc4-448f-89a0-26d2d5197274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:04.377298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1061/2116] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:04.387419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae768b12-629c-4393-ab59-94d1293edb5b None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:04.389345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ae768b12-629c-4393-ab59-94d1293edb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:04.430519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1056/2117] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:20:04.441021 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ee411-dbc4-448f-89a0-26d2d5197274 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:04.443187 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-614ee411-dbc4-448f-89a0-26d2d5197274 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:04.452002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae768b12-629c-4393-ab59-94d1293edb5b None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:04.511622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614ee411-dbc4-448f-89a0-26d2d5197274 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:04.515646 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052a2bd-9739-4659-a02b-6ef7bfedba4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:04.515850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fa8d2-9553-4efc-8372-023e95415560 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:04.516310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052a2bd-9739-4659-a02b-6ef7bfedba4e service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:04.516537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa8d2-9553-4efc-8372-023e95415560 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:04.516856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052a2bd-9739-4659-a02b-6ef7bfedba4e service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:04.516957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa8d2-9553-4efc-8372-023e95415560 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:04.517039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5052a2bd-9739-4659-a02b-6ef7bfedba4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:04.517133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fa8d2-9553-4efc-8372-023e95415560 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:04.527205 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fa8d2-9553-4efc-8372-023e95415560 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:04.527429 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052a2bd-9739-4659-a02b-6ef7bfedba4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:04.528853 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0fa8d2-9553-4efc-8372-023e95415560 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:04.528998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5052a2bd-9739-4659-a02b-6ef7bfedba4e service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:04.540634 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1057/2119] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:04.540850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1062/2119] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:04.812420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052a2bd-9739-4659-a02b-6ef7bfedba4e service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:04.814514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5052a2bd-9739-4659-a02b-6ef7bfedba4e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:04.827785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5052a2bd-9739-4659-a02b-6ef7bfedba4e service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:04.833690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc843a1-da6c-40c4-b546-fb581d22e34f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:04.834652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc843a1-da6c-40c4-b546-fb581d22e34f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:04.835007 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc843a1-da6c-40c4-b546-fb581d22e34f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:04.835557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc843a1-da6c-40c4-b546-fb581d22e34f admin admin] PATH_INFO: `/v3/projects/d50996fa3471457e865c93789499a2ca` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:04.836941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc843a1-da6c-40c4-b546-fb581d22e34f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d50996fa3471457e865c93789499a2ca)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:04.839378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc843a1-da6c-40c4-b546-fb581d22e34f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:04.843196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:04.905982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0cc843a1-da6c-40c4-b546-fb581d22e34f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd50996fa3471457e865c93789499a2ca', 'request_id': 'req-0cc843a1-da6c-40c4-b546-fb581d22e34f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.913877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0cc843a1-da6c-40c4-b546-fb581d22e34f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd50996fa3471457e865c93789499a2ca', 'request_id': 'req-0cc843a1-da6c-40c4-b546-fb581d22e34f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.920071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fa8d2-9553-4efc-8372-023e95415560 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:04.922196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0a0fa8d2-9553-4efc-8372-023e95415560 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:04.926040 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0cc843a1-da6c-40c4-b546-fb581d22e34f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd50996fa3471457e865c93789499a2ca', 'request_id': 'req-0cc843a1-da6c-40c4-b546-fb581d22e34f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.950199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0cc843a1-da6c-40c4-b546-fb581d22e34f admin admin] The token cache is being invalidate because project d50996fa3471457e865c93789499a2ca was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:20:04.950801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0cc843a1-da6c-40c4-b546-fb581d22e34f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.952000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0cc843a1-da6c-40c4-b546-fb581d22e34f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:04.952337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0fa8d2-9553-4efc-8372-023e95415560 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:04.954465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1058/2120] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:20:04 2022] DELETE /identity/v3/projects/d50996fa3471457e865c93789499a2ca => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:04.960177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5d96d-c2a3-4bcb-9b06-254f4c5b3781 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:04.960493 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5d96d-c2a3-4bcb-9b06-254f4c5b3781 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:04.960827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd5d96d-c2a3-4bcb-9b06-254f4c5b3781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:04.964762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:04.985963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0dd5d96d-c2a3-4bcb-9b06-254f4c5b3781 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:04.987212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0dd5d96d-c2a3-4bcb-9b06-254f4c5b3781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:05.023429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:05.024067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:05.024341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:05.024609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] PATH_INFO: `/v3/projects/7232dac4c0db4f5590325e005049745f` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:05.025905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7232dac4c0db4f5590325e005049745f)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:05.028002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:05.057670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1059/2121] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:20:05.065734 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974241f3-8258-4128-ae89-98bd467e349f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:05.066120 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974241f3-8258-4128-ae89-98bd467e349f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:05.066491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974241f3-8258-4128-ae89-98bd467e349f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:05.088964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7232dac4c0db4f5590325e005049745f', 'request_id': 'req-a35934c6-ebba-4a44-8f1b-9724418531f0'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:05.090935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-974241f3-8258-4128-ae89-98bd467e349f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:05.092185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-974241f3-8258-4128-ae89-98bd467e349f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:05.097398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7232dac4c0db4f5590325e005049745f', 'request_id': 'req-a35934c6-ebba-4a44-8f1b-9724418531f0'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:05.106814 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7232dac4c0db4f5590325e005049745f', 'request_id': 'req-a35934c6-ebba-4a44-8f1b-9724418531f0'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:05.119305 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] The token cache is being invalidate because project 7232dac4c0db4f5590325e005049745f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:20:05.119588 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:05.120313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:05.122291 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1063/2122] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:20:04 2022] DELETE /identity/v3/projects/7232dac4c0db4f5590325e005049745f => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:20:05.126366 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:05.127877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:05.171031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1060/2123] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:20:05.175976 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974241f3-8258-4128-ae89-98bd467e349f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:05.185575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974241f3-8258-4128-ae89-98bd467e349f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:05.191106 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff1750-c83a-4ee1-a219-3de61f785add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:05.191625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff1750-c83a-4ee1-a219-3de61f785add admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:05.191907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff1750-c83a-4ee1-a219-3de61f785add admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:05.192178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adff1750-c83a-4ee1-a219-3de61f785add admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:05.192845 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff1750-c83a-4ee1-a219-3de61f785add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:20:05.193152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff1750-c83a-4ee1-a219-3de61f785add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:05.195016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adff1750-c83a-4ee1-a219-3de61f785add admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:05.206178 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35934c6-ebba-4a44-8f1b-9724418531f0 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:05.211072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1061/2124] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:20:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:20:05.211802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:05.212452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:05.212726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:05.212993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] PATH_INFO: `/v3/users/72e0b74073704ee7b58089e43f1ab1ff` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:05.214626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72e0b74073704ee7b58089e43f1ab1ff)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:05.216131 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff1750-c83a-4ee1-a219-3de61f785add admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:05.216702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:05.240382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adff1750-c83a-4ee1-a219-3de61f785add admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:05.250401 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d2652-be39-4d64-bc91-7c263e8d96ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:05.251309 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2652-be39-4d64-bc91-7c263e8d96ec admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:05.252114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2652-be39-4d64-bc91-7c263e8d96ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:05.252461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d2652-be39-4d64-bc91-7c263e8d96ec admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:05.253645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d2652-be39-4d64-bc91-7c263e8d96ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:05.257332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d2652-be39-4d64-bc91-7c263e8d96ec admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:05.292244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:05.298421 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:05.301051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72e0b74073704ee7b58089e43f1ab1ff'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:05.307918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1062/2125] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:20:05 2022] POST /identity/v3/projects => generated 381 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:20:05.310895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d2652-be39-4d64-bc91-7c263e8d96ec admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:05.331458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72e0b74073704ee7b58089e43f1ab1ff'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:05.332597 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72e0b74073704ee7b58089e43f1ab1ff'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:05.333636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72e0b74073704ee7b58089e43f1ab1ff'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:05.348341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72e0b74073704ee7b58089e43f1ab1ff'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:05.382745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1064/2126] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:20:05 2022] DELETE /identity/v3/users/72e0b74073704ee7b58089e43f1ab1ff => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:20:05.400788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d2652-be39-4d64-bc91-7c263e8d96ec admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:05.493559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbad597-e6c1-4c63-beec-29a6ea4ff03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:05.494653 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbad597-e6c1-4c63-beec-29a6ea4ff03a admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:05.494827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbad597-e6c1-4c63-beec-29a6ea4ff03a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:05.495222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbad597-e6c1-4c63-beec-29a6ea4ff03a admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:05.496532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbad597-e6c1-4c63-beec-29a6ea4ff03a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:05.499004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cbad597-e6c1-4c63-beec-29a6ea4ff03a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:05.533136 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1063/2127] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:20:05 2022] POST /identity/v3/users => generated 291 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:20:05.534917 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:05.537146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:05.554183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6228ab7-6fbb-43d6-a524-15171056b796 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:05.571588 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d2bca-97b7-4a73-b13b-869db75c395f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:05.572861 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d2bca-97b7-4a73-b13b-869db75c395f admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:05.573150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d2bca-97b7-4a73-b13b-869db75c395f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:05.573876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e0d2bca-97b7-4a73-b13b-869db75c395f admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:05.596289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d2bca-97b7-4a73-b13b-869db75c395f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:05.599048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e0d2bca-97b7-4a73-b13b-869db75c395f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:05.625060 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1065/2128] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:20:05.626434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbad597-e6c1-4c63-beec-29a6ea4ff03a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:05.639503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbad597-e6c1-4c63-beec-29a6ea4ff03a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:05.646459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84800984-43cb-4ced-b4d8-6e5513737877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:05.647245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84800984-43cb-4ced-b4d8-6e5513737877 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:05.647544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84800984-43cb-4ced-b4d8-6e5513737877 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:05.647803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84800984-43cb-4ced-b4d8-6e5513737877 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:05.648512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84800984-43cb-4ced-b4d8-6e5513737877 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:05.650841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84800984-43cb-4ced-b4d8-6e5513737877 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:05.669835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1064/2129] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:05 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:20:05.672180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d2bca-97b7-4a73-b13b-869db75c395f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:05.685454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e0d2bca-97b7-4a73-b13b-869db75c395f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:05.692828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396b4bc-f1ac-4e3e-9cc1-e34c523975df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:05.692828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396b4bc-f1ac-4e3e-9cc1-e34c523975df admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:05.692828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396b4bc-f1ac-4e3e-9cc1-e34c523975df admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:05.692828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e396b4bc-f1ac-4e3e-9cc1-e34c523975df admin admin] PATH_INFO: `/v3/projects/bece4709db5e4c8fa74b9dac13499ea4/users/4abbd18f03d64e06b319b9773d0b6dce/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:05.714015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396b4bc-f1ac-4e3e-9cc1-e34c523975df admin admin] RBAC: Authorizing `identity:create_grant(project_id=bece4709db5e4c8fa74b9dac13499ea4, user_id=4abbd18f03d64e06b319b9773d0b6dce, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:05.716899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e396b4bc-f1ac-4e3e-9cc1-e34c523975df admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:05.746016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1066/2130] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:20:05 2022] PUT /identity/v3/projects/bece4709db5e4c8fa74b9dac13499ea4/users/4abbd18f03d64e06b319b9773d0b6dce/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:05.748535 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230afcc-457c-4cc0-a3a3-6b945db30051 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:05.748835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230afcc-457c-4cc0-a3a3-6b945db30051 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:05.749122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c230afcc-457c-4cc0-a3a3-6b945db30051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:05.772028 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c230afcc-457c-4cc0-a3a3-6b945db30051 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:05.773306 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c230afcc-457c-4cc0-a3a3-6b945db30051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:05.863179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1065/2131] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:05.874854 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396b4bc-f1ac-4e3e-9cc1-e34c523975df admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:05.876900 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e396b4bc-f1ac-4e3e-9cc1-e34c523975df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:05.957400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e396b4bc-f1ac-4e3e-9cc1-e34c523975df admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:05.959762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230afcc-457c-4cc0-a3a3-6b945db30051 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:05.961434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c230afcc-457c-4cc0-a3a3-6b945db30051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:05.968024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4796be8-6bcc-416a-be7f-8159687827e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:05.968747 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796be8-6bcc-416a-be7f-8159687827e0 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:05.969031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796be8-6bcc-416a-be7f-8159687827e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:05.969298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4796be8-6bcc-416a-be7f-8159687827e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:05.977318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c230afcc-457c-4cc0-a3a3-6b945db30051 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:05.983125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:05.983893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:05.984273 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:05.984647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9 admin admin] PATH_INFO: `/v3/projects/aa11ab77dfa442b08d3f3ff695556fb9` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:05.986104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa11ab77dfa442b08d3f3ff695556fb9)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:05.986377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4796be8-6bcc-416a-be7f-8159687827e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:05.988266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:05.988855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4796be8-6bcc-416a-be7f-8159687827e0 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:06.005471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1067/2132] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:06.040523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:06.093871 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa11ab77dfa442b08d3f3ff695556fb9', 'request_id': 'req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:06.101964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa11ab77dfa442b08d3f3ff695556fb9', 'request_id': 'req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:06.114750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa11ab77dfa442b08d3f3ff695556fb9', 'request_id': 'req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:06.131345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9 admin admin] The token cache is being invalidate because project aa11ab77dfa442b08d3f3ff695556fb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:20:06.131811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:06.132938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-42e75d5b-3b48-494f-ab60-b7d022d8cbf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:06.139547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1066/2133] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:20:05 2022] DELETE /identity/v3/projects/aa11ab77dfa442b08d3f3ff695556fb9 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:20:06.147650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a3457-64c1-43ee-9e66-66e9df061d2e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:06.148501 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a3457-64c1-43ee-9e66-66e9df061d2e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:06.148876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16a3457-64c1-43ee-9e66-66e9df061d2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:06.180303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c16a3457-64c1-43ee-9e66-66e9df061d2e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:06.182846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c16a3457-64c1-43ee-9e66-66e9df061d2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:06.271668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1068/2134] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:06.279710 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779751-9161-4fff-b7ab-d304a9d8d9a7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:06.279997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779751-9161-4fff-b7ab-d304a9d8d9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:06.280272 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3779751-9161-4fff-b7ab-d304a9d8d9a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:06.302610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e3779751-9161-4fff-b7ab-d304a9d8d9a7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:06.303662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e3779751-9161-4fff-b7ab-d304a9d8d9a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:06.319287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a3457-64c1-43ee-9e66-66e9df061d2e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:06.325172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1067/2135] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:06.335297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16a3457-64c1-43ee-9e66-66e9df061d2e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:06.344661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b78330-f0c0-41fb-88a4-3a5dbfbb4fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:06.345515 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b78330-f0c0-41fb-88a4-3a5dbfbb4fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:06.346893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b78330-f0c0-41fb-88a4-3a5dbfbb4fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:06.347506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b78330-f0c0-41fb-88a4-3a5dbfbb4fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:06.348551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b78330-f0c0-41fb-88a4-3a5dbfbb4fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:20:06.349479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b78330-f0c0-41fb-88a4-3a5dbfbb4fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:06.351354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b78330-f0c0-41fb-88a4-3a5dbfbb4fc9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:06.372714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3779751-9161-4fff-b7ab-d304a9d8d9a7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:06.378791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1069/2136] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:20:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:20:06.383300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3779751-9161-4fff-b7ab-d304a9d8d9a7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:06.395070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638039f-3c83-4400-a08f-14cc9db16d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:06.395812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638039f-3c83-4400-a08f-14cc9db16d4c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:06.396426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638039f-3c83-4400-a08f-14cc9db16d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:06.396768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a638039f-3c83-4400-a08f-14cc9db16d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:06.397496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638039f-3c83-4400-a08f-14cc9db16d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:06.399586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a638039f-3c83-4400-a08f-14cc9db16d4c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:06.440673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1068/2137] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:20:06 2022] POST /identity/v3/projects => generated 409 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:20:06.446474 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b78330-f0c0-41fb-88a4-3a5dbfbb4fc9 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:06.459068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b78330-f0c0-41fb-88a4-3a5dbfbb4fc9 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:06.476706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:06.545033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9bd14-943f-49be-8821-aa3798c1424f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:06.545556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9bd14-943f-49be-8821-aa3798c1424f admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:06.545862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9bd14-943f-49be-8821-aa3798c1424f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:06.546134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9bd14-943f-49be-8821-aa3798c1424f admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:06.546795 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9bd14-943f-49be-8821-aa3798c1424f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:06.548783 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9bd14-943f-49be-8821-aa3798c1424f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:06.578693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1070/2138] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:20:06 2022] POST /identity/v3/users => generated 305 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:20:06.580031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638039f-3c83-4400-a08f-14cc9db16d4c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:06.593588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a638039f-3c83-4400-a08f-14cc9db16d4c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:06.601820 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aadab-020a-4ecb-848a-4c1a067e2e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:06.602567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aadab-020a-4ecb-848a-4c1a067e2e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:06.602877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aadab-020a-4ecb-848a-4c1a067e2e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:06.603149 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2aadab-020a-4ecb-848a-4c1a067e2e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:06.603814 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aadab-020a-4ecb-848a-4c1a067e2e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:06.605454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2aadab-020a-4ecb-848a-4c1a067e2e23 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:06.617455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1069/2139] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:20:06.622648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9bd14-943f-49be-8821-aa3798c1424f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:06.634240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9bd14-943f-49be-8821-aa3798c1424f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:06.640081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b3893b-8eef-477c-a45c-5a535c10acfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:06.640734 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3893b-8eef-477c-a45c-5a535c10acfa admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:06.641003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3893b-8eef-477c-a45c-5a535c10acfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:06.641278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b3893b-8eef-477c-a45c-5a535c10acfa admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:06.641959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3893b-8eef-477c-a45c-5a535c10acfa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:06.643573 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b3893b-8eef-477c-a45c-5a535c10acfa admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:06.659777 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1071/2140] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:20:06.664117 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aadab-020a-4ecb-848a-4c1a067e2e23 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:06.677141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2aadab-020a-4ecb-848a-4c1a067e2e23 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:06.682736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292195aa-e9dd-4c77-aae8-83fdea9cf1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:06.684898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292195aa-e9dd-4c77-aae8-83fdea9cf1a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:06.684898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292195aa-e9dd-4c77-aae8-83fdea9cf1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:06.685081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292195aa-e9dd-4c77-aae8-83fdea9cf1a9 admin admin] PATH_INFO: `/v3/projects/3697397453f841989f1813335931b92b/users/d28cf8a1f99e40fb890528742882a7e9/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:06.704305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292195aa-e9dd-4c77-aae8-83fdea9cf1a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3697397453f841989f1813335931b92b, user_id=d28cf8a1f99e40fb890528742882a7e9, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:06.707767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292195aa-e9dd-4c77-aae8-83fdea9cf1a9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:06.730599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1070/2141] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:20:06 2022] PUT /identity/v3/projects/3697397453f841989f1813335931b92b/users/d28cf8a1f99e40fb890528742882a7e9/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:06.741909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745a1b0-b68c-488b-bc3c-f0c68ff732cf None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:06.742200 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745a1b0-b68c-488b-bc3c-f0c68ff732cf None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:06.742472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4745a1b0-b68c-488b-bc3c-f0c68ff732cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:06.790685 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4745a1b0-b68c-488b-bc3c-f0c68ff732cf None None] MFA Rules not processed for user `d28cf8a1f99e40fb890528742882a7e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:06.792029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4745a1b0-b68c-488b-bc3c-f0c68ff732cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:06.889733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1072/2142] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:06 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:06.894565 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292195aa-e9dd-4c77-aae8-83fdea9cf1a9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:07.009300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292195aa-e9dd-4c77-aae8-83fdea9cf1a9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:07.022943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1816c2-cc97-426f-a2a9-b738c68af635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:07.023994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1816c2-cc97-426f-a2a9-b738c68af635 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:07.024321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1816c2-cc97-426f-a2a9-b738c68af635 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:07.024674 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1816c2-cc97-426f-a2a9-b738c68af635 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:07.026381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1816c2-cc97-426f-a2a9-b738c68af635 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:07.028507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1816c2-cc97-426f-a2a9-b738c68af635 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:07.073175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1071/2143] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:20:06 2022] POST /identity/v3/projects => generated 409 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:20:07.077896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745a1b0-b68c-488b-bc3c-f0c68ff732cf None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:07.101714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff73f04-17f3-4eb4-87ee-6750a80023bc None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:07.101714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff73f04-17f3-4eb4-87ee-6750a80023bc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:07.101714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff73f04-17f3-4eb4-87ee-6750a80023bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:07.111764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4745a1b0-b68c-488b-bc3c-f0c68ff732cf None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:07.150616 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-eff73f04-17f3-4eb4-87ee-6750a80023bc None None] MFA Rules not processed for user `4abbd18f03d64e06b319b9773d0b6dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:07.151852 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-eff73f04-17f3-4eb4-87ee-6750a80023bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:07.174895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:07.212494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cbba5-13e6-456c-990c-681553c9d7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:07.214231 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cbba5-13e6-456c-990c-681553c9d7dc admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:07.214655 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cbba5-13e6-456c-990c-681553c9d7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:07.215059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844cbba5-13e6-456c-990c-681553c9d7dc admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:07.215879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cbba5-13e6-456c-990c-681553c9d7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:07.219093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844cbba5-13e6-456c-990c-681553c9d7dc admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:07.243222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1073/2144] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:20:07 2022] POST /identity/v3/users => generated 311 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:20:07.249828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1072/2145] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:07 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:07.250023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cbba5-13e6-456c-990c-681553c9d7dc admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:07.258838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff73f04-17f3-4eb4-87ee-6750a80023bc None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:07.259681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844cbba5-13e6-456c-990c-681553c9d7dc admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:07.260453 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-eff73f04-17f3-4eb4-87ee-6750a80023bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:07.265579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d2255-03e2-4fb9-bd56-c177849eef86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:07.266446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2255-03e2-4fb9-bd56-c177849eef86 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:07.266730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2255-03e2-4fb9-bd56-c177849eef86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:07.267004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883d2255-03e2-4fb9-bd56-c177849eef86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:07.267842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d2255-03e2-4fb9-bd56-c177849eef86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:07.269979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883d2255-03e2-4fb9-bd56-c177849eef86 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:07.285882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1074/2146] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:20:07.290879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d2255-03e2-4fb9-bd56-c177849eef86 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:07.297872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:07.303620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883d2255-03e2-4fb9-bd56-c177849eef86 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:07.312518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fd466-30c1-4f85-aa79-9dfd2cf1daa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:07.313225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fd466-30c1-4f85-aa79-9dfd2cf1daa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:07.313554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fd466-30c1-4f85-aa79-9dfd2cf1daa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:07.313890 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3fd466-30c1-4f85-aa79-9dfd2cf1daa6 admin admin] PATH_INFO: `/v3/projects/00c6940fbf89472ca6d02baa82a38948/users/5f1f19179b534e60a47debbb1704ef62/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:07.332595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fd466-30c1-4f85-aa79-9dfd2cf1daa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c6940fbf89472ca6d02baa82a38948, user_id=5f1f19179b534e60a47debbb1704ef62, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:07.335405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3fd466-30c1-4f85-aa79-9dfd2cf1daa6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:07.347036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff73f04-17f3-4eb4-87ee-6750a80023bc None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:07.354529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1075/2147] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:20:07 2022] PUT /identity/v3/projects/00c6940fbf89472ca6d02baa82a38948/users/5f1f19179b534e60a47debbb1704ef62/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:07.358766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fd466-30c1-4f85-aa79-9dfd2cf1daa6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:07.409537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce75802f-1e98-41c4-8282-f1cb21761c58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:07.412525 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75802f-1e98-41c4-8282-f1cb21761c58 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:07.412658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75802f-1e98-41c4-8282-f1cb21761c58 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:07.412882 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce75802f-1e98-41c4-8282-f1cb21761c58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:07.437841 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3fd466-30c1-4f85-aa79-9dfd2cf1daa6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:07.443639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087c62f-b04d-479b-a1d1-53e96f2edaf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:07.444261 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087c62f-b04d-479b-a1d1-53e96f2edaf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:07.444539 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087c62f-b04d-479b-a1d1-53e96f2edaf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:07.444808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0087c62f-b04d-479b-a1d1-53e96f2edaf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:07.445645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087c62f-b04d-479b-a1d1-53e96f2edaf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:07.447768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0087c62f-b04d-479b-a1d1-53e96f2edaf3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:07.468353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1076/2148] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:07 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:20:07.472771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087c62f-b04d-479b-a1d1-53e96f2edaf3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:07.487073 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0087c62f-b04d-479b-a1d1-53e96f2edaf3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:07.489548 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75802f-1e98-41c4-8282-f1cb21761c58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:07.491163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce75802f-1e98-41c4-8282-f1cb21761c58 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:07.492483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3581b0a-c88f-4eca-994d-65e21b2ac2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:07.493068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3581b0a-c88f-4eca-994d-65e21b2ac2d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:07.493349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3581b0a-c88f-4eca-994d-65e21b2ac2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:07.493605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3581b0a-c88f-4eca-994d-65e21b2ac2d9 admin admin] PATH_INFO: `/v3/projects/00c6940fbf89472ca6d02baa82a38948/users/5f1f19179b534e60a47debbb1704ef62/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:07.495784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3581b0a-c88f-4eca-994d-65e21b2ac2d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00c6940fbf89472ca6d02baa82a38948, user_id=5f1f19179b534e60a47debbb1704ef62, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:07.499300 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3581b0a-c88f-4eca-994d-65e21b2ac2d9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:07.501377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1073/2149] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:07.511631 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1077/2150] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:20:07 2022] PUT /identity/v3/projects/00c6940fbf89472ca6d02baa82a38948/users/5f1f19179b534e60a47debbb1704ef62/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:07.522491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e9816-c5e3-4534-b034-6440937a63a2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:07.522778 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e9816-c5e3-4534-b034-6440937a63a2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:07.523051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08e9816-c5e3-4534-b034-6440937a63a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:07.554838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d08e9816-c5e3-4534-b034-6440937a63a2 None None] MFA Rules not processed for user `5f1f19179b534e60a47debbb1704ef62`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:07.556060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d08e9816-c5e3-4534-b034-6440937a63a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:07.574107 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:07.637319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1074/2151] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:07 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:07.651837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3581b0a-c88f-4eca-994d-65e21b2ac2d9 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:07.653988 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a3581b0a-c88f-4eca-994d-65e21b2ac2d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:07.722687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3581b0a-c88f-4eca-994d-65e21b2ac2d9 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:07.726572 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65c310b-6389-4b9a-92a4-9f74cdfe7c87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:07.727197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c310b-6389-4b9a-92a4-9f74cdfe7c87 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:07.727471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c310b-6389-4b9a-92a4-9f74cdfe7c87 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:07.727746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65c310b-6389-4b9a-92a4-9f74cdfe7c87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:07.739649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c310b-6389-4b9a-92a4-9f74cdfe7c87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:07.741074 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65c310b-6389-4b9a-92a4-9f74cdfe7c87 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:07.753182 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1078/2152] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:07 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:07.940034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e9816-c5e3-4534-b034-6440937a63a2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:07.951860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08e9816-c5e3-4534-b034-6440937a63a2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:07.957019 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619d37a-2f32-4512-8daf-be3d67d07b36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:07.957684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619d37a-2f32-4512-8daf-be3d67d07b36 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:07.957989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619d37a-2f32-4512-8daf-be3d67d07b36 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:07.958235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7619d37a-2f32-4512-8daf-be3d67d07b36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:08.031738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619d37a-2f32-4512-8daf-be3d67d07b36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:08.033244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7619d37a-2f32-4512-8daf-be3d67d07b36 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:08.044214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1075/2153] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:07 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:08.923961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4948a-11dc-4394-98cb-56de3c217b8c None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:08.924532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4948a-11dc-4394-98cb-56de3c217b8c None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:08.924532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef4948a-11dc-4394-98cb-56de3c217b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:08.948651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0ef4948a-11dc-4394-98cb-56de3c217b8c None None] MFA Rules not processed for user `4abbd18f03d64e06b319b9773d0b6dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:08.950751 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0ef4948a-11dc-4394-98cb-56de3c217b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:09.021627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1079/2154] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:13.610481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619d37a-2f32-4512-8daf-be3d67d07b36 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:13.682448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7619d37a-2f32-4512-8daf-be3d67d07b36 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:13.688968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:13.689638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:13.689959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:13.690235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] PATH_INFO: `/v3/users/d28cf8a1f99e40fb890528742882a7e9` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:13.691486 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d28cf8a1f99e40fb890528742882a7e9)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:13.693497 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:13.757617 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd28cf8a1f99e40fb890528742882a7e9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:13.768482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd28cf8a1f99e40fb890528742882a7e9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:13.769086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd28cf8a1f99e40fb890528742882a7e9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:13.769874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd28cf8a1f99e40fb890528742882a7e9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:13.771572 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:13.780149 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd28cf8a1f99e40fb890528742882a7e9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:13.801566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1076/2155] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:20:13 2022] DELETE /identity/v3/users/d28cf8a1f99e40fb890528742882a7e9 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:13.807511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0143251-b98e-4a9a-98cc-580779e102d9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:13.807511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0143251-b98e-4a9a-98cc-580779e102d9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:13.807511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0143251-b98e-4a9a-98cc-580779e102d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:13.831714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d0143251-b98e-4a9a-98cc-580779e102d9 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:13.833062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d0143251-b98e-4a9a-98cc-580779e102d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:13.840430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:13.908619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1080/2156] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:13.920013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:13.921440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:13.983656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32086f0-3868-4e3c-a202-39b1583fdb85 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:13.990239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacdcb9-1ad5-4bae-830e-8d55d2dca116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:13.991022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacdcb9-1ad5-4bae-830e-8d55d2dca116 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:13.991435 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacdcb9-1ad5-4bae-830e-8d55d2dca116 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:13.991811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eacdcb9-1ad5-4bae-830e-8d55d2dca116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:14.002724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacdcb9-1ad5-4bae-830e-8d55d2dca116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:14.003773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eacdcb9-1ad5-4bae-830e-8d55d2dca116 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:14.015863 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1077/2157] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:14.448012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0143251-b98e-4a9a-98cc-580779e102d9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:14.450056 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d0143251-b98e-4a9a-98cc-580779e102d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:14.497192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0143251-b98e-4a9a-98cc-580779e102d9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:14.505176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:14.506026 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:14.506293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:14.506587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] PATH_INFO: `/v3/projects/3697397453f841989f1813335931b92b` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:14.507894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3697397453f841989f1813335931b92b)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:14.510498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:14.582654 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3697397453f841989f1813335931b92b', 'request_id': 'req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:14.590886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3697397453f841989f1813335931b92b', 'request_id': 'req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:14.606184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3697397453f841989f1813335931b92b', 'request_id': 'req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:14.619875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] The token cache is being invalidate because project 3697397453f841989f1813335931b92b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:20:14.620213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:14.620990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:14.626250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1081/2158] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:20:14 2022] DELETE /identity/v3/projects/3697397453f841989f1813335931b92b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:14.627516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacdcb9-1ad5-4bae-830e-8d55d2dca116 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:14.639801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eacdcb9-1ad5-4bae-830e-8d55d2dca116 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:14.697539 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab1e2c4-4d10-4407-8a61-ba34e8e9b4c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:14.698180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1e2c4-4d10-4407-8a61-ba34e8e9b4c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:14.698559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1e2c4-4d10-4407-8a61-ba34e8e9b4c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:14.698868 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab1e2c4-4d10-4407-8a61-ba34e8e9b4c0 admin admin] PATH_INFO: `/v3/users/5f1f19179b534e60a47debbb1704ef62` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:14.700046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1e2c4-4d10-4407-8a61-ba34e8e9b4c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f1f19179b534e60a47debbb1704ef62)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:14.702066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab1e2c4-4d10-4407-8a61-ba34e8e9b4c0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:14.754996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0ab1e2c4-4d10-4407-8a61-ba34e8e9b4c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f1f19179b534e60a47debbb1704ef62'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:14.764022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0ab1e2c4-4d10-4407-8a61-ba34e8e9b4c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f1f19179b534e60a47debbb1704ef62'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:14.764688 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0ab1e2c4-4d10-4407-8a61-ba34e8e9b4c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f1f19179b534e60a47debbb1704ef62'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:14.765307 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0ab1e2c4-4d10-4407-8a61-ba34e8e9b4c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f1f19179b534e60a47debbb1704ef62'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:14.773064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0ab1e2c4-4d10-4407-8a61-ba34e8e9b4c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f1f19179b534e60a47debbb1704ef62'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:14.783932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:14.795908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1078/2159] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:20:14 2022] DELETE /identity/v3/users/5f1f19179b534e60a47debbb1704ef62 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:15.143223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:15.145394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:15.164232 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-734653c3-9640-4cbf-a1bf-3b363bdbcc2e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:15.248587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20869fd0-8943-45ee-876a-04c6f434290f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:15.249343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20869fd0-8943-45ee-876a-04c6f434290f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:15.249686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20869fd0-8943-45ee-876a-04c6f434290f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:15.250050 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20869fd0-8943-45ee-876a-04c6f434290f admin admin] PATH_INFO: `/v3/projects/00c6940fbf89472ca6d02baa82a38948` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:15.251408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20869fd0-8943-45ee-876a-04c6f434290f admin admin] RBAC: Authorizing `identity:delete_project(project_id=00c6940fbf89472ca6d02baa82a38948)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:15.253489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20869fd0-8943-45ee-876a-04c6f434290f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:15.310488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-20869fd0-8943-45ee-876a-04c6f434290f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00c6940fbf89472ca6d02baa82a38948', 'request_id': 'req-20869fd0-8943-45ee-876a-04c6f434290f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:15.316909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:15.317942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-20869fd0-8943-45ee-876a-04c6f434290f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00c6940fbf89472ca6d02baa82a38948', 'request_id': 'req-20869fd0-8943-45ee-876a-04c6f434290f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:15.329590 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-20869fd0-8943-45ee-876a-04c6f434290f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00c6940fbf89472ca6d02baa82a38948', 'request_id': 'req-20869fd0-8943-45ee-876a-04c6f434290f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:15.351220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-20869fd0-8943-45ee-876a-04c6f434290f admin admin] The token cache is being invalidate because project 00c6940fbf89472ca6d02baa82a38948 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:20:15.351591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-20869fd0-8943-45ee-876a-04c6f434290f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:15.353372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-20869fd0-8943-45ee-876a-04c6f434290f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:15.357227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1082/2160] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:20:15 2022] DELETE /identity/v3/projects/00c6940fbf89472ca6d02baa82a38948 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:15.362480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99404b2-6f2a-4ba1-a632-b3b023539d2b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:15.362861 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99404b2-6f2a-4ba1-a632-b3b023539d2b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:15.363229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99404b2-6f2a-4ba1-a632-b3b023539d2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:15.392209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a99404b2-6f2a-4ba1-a632-b3b023539d2b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:15.393727 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a99404b2-6f2a-4ba1-a632-b3b023539d2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:15.500058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1079/2161] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:15.509518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8211a-5815-4c3b-9087-1692cb859dcc None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:15.509841 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8211a-5815-4c3b-9087-1692cb859dcc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:15.510100 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a8211a-5815-4c3b-9087-1692cb859dcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:15.536321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-48a8211a-5815-4c3b-9087-1692cb859dcc None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:15.537576 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-48a8211a-5815-4c3b-9087-1692cb859dcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:15.555160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1083/2162] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:15.559295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99404b2-6f2a-4ba1-a632-b3b023539d2b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:15.570310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99404b2-6f2a-4ba1-a632-b3b023539d2b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:15.582553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b6812-a7f3-4215-bc6d-fc2b81859377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:15.583736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b6812-a7f3-4215-bc6d-fc2b81859377 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:15.584011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b6812-a7f3-4215-bc6d-fc2b81859377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:15.584283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4b6812-a7f3-4215-bc6d-fc2b81859377 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:15.584953 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b6812-a7f3-4215-bc6d-fc2b81859377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:20:15.585250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b6812-a7f3-4215-bc6d-fc2b81859377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:15.587042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4b6812-a7f3-4215-bc6d-fc2b81859377 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:15.603930 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1080/2163] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:20:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:20:15.607315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8211a-5815-4c3b-9087-1692cb859dcc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:15.617517 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a8211a-5815-4c3b-9087-1692cb859dcc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:15.623458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1cbc8-44af-4acf-985e-fcef4a8a6d61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:15.624396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1cbc8-44af-4acf-985e-fcef4a8a6d61 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:15.624554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1cbc8-44af-4acf-985e-fcef4a8a6d61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:15.624914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1cbc8-44af-4acf-985e-fcef4a8a6d61 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:15.625835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1cbc8-44af-4acf-985e-fcef4a8a6d61 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:15.627849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1cbc8-44af-4acf-985e-fcef4a8a6d61 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:15.661758 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1084/2164] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:20:15 2022] POST /identity/v3/projects => generated 375 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:20:15.666416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b6812-a7f3-4215-bc6d-fc2b81859377 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:15.684361 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4b6812-a7f3-4215-bc6d-fc2b81859377 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:15.754034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37845a2-1897-4a49-8aa3-af611895e5b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:15.754656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37845a2-1897-4a49-8aa3-af611895e5b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:15.754935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37845a2-1897-4a49-8aa3-af611895e5b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:15.755201 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37845a2-1897-4a49-8aa3-af611895e5b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:15.756402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37845a2-1897-4a49-8aa3-af611895e5b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:15.758421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37845a2-1897-4a49-8aa3-af611895e5b6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:15.786095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1081/2165] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:20:15 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:20:15.790987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1cbc8-44af-4acf-985e-fcef4a8a6d61 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:15.803196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1cbc8-44af-4acf-985e-fcef4a8a6d61 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:15.809144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b1f1c-7a11-47b8-bc5d-c641666264f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:15.810435 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b1f1c-7a11-47b8-bc5d-c641666264f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:15.810719 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b1f1c-7a11-47b8-bc5d-c641666264f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:15.810986 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-692b1f1c-7a11-47b8-bc5d-c641666264f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:15.811824 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b1f1c-7a11-47b8-bc5d-c641666264f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:15.813453 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-692b1f1c-7a11-47b8-bc5d-c641666264f5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:15.826606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1085/2166] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:20:15.831051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37845a2-1897-4a49-8aa3-af611895e5b6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:15.844247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37845a2-1897-4a49-8aa3-af611895e5b6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:15.851845 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36483358-c74f-42ed-a0a0-868258ac031f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:15.852563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36483358-c74f-42ed-a0a0-868258ac031f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:15.853039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36483358-c74f-42ed-a0a0-868258ac031f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:15.853313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36483358-c74f-42ed-a0a0-868258ac031f admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:15.854124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36483358-c74f-42ed-a0a0-868258ac031f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:15.856155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36483358-c74f-42ed-a0a0-868258ac031f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:15.868761 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1082/2167] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:15 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:20:15.873361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b1f1c-7a11-47b8-bc5d-c641666264f5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:15.884237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-692b1f1c-7a11-47b8-bc5d-c641666264f5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:15.890431 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da36ac-ef54-491a-b212-c92a3046323c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:15.891196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da36ac-ef54-491a-b212-c92a3046323c admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:15.891473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da36ac-ef54-491a-b212-c92a3046323c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:15.891743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1da36ac-ef54-491a-b212-c92a3046323c admin admin] PATH_INFO: `/v3/projects/42dca08705e04c51b0b077c38e991369/users/82efd600f277499380e121bcaa902902/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:15.910375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da36ac-ef54-491a-b212-c92a3046323c admin admin] RBAC: Authorizing `identity:create_grant(project_id=42dca08705e04c51b0b077c38e991369, user_id=82efd600f277499380e121bcaa902902, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:15.911645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1da36ac-ef54-491a-b212-c92a3046323c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:15.936924 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1086/2168] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:20:15 2022] PUT /identity/v3/projects/42dca08705e04c51b0b077c38e991369/users/82efd600f277499380e121bcaa902902/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:15.940119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0469-bdf1-460a-9b7e-17822590898e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:15.940595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0469-bdf1-460a-9b7e-17822590898e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:15.941024 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1c0469-bdf1-460a-9b7e-17822590898e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:15.975334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ed1c0469-bdf1-460a-9b7e-17822590898e None None] MFA Rules not processed for user `82efd600f277499380e121bcaa902902`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:15.977969 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ed1c0469-bdf1-460a-9b7e-17822590898e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:16.036656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:16.058599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1083/2169] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:16.070191 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da36ac-ef54-491a-b212-c92a3046323c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:16.071993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d1da36ac-ef54-491a-b212-c92a3046323c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:16.145296 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1da36ac-ef54-491a-b212-c92a3046323c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:16.149516 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300868b5-bece-41a1-bf29-5d8474d07cd6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:16.150183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300868b5-bece-41a1-bf29-5d8474d07cd6 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:16.150462 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300868b5-bece-41a1-bf29-5d8474d07cd6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:16.150731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300868b5-bece-41a1-bf29-5d8474d07cd6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:16.161937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300868b5-bece-41a1-bf29-5d8474d07cd6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:16.163578 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300868b5-bece-41a1-bf29-5d8474d07cd6 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:16.175294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1087/2170] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:16 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:19.593493 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c0469-bdf1-460a-9b7e-17822590898e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:19.673307 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1c0469-bdf1-460a-9b7e-17822590898e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:19.678681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5582e9e8-dffc-4852-ab09-6e2a38e2b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:19.679347 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582e9e8-dffc-4852-ab09-6e2a38e2b6da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:19.679629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582e9e8-dffc-4852-ab09-6e2a38e2b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:19.679896 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5582e9e8-dffc-4852-ab09-6e2a38e2b6da admin admin] PATH_INFO: `/v3/users/82efd600f277499380e121bcaa902902` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:19.681097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582e9e8-dffc-4852-ab09-6e2a38e2b6da admin admin] RBAC: Authorizing `identity:delete_user(user_id=82efd600f277499380e121bcaa902902)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:19.683119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5582e9e8-dffc-4852-ab09-6e2a38e2b6da admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:19.758700 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5582e9e8-dffc-4852-ab09-6e2a38e2b6da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82efd600f277499380e121bcaa902902'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:19.781025 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5582e9e8-dffc-4852-ab09-6e2a38e2b6da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82efd600f277499380e121bcaa902902'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:19.782099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5582e9e8-dffc-4852-ab09-6e2a38e2b6da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82efd600f277499380e121bcaa902902'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:19.782935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5582e9e8-dffc-4852-ab09-6e2a38e2b6da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82efd600f277499380e121bcaa902902'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:19.795726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-5582e9e8-dffc-4852-ab09-6e2a38e2b6da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82efd600f277499380e121bcaa902902'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:19.818188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1084/2171] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:20:19 2022] DELETE /identity/v3/users/82efd600f277499380e121bcaa902902 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:19.822943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36824f-6fc9-4bba-96ce-30c7e7201a3d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:19.823629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36824f-6fc9-4bba-96ce-30c7e7201a3d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:19.823783 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b36824f-6fc9-4bba-96ce-30c7e7201a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:19.844151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0b36824f-6fc9-4bba-96ce-30c7e7201a3d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:19.845399 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0b36824f-6fc9-4bba-96ce-30c7e7201a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:19.931356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1088/2172] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:19.935943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8086b4f-0bb8-42cb-b81e-1f1957027f8a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:19.936382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8086b4f-0bb8-42cb-b81e-1f1957027f8a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:19.936506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8086b4f-0bb8-42cb-b81e-1f1957027f8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:19.944227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36824f-6fc9-4bba-96ce-30c7e7201a3d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:19.947191 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0b36824f-6fc9-4bba-96ce-30c7e7201a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:19.954866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:19.960514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c8086b4f-0bb8-42cb-b81e-1f1957027f8a None None] MFA Rules not processed for user `a5a8b4618308488dabdef27763f291e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:19.961714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c8086b4f-0bb8-42cb-b81e-1f1957027f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:20.014556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b36824f-6fc9-4bba-96ce-30c7e7201a3d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:20.018390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed666419-b828-4441-b43d-b4f19befd6a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:20.019131 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed666419-b828-4441-b43d-b4f19befd6a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:20.019660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed666419-b828-4441-b43d-b4f19befd6a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:20.019818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed666419-b828-4441-b43d-b4f19befd6a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:20.032056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1085/2173] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:20.032551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed666419-b828-4441-b43d-b4f19befd6a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:20.034048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed666419-b828-4441-b43d-b4f19befd6a5 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:20.044830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1089/2174] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:20:20.357683 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8086b4f-0bb8-42cb-b81e-1f1957027f8a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:20.360322 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c8086b4f-0bb8-42cb-b81e-1f1957027f8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:20.385104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8086b4f-0bb8-42cb-b81e-1f1957027f8a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:20.397826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eab28c-48c1-4f53-bb28-0cdca07722a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:20.398523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eab28c-48c1-4f53-bb28-0cdca07722a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:20.398797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eab28c-48c1-4f53-bb28-0cdca07722a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:20.399061 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eab28c-48c1-4f53-bb28-0cdca07722a2 admin admin] PATH_INFO: `/v3/projects/42dca08705e04c51b0b077c38e991369` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:20.400376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eab28c-48c1-4f53-bb28-0cdca07722a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42dca08705e04c51b0b077c38e991369)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:20.402659 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eab28c-48c1-4f53-bb28-0cdca07722a2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:20.411636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:20.467508 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c3eab28c-48c1-4f53-bb28-0cdca07722a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42dca08705e04c51b0b077c38e991369', 'request_id': 'req-c3eab28c-48c1-4f53-bb28-0cdca07722a2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:20.475860 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c3eab28c-48c1-4f53-bb28-0cdca07722a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42dca08705e04c51b0b077c38e991369', 'request_id': 'req-c3eab28c-48c1-4f53-bb28-0cdca07722a2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:20.489292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c3eab28c-48c1-4f53-bb28-0cdca07722a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42dca08705e04c51b0b077c38e991369', 'request_id': 'req-c3eab28c-48c1-4f53-bb28-0cdca07722a2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:20.503553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c3eab28c-48c1-4f53-bb28-0cdca07722a2 admin admin] The token cache is being invalidate because project 42dca08705e04c51b0b077c38e991369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:20:20.503918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c3eab28c-48c1-4f53-bb28-0cdca07722a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:20.504690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c3eab28c-48c1-4f53-bb28-0cdca07722a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:20.507002 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1086/2175] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:20:20 2022] DELETE /identity/v3/projects/42dca08705e04c51b0b077c38e991369 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:20.513206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c17c7-e71f-4e24-90b7-a0cb355128bb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:20.513575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c17c7-e71f-4e24-90b7-a0cb355128bb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:20.513949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65c17c7-e71f-4e24-90b7-a0cb355128bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:20.537977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d65c17c7-e71f-4e24-90b7-a0cb355128bb None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:20.539281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d65c17c7-e71f-4e24-90b7-a0cb355128bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:20.630076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1090/2176] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:20.638690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8b6a1-9ab7-45c2-9781-701ec841e7e6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:20.639695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8b6a1-9ab7-45c2-9781-701ec841e7e6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:20.639979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc8b6a1-9ab7-45c2-9781-701ec841e7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:20.666062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1bc8b6a1-9ab7-45c2-9781-701ec841e7e6 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:20.668005 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1bc8b6a1-9ab7-45c2-9781-701ec841e7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:20.679123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1087/2177] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:20.683833 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c17c7-e71f-4e24-90b7-a0cb355128bb None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:20.704749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65c17c7-e71f-4e24-90b7-a0cb355128bb None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:20.712459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c45e3f-46e0-4e1b-abcd-8ff4b26d31da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:20.713446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c45e3f-46e0-4e1b-abcd-8ff4b26d31da admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:20.713769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c45e3f-46e0-4e1b-abcd-8ff4b26d31da admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:20.714066 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c45e3f-46e0-4e1b-abcd-8ff4b26d31da admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:20.714736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c45e3f-46e0-4e1b-abcd-8ff4b26d31da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:20:20.715162 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c45e3f-46e0-4e1b-abcd-8ff4b26d31da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:20.716791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c45e3f-46e0-4e1b-abcd-8ff4b26d31da admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:20.733927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1091/2178] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:20:20.736399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8b6a1-9ab7-45c2-9781-701ec841e7e6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:20.748160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc8b6a1-9ab7-45c2-9781-701ec841e7e6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:20.753834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecc4df-6409-4532-8f13-d30d93122a8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:20.754744 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecc4df-6409-4532-8f13-d30d93122a8d admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:20.755131 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecc4df-6409-4532-8f13-d30d93122a8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:20.755502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ecc4df-6409-4532-8f13-d30d93122a8d admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:20.756247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecc4df-6409-4532-8f13-d30d93122a8d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:20.758759 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ecc4df-6409-4532-8f13-d30d93122a8d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:20.796139 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1088/2179] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:20:20 2022] POST /identity/v3/projects => generated 391 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:20:20.800284 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c45e3f-46e0-4e1b-abcd-8ff4b26d31da admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:20.814508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c45e3f-46e0-4e1b-abcd-8ff4b26d31da admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:20.929068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ce019-a1ef-4786-8383-6f5a58478f0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:20.930595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ce019-a1ef-4786-8383-6f5a58478f0d admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:20.930987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ce019-a1ef-4786-8383-6f5a58478f0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:20.931546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247ce019-a1ef-4786-8383-6f5a58478f0d admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:20.932471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ce019-a1ef-4786-8383-6f5a58478f0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:20.934892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247ce019-a1ef-4786-8383-6f5a58478f0d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:20.977818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1092/2180] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:20:20 2022] POST /identity/v3/users => generated 296 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:20:20.983126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecc4df-6409-4532-8f13-d30d93122a8d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:20.998111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ecc4df-6409-4532-8f13-d30d93122a8d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:21.004896 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20ce96-3a90-45d3-90bf-225f8e142135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:21.006335 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20ce96-3a90-45d3-90bf-225f8e142135 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:21.006630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20ce96-3a90-45d3-90bf-225f8e142135 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:21.006905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a20ce96-3a90-45d3-90bf-225f8e142135 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:21.007846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20ce96-3a90-45d3-90bf-225f8e142135 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:21.010641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a20ce96-3a90-45d3-90bf-225f8e142135 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:21.032537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1089/2181] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:20:21.033616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ce019-a1ef-4786-8383-6f5a58478f0d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:21.054895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247ce019-a1ef-4786-8383-6f5a58478f0d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:21.063435 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6d9792-c4e3-4557-9391-00cb707abcbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:21.064939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d9792-c4e3-4557-9391-00cb707abcbd admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:21.065563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d9792-c4e3-4557-9391-00cb707abcbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:21.066040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6d9792-c4e3-4557-9391-00cb707abcbd admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:21.066808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d9792-c4e3-4557-9391-00cb707abcbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:21.069077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6d9792-c4e3-4557-9391-00cb707abcbd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:21.105310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1093/2182] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:21 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:20:21.111290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20ce96-3a90-45d3-90bf-225f8e142135 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:21.138838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a20ce96-3a90-45d3-90bf-225f8e142135 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:21.148753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09922-0eb5-4879-9675-5f2e7f906a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:21.151079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09922-0eb5-4879-9675-5f2e7f906a2f admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:21.153122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09922-0eb5-4879-9675-5f2e7f906a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:21.153808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d09922-0eb5-4879-9675-5f2e7f906a2f admin admin] PATH_INFO: `/v3/projects/8b241e31f2224774af58f670622222d3/users/ecc975d5662849549b5ca537c88d6eb8/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:21.190299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09922-0eb5-4879-9675-5f2e7f906a2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b241e31f2224774af58f670622222d3, user_id=ecc975d5662849549b5ca537c88d6eb8, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:21.195536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d09922-0eb5-4879-9675-5f2e7f906a2f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:21.234926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1090/2183] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:20:21 2022] PUT /identity/v3/projects/8b241e31f2224774af58f670622222d3/users/ecc975d5662849549b5ca537c88d6eb8/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:21.242139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bc7b8-b2b4-4c68-a935-f37b4d9553e4 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:21.242139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bc7b8-b2b4-4c68-a935-f37b4d9553e4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:21.242721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229bc7b8-b2b4-4c68-a935-f37b4d9553e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:21.289071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:21.293893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-229bc7b8-b2b4-4c68-a935-f37b4d9553e4 None None] MFA Rules not processed for user `ecc975d5662849549b5ca537c88d6eb8`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:21.298345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-229bc7b8-b2b4-4c68-a935-f37b4d9553e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:21.443235 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1094/2184] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:21.472108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09922-0eb5-4879-9675-5f2e7f906a2f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:21.473928 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-16d09922-0eb5-4879-9675-5f2e7f906a2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:21.593599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d09922-0eb5-4879-9675-5f2e7f906a2f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:21.601561 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44beb40b-dd0e-4e3d-873b-18baa2fe6107 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:21.602472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb40b-dd0e-4e3d-873b-18baa2fe6107 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:21.603521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb40b-dd0e-4e3d-873b-18baa2fe6107 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:21.603893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44beb40b-dd0e-4e3d-873b-18baa2fe6107 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:21.644441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44beb40b-dd0e-4e3d-873b-18baa2fe6107 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:21.646319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44beb40b-dd0e-4e3d-873b-18baa2fe6107 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:21.688216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1091/2185] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:22.891414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bc7b8-b2b4-4c68-a935-f37b4d9553e4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:22.893510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-229bc7b8-b2b4-4c68-a935-f37b4d9553e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:22.982560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229bc7b8-b2b4-4c68-a935-f37b4d9553e4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:22.987168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:22.987854 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:22.988103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:22.988405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] PATH_INFO: `/v3/users/aee9e37550904aaf8b9276d86c78b2f5` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:22.989537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=aee9e37550904aaf8b9276d86c78b2f5)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:22.991510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:23.053275 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aee9e37550904aaf8b9276d86c78b2f5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:23.065230 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aee9e37550904aaf8b9276d86c78b2f5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:23.066039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aee9e37550904aaf8b9276d86c78b2f5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:23.066714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aee9e37550904aaf8b9276d86c78b2f5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:23.074822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aee9e37550904aaf8b9276d86c78b2f5'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:23.100704 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1095/2186] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:20:22 2022] DELETE /identity/v3/users/aee9e37550904aaf8b9276d86c78b2f5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:23.105301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a7a4b-91ce-4b34-8ebe-d1c35a5f1ec8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:23.105811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a7a4b-91ce-4b34-8ebe-d1c35a5f1ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:23.105987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618a7a4b-91ce-4b34-8ebe-d1c35a5f1ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:23.127898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-618a7a4b-91ce-4b34-8ebe-d1c35a5f1ec8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:23.129137 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-618a7a4b-91ce-4b34-8ebe-d1c35a5f1ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:23.199257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:23.237246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1092/2187] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:23.248097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:23.250045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:23.283784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:23.332656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e02b7f8-9ba4-47cd-b12b-024c7aba8e6c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:23.336687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee06669c-9360-431b-83fe-423a55525742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:23.337571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06669c-9360-431b-83fe-423a55525742 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:23.338110 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06669c-9360-431b-83fe-423a55525742 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:23.338380 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee06669c-9360-431b-83fe-423a55525742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:23.351853 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06669c-9360-431b-83fe-423a55525742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:23.354390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee06669c-9360-431b-83fe-423a55525742 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:23.377328 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1096/2188] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:23.844365 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a7a4b-91ce-4b34-8ebe-d1c35a5f1ec8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:23.845906 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-618a7a4b-91ce-4b34-8ebe-d1c35a5f1ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:23.861150 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618a7a4b-91ce-4b34-8ebe-d1c35a5f1ec8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:23.866165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3157f72-6264-4cc8-bfdb-04bb460ec54e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:23.867465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3157f72-6264-4cc8-bfdb-04bb460ec54e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:23.867465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3157f72-6264-4cc8-bfdb-04bb460ec54e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:23.867465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3157f72-6264-4cc8-bfdb-04bb460ec54e admin admin] PATH_INFO: `/v3/projects/ba8c8155267948a99eafaceb0f6305f4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:23.868609 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3157f72-6264-4cc8-bfdb-04bb460ec54e admin admin] RBAC: Authorizing `identity:delete_project(project_id=ba8c8155267948a99eafaceb0f6305f4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:23.870767 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3157f72-6264-4cc8-bfdb-04bb460ec54e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:23.926395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b3157f72-6264-4cc8-bfdb-04bb460ec54e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ba8c8155267948a99eafaceb0f6305f4', 'request_id': 'req-b3157f72-6264-4cc8-bfdb-04bb460ec54e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:23.934438 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b3157f72-6264-4cc8-bfdb-04bb460ec54e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ba8c8155267948a99eafaceb0f6305f4', 'request_id': 'req-b3157f72-6264-4cc8-bfdb-04bb460ec54e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:23.944371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b3157f72-6264-4cc8-bfdb-04bb460ec54e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ba8c8155267948a99eafaceb0f6305f4', 'request_id': 'req-b3157f72-6264-4cc8-bfdb-04bb460ec54e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:23.957882 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b3157f72-6264-4cc8-bfdb-04bb460ec54e admin admin] The token cache is being invalidate because project ba8c8155267948a99eafaceb0f6305f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:20:23.958203 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b3157f72-6264-4cc8-bfdb-04bb460ec54e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:23.958974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b3157f72-6264-4cc8-bfdb-04bb460ec54e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:23.960521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1093/2189] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:20:23 2022] DELETE /identity/v3/projects/ba8c8155267948a99eafaceb0f6305f4 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:23.966063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8bb6-ed9d-488c-b64c-2f6954507be8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:23.966581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8bb6-ed9d-488c-b64c-2f6954507be8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:23.966581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508c8bb6-ed9d-488c-b64c-2f6954507be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:23.988408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-508c8bb6-ed9d-488c-b64c-2f6954507be8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:23.989642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-508c8bb6-ed9d-488c-b64c-2f6954507be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:24.074988 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1097/2190] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:24.083162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6497401-a12f-4b42-a244-8e6a111bbd5e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:24.083689 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6497401-a12f-4b42-a244-8e6a111bbd5e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:24.084142 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6497401-a12f-4b42-a244-8e6a111bbd5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:24.128376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d6497401-a12f-4b42-a244-8e6a111bbd5e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:24.130727 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d6497401-a12f-4b42-a244-8e6a111bbd5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:24.140522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1094/2191] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:20:24.145355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c8bb6-ed9d-488c-b64c-2f6954507be8 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:24.160656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508c8bb6-ed9d-488c-b64c-2f6954507be8 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:24.169061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec1e64-3257-45e9-9924-410a8168dca5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:24.170164 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec1e64-3257-45e9-9924-410a8168dca5 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:24.170617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec1e64-3257-45e9-9924-410a8168dca5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:24.171027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ec1e64-3257-45e9-9924-410a8168dca5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:24.171832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec1e64-3257-45e9-9924-410a8168dca5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:20:24.172275 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec1e64-3257-45e9-9924-410a8168dca5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:24.174239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ec1e64-3257-45e9-9924-410a8168dca5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:24.190618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1098/2192] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:20:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:20:24.195299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6497401-a12f-4b42-a244-8e6a111bbd5e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:24.219535 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6497401-a12f-4b42-a244-8e6a111bbd5e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:24.237505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6503b-ae73-4787-95b1-7b63a4d9f043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:24.238155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6503b-ae73-4787-95b1-7b63a4d9f043 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:24.238394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6503b-ae73-4787-95b1-7b63a4d9f043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:24.238831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec6503b-ae73-4787-95b1-7b63a4d9f043 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:24.239662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6503b-ae73-4787-95b1-7b63a4d9f043 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:24.241562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec6503b-ae73-4787-95b1-7b63a4d9f043 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:24.286075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1095/2193] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:20:24 2022] POST /identity/v3/projects => generated 363 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:20:24.289639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec1e64-3257-45e9-9924-410a8168dca5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:24.306143 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ec1e64-3257-45e9-9924-410a8168dca5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:24.375885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904243bc-d843-40cb-b52f-914ae44bafb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:24.376505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904243bc-d843-40cb-b52f-914ae44bafb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:24.376784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904243bc-d843-40cb-b52f-914ae44bafb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:24.377078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904243bc-d843-40cb-b52f-914ae44bafb3 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:24.377725 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904243bc-d843-40cb-b52f-914ae44bafb3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:24.379752 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904243bc-d843-40cb-b52f-914ae44bafb3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:24.404379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1099/2194] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:20:24 2022] POST /identity/v3/users => generated 282 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:20:24.411067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6503b-ae73-4787-95b1-7b63a4d9f043 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:24.427459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec6503b-ae73-4787-95b1-7b63a4d9f043 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:24.434140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63895bd9-50a4-4eca-822e-1a9853375481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:24.434939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63895bd9-50a4-4eca-822e-1a9853375481 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:24.435248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63895bd9-50a4-4eca-822e-1a9853375481 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:24.435507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63895bd9-50a4-4eca-822e-1a9853375481 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:24.436338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63895bd9-50a4-4eca-822e-1a9853375481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:24.438092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63895bd9-50a4-4eca-822e-1a9853375481 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:24.449974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1096/2195] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:20:24.454256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904243bc-d843-40cb-b52f-914ae44bafb3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:24.465695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904243bc-d843-40cb-b52f-914ae44bafb3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:24.471230 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d85834-1b38-47fc-8ba0-dc1a3ffa9b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:24.471873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d85834-1b38-47fc-8ba0-dc1a3ffa9b50 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:24.472150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d85834-1b38-47fc-8ba0-dc1a3ffa9b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:24.472424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d85834-1b38-47fc-8ba0-dc1a3ffa9b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:24.473077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d85834-1b38-47fc-8ba0-dc1a3ffa9b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:24.475082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d85834-1b38-47fc-8ba0-dc1a3ffa9b50 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:24.488026 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1100/2196] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:20:24.492424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63895bd9-50a4-4eca-822e-1a9853375481 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:24.503913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63895bd9-50a4-4eca-822e-1a9853375481 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:24.512095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18dc51-4858-49a9-bdb1-3e2b772e230b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:24.512802 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18dc51-4858-49a9-bdb1-3e2b772e230b admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:24.513277 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18dc51-4858-49a9-bdb1-3e2b772e230b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:24.513454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18dc51-4858-49a9-bdb1-3e2b772e230b admin admin] PATH_INFO: `/v3/projects/b8203bae81a942099a80ebb47f2c17ab/users/55bbce5f921e4c6889c5712031b06d40/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:24.531804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18dc51-4858-49a9-bdb1-3e2b772e230b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8203bae81a942099a80ebb47f2c17ab, user_id=55bbce5f921e4c6889c5712031b06d40, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:24.534633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18dc51-4858-49a9-bdb1-3e2b772e230b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:24.553381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1097/2197] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:20:24 2022] PUT /identity/v3/projects/b8203bae81a942099a80ebb47f2c17ab/users/55bbce5f921e4c6889c5712031b06d40/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:24.564031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62309-dea6-4c7c-9064-e566611db1f4 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:24.564305 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62309-dea6-4c7c-9064-e566611db1f4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:24.564697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a62309-dea6-4c7c-9064-e566611db1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:24.601254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-19a62309-dea6-4c7c-9064-e566611db1f4 None None] MFA Rules not processed for user `55bbce5f921e4c6889c5712031b06d40`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:24.602720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-19a62309-dea6-4c7c-9064-e566611db1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:24.642766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:24.716968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1101/2198] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:24.757446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18dc51-4858-49a9-bdb1-3e2b772e230b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:24.759355 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cc18dc51-4858-49a9-bdb1-3e2b772e230b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:24.841912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18dc51-4858-49a9-bdb1-3e2b772e230b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:24.851729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8da328-2337-4f04-aaa5-1e74f316430e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:24.852393 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8da328-2337-4f04-aaa5-1e74f316430e service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:24.853360 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8da328-2337-4f04-aaa5-1e74f316430e service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:24.853360 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8da328-2337-4f04-aaa5-1e74f316430e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:24.876133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8da328-2337-4f04-aaa5-1e74f316430e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:24.877754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8da328-2337-4f04-aaa5-1e74f316430e service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:24.882447 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:24.895228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1098/2199] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:24 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:32.537830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a62309-dea6-4c7c-9064-e566611db1f4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:32.539624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-19a62309-dea6-4c7c-9064-e566611db1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:32.655213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a62309-dea6-4c7c-9064-e566611db1f4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:32.661346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:32.662168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:32.662508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:32.662850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] PATH_INFO: `/v3/users/ecc975d5662849549b5ca537c88d6eb8` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:32.664436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=ecc975d5662849549b5ca537c88d6eb8)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:32.668046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:32.757895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ecc975d5662849549b5ca537c88d6eb8'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:32.769152 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ecc975d5662849549b5ca537c88d6eb8'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:32.770136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ecc975d5662849549b5ca537c88d6eb8'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:32.770919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ecc975d5662849549b5ca537c88d6eb8'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:32.795334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ecc975d5662849549b5ca537c88d6eb8'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:32.821242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1102/2200] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:20:32 2022] DELETE /identity/v3/users/ecc975d5662849549b5ca537c88d6eb8 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:32.826685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f2b86-5473-4973-ae68-5ef33d50b5b2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:32.829259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f2b86-5473-4973-ae68-5ef33d50b5b2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:32.829551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8f2b86-5473-4973-ae68-5ef33d50b5b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:32.854962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5c8f2b86-5473-4973-ae68-5ef33d50b5b2 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:32.856962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5c8f2b86-5473-4973-ae68-5ef33d50b5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:32.944056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1099/2201] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:32.961421 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:32.964766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:33.026594 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:33.046488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df87e2-3307-4247-a38c-a139e59500bb admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:33.050842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17158192-8ee6-4976-8232-d2d6d8f83369 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:33.051496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17158192-8ee6-4976-8232-d2d6d8f83369 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:33.051868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17158192-8ee6-4976-8232-d2d6d8f83369 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:33.052145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17158192-8ee6-4976-8232-d2d6d8f83369 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:33.064073 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17158192-8ee6-4976-8232-d2d6d8f83369 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:33.065658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17158192-8ee6-4976-8232-d2d6d8f83369 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:33.081919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1103/2202] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:33.434563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f2b86-5473-4973-ae68-5ef33d50b5b2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:33.437073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5c8f2b86-5473-4973-ae68-5ef33d50b5b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:33.474465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8f2b86-5473-4973-ae68-5ef33d50b5b2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:33.491415 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df52ab1f-4630-4986-981a-191f896087a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:33.492662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52ab1f-4630-4986-981a-191f896087a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:33.493215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52ab1f-4630-4986-981a-191f896087a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:33.493518 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df52ab1f-4630-4986-981a-191f896087a3 admin admin] PATH_INFO: `/v3/projects/8b241e31f2224774af58f670622222d3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:33.495370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52ab1f-4630-4986-981a-191f896087a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b241e31f2224774af58f670622222d3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:33.497098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df52ab1f-4630-4986-981a-191f896087a3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:33.573000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-df52ab1f-4630-4986-981a-191f896087a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b241e31f2224774af58f670622222d3', 'request_id': 'req-df52ab1f-4630-4986-981a-191f896087a3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:33.583264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-df52ab1f-4630-4986-981a-191f896087a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b241e31f2224774af58f670622222d3', 'request_id': 'req-df52ab1f-4630-4986-981a-191f896087a3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:33.594831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-df52ab1f-4630-4986-981a-191f896087a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b241e31f2224774af58f670622222d3', 'request_id': 'req-df52ab1f-4630-4986-981a-191f896087a3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:33.610347 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-df52ab1f-4630-4986-981a-191f896087a3 admin admin] The token cache is being invalidate because project 8b241e31f2224774af58f670622222d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:20:33.610664 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-df52ab1f-4630-4986-981a-191f896087a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:33.611428 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-df52ab1f-4630-4986-981a-191f896087a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:20:33.616555 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1100/2203] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:20:33 2022] DELETE /identity/v3/projects/8b241e31f2224774af58f670622222d3 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:20:35.800429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d21f-c712-429b-883f-3a50095e50cc None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:35.801029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d21f-c712-429b-883f-3a50095e50cc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:35.801029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f407d21f-c712-429b-883f-3a50095e50cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:35.824263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f407d21f-c712-429b-883f-3a50095e50cc None None] MFA Rules not processed for user `6a7f1fb1137c4fa7aa572631db1b00ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:35.825523 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f407d21f-c712-429b-883f-3a50095e50cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:35.891022 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1104/2204] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:20:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:42.627981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b2383-ac25-4584-be94-05c1452bfac8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:42.629329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b2383-ac25-4584-be94-05c1452bfac8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:42.629812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b2383-ac25-4584-be94-05c1452bfac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:42.654228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5c0b2383-ac25-4584-be94-05c1452bfac8 None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:42.654228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5c0b2383-ac25-4584-be94-05c1452bfac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:42.762274 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1101/2205] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:20:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:42.774689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407d21f-c712-429b-883f-3a50095e50cc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:42.776245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f407d21f-c712-429b-883f-3a50095e50cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:42.896454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f407d21f-c712-429b-883f-3a50095e50cc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:42.902894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59765e3d-8a3e-4899-890f-285639f6fbb8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:42.904180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59765e3d-8a3e-4899-890f-285639f6fbb8 service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:42.904180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59765e3d-8a3e-4899-890f-285639f6fbb8 service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:42.904180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59765e3d-8a3e-4899-890f-285639f6fbb8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:42.917691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59765e3d-8a3e-4899-890f-285639f6fbb8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:42.921132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59765e3d-8a3e-4899-890f-285639f6fbb8 service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:42.931239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1105/2206] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:20:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 19:20:43.431404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f46d7-686c-480f-9bd3-6715149c1264 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:43.431693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f46d7-686c-480f-9bd3-6715149c1264 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:43.435946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f46d7-686c-480f-9bd3-6715149c1264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:43.461216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-947f46d7-686c-480f-9bd3-6715149c1264 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:43.463583 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-947f46d7-686c-480f-9bd3-6715149c1264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:43.497206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:43.571146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1102/2207] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 19:20:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:20:43.588274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59765e3d-8a3e-4899-890f-285639f6fbb8 service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:43.590222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-59765e3d-8a3e-4899-890f-285639f6fbb8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:43.693653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59765e3d-8a3e-4899-890f-285639f6fbb8 service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:43.700710 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ed2cd-3d8d-4080-9520-f56e186b131f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:43.701337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ed2cd-3d8d-4080-9520-f56e186b131f service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:43.701609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ed2cd-3d8d-4080-9520-f56e186b131f service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:43.701906 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688ed2cd-3d8d-4080-9520-f56e186b131f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:43.711221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ed2cd-3d8d-4080-9520-f56e186b131f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:43.714000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688ed2cd-3d8d-4080-9520-f56e186b131f service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:43.728088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1106/2208] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:47.776648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a2524-95c5-42e9-a6f3-a644eb8020c0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:47.777278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a2524-95c5-42e9-a6f3-a644eb8020c0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:47.777624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7a2524-95c5-42e9-a6f3-a644eb8020c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:47.805816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-df7a2524-95c5-42e9-a6f3-a644eb8020c0 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:47.807764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-df7a2524-95c5-42e9-a6f3-a644eb8020c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:47.843520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1103/2209] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 19:20:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:47.875044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ed2cd-3d8d-4080-9520-f56e186b131f service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:47.877283 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-688ed2cd-3d8d-4080-9520-f56e186b131f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:47.894849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:20:47.910741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688ed2cd-3d8d-4080-9520-f56e186b131f service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:47.928295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01078626-f670-4e78-869e-90379d613c02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:47.928931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01078626-f670-4e78-869e-90379d613c02 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:47.929204 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01078626-f670-4e78-869e-90379d613c02 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:47.929649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01078626-f670-4e78-869e-90379d613c02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:47.939935 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01078626-f670-4e78-869e-90379d613c02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:47.943216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01078626-f670-4e78-869e-90379d613c02 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:47.964141 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1107/2210] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:52.428022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840ccf0-780e-49da-b2f3-c45f0a6b422b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:52.429237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840ccf0-780e-49da-b2f3-c45f0a6b422b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:52.429693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d840ccf0-780e-49da-b2f3-c45f0a6b422b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:52.456811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d840ccf0-780e-49da-b2f3-c45f0a6b422b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:52.458253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d840ccf0-780e-49da-b2f3-c45f0a6b422b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:52.473386 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1104/2211] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 19:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:20:52.499037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01078626-f670-4e78-869e-90379d613c02 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:52.514134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01078626-f670-4e78-869e-90379d613c02 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:52.522195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97522d-af7a-4a9b-88f3-56468157eef5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:52.523154 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97522d-af7a-4a9b-88f3-56468157eef5 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:52.523586 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97522d-af7a-4a9b-88f3-56468157eef5 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:52.523950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b97522d-af7a-4a9b-88f3-56468157eef5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:52.534498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97522d-af7a-4a9b-88f3-56468157eef5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:52.536512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b97522d-af7a-4a9b-88f3-56468157eef5 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:52.547946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1108/2212] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:20:57.303552 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0629b1-5c3e-4fd4-a49a-d74f419ee22e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:57.304023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0629b1-5c3e-4fd4-a49a-d74f419ee22e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:57.304513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0629b1-5c3e-4fd4-a49a-d74f419ee22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:57.329971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-cd0629b1-5c3e-4fd4-a49a-d74f419ee22e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:20:57.331228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cd0629b1-5c3e-4fd4-a49a-d74f419ee22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:20:57.342084 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1105/2213] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 19:20:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:20:57.362457 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97522d-af7a-4a9b-88f3-56468157eef5 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:20:57.374755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b97522d-af7a-4a9b-88f3-56468157eef5 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:20:57.380467 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd838ade-6727-4f90-937a-ddf07b2c57e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:20:57.381104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd838ade-6727-4f90-937a-ddf07b2c57e8 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:20:57.381384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd838ade-6727-4f90-937a-ddf07b2c57e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:20:57.381657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd838ade-6727-4f90-937a-ddf07b2c57e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:20:57.391402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd838ade-6727-4f90-937a-ddf07b2c57e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:20:57.392920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd838ade-6727-4f90-937a-ddf07b2c57e8 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:20:57.403772 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1109/2214] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:20:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:21:00.396729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0629b1-5c3e-4fd4-a49a-d74f419ee22e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:00.398868 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cd0629b1-5c3e-4fd4-a49a-d74f419ee22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:00.415868 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0629b1-5c3e-4fd4-a49a-d74f419ee22e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:00.422974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:00.423661 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:00.424259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:00.424708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] PATH_INFO: `/v3/users/55bbce5f921e4c6889c5712031b06d40` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:00.426089 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=55bbce5f921e4c6889c5712031b06d40)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:00.428900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:00.494683 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '55bbce5f921e4c6889c5712031b06d40'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:21:00.506657 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '55bbce5f921e4c6889c5712031b06d40'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:21:00.507326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '55bbce5f921e4c6889c5712031b06d40'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:21:00.507952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '55bbce5f921e4c6889c5712031b06d40'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:21:00.517183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '55bbce5f921e4c6889c5712031b06d40'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:21:00.536443 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1106/2215] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:21:00 2022] DELETE /identity/v3/users/55bbce5f921e4c6889c5712031b06d40 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:21:00.541192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb33ca-ddc1-4be3-979f-8fe8270cb1e0 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:00.541930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb33ca-ddc1-4be3-979f-8fe8270cb1e0 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:00.541930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fb33ca-ddc1-4be3-979f-8fe8270cb1e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:00.563574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-25fb33ca-ddc1-4be3-979f-8fe8270cb1e0 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:00.564792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-25fb33ca-ddc1-4be3-979f-8fe8270cb1e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:00.634881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1110/2216] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:00.646801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:00.648349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:00.709834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ee096-b1a7-48f1-8e3d-c8999f44f3c0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:00.715456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844ed843-d03a-4f10-8782-234bdeb7441e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:00.716094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ed843-d03a-4f10-8782-234bdeb7441e service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:00.716376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ed843-d03a-4f10-8782-234bdeb7441e service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:00.716655 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844ed843-d03a-4f10-8782-234bdeb7441e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:00.726938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ed843-d03a-4f10-8782-234bdeb7441e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:00.729004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844ed843-d03a-4f10-8782-234bdeb7441e service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:00.740287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1107/2217] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:21:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:21:00.888857 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1371e1-0732-4684-b19b-548346f846c8 None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:00.889122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1371e1-0732-4684-b19b-548346f846c8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:00.889393 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1371e1-0732-4684-b19b-548346f846c8 None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:00.890781 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1111/2218] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:21:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:21:00.899975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105cfbd-46f7-47b6-bbf9-5ec5cbb157cc None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:00.900270 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105cfbd-46f7-47b6-bbf9-5ec5cbb157cc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:00.900713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7105cfbd-46f7-47b6-bbf9-5ec5cbb157cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:00.925541 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7105cfbd-46f7-47b6-bbf9-5ec5cbb157cc None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:00.927408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7105cfbd-46f7-47b6-bbf9-5ec5cbb157cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:00.947048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:21:01.016853 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1108/2219] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:21:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:01.032641 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1371e1-0732-4684-b19b-548346f846c8 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:01.034493 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-8e1371e1-0732-4684-b19b-548346f846c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:01.120246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1371e1-0732-4684-b19b-548346f846c8 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:01.132879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105cfbd-46f7-47b6-bbf9-5ec5cbb157cc None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:01.134303 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7105cfbd-46f7-47b6-bbf9-5ec5cbb157cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:01.137160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d08437e-a6e9-4a10-9258-814041e607b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06d8a144ecf43fc8de82346758b6065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:01.137819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08437e-a6e9-4a10-9258-814041e607b2 service glance] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:01.141362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08437e-a6e9-4a10-9258-814041e607b2 service glance] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:01.141984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d08437e-a6e9-4a10-9258-814041e607b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:01.149190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7105cfbd-46f7-47b6-bbf9-5ec5cbb157cc None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:01.158973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08437e-a6e9-4a10-9258-814041e607b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:01.160781 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d08437e-a6e9-4a10-9258-814041e607b2 service glance] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:01.167121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e6a591-889e-4d2c-a901-4224b1bc1851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:01.167804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6a591-889e-4d2c-a901-4224b1bc1851 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:01.168079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6a591-889e-4d2c-a901-4224b1bc1851 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:01.168347 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e6a591-889e-4d2c-a901-4224b1bc1851 admin admin] PATH_INFO: `/v3/projects/b8203bae81a942099a80ebb47f2c17ab` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:01.169506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6a591-889e-4d2c-a901-4224b1bc1851 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8203bae81a942099a80ebb47f2c17ab)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:01.171453 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e6a591-889e-4d2c-a901-4224b1bc1851 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:01.175902 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1112/2220] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:21:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:21:01.226824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b8e6a591-889e-4d2c-a901-4224b1bc1851 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8203bae81a942099a80ebb47f2c17ab', 'request_id': 'req-b8e6a591-889e-4d2c-a901-4224b1bc1851'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:21:01.235391 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b8e6a591-889e-4d2c-a901-4224b1bc1851 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8203bae81a942099a80ebb47f2c17ab', 'request_id': 'req-b8e6a591-889e-4d2c-a901-4224b1bc1851'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:21:01.245964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b8e6a591-889e-4d2c-a901-4224b1bc1851 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8203bae81a942099a80ebb47f2c17ab', 'request_id': 'req-b8e6a591-889e-4d2c-a901-4224b1bc1851'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:21:01.258834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b8e6a591-889e-4d2c-a901-4224b1bc1851 admin admin] The token cache is being invalidate because project b8203bae81a942099a80ebb47f2c17ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:21:01.259076 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b8e6a591-889e-4d2c-a901-4224b1bc1851 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:21:01.260603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b8e6a591-889e-4d2c-a901-4224b1bc1851 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:21:01.263140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1109/2221] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:21:01 2022] DELETE /identity/v3/projects/b8203bae81a942099a80ebb47f2c17ab => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:21:01.264677 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0188c-0da6-4726-b72c-fe998a386bfb None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:01.264990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0188c-0da6-4726-b72c-fe998a386bfb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:01.265267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa0188c-0da6-4726-b72c-fe998a386bfb None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:01.266679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1113/2222] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:21:01.272394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c7d93-531f-4450-98bf-c80f20e8a929 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:01.272715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c7d93-531f-4450-98bf-c80f20e8a929 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:01.273075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c7d93-531f-4450-98bf-c80f20e8a929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:01.303438 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-076c7d93-531f-4450-98bf-c80f20e8a929 None None] MFA Rules not processed for user `4591e01ab4954b22a81f6b09cdb2d544`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:01.304738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-076c7d93-531f-4450-98bf-c80f20e8a929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:01.376545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1110/2223] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:21:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:01.383275 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0188c-0da6-4726-b72c-fe998a386bfb None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:01.385308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cfa0188c-0da6-4726-b72c-fe998a386bfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:01.404981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa0188c-0da6-4726-b72c-fe998a386bfb None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:01.408704 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ac71e0-08f1-4107-87e3-4bfc1332f12b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:01.409423 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac71e0-08f1-4107-87e3-4bfc1332f12b service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:01.409852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac71e0-08f1-4107-87e3-4bfc1332f12b service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:01.410002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ac71e0-08f1-4107-87e3-4bfc1332f12b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:01.418748 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac71e0-08f1-4107-87e3-4bfc1332f12b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:01.420211 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ac71e0-08f1-4107-87e3-4bfc1332f12b service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:01.429480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1114/2224] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:21:01 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:21:01.521511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb5385-b6ac-48f1-8c5b-e893dfb29db5 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:01.522192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb5385-b6ac-48f1-8c5b-e893dfb29db5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:01.522192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65bb5385-b6ac-48f1-8c5b-e893dfb29db5 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:01.523357 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1111/2225] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:21:01.529159 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f077a8-14d0-4fc3-98d0-2f5f9bdeaf3d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:01.529443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f077a8-14d0-4fc3-98d0-2f5f9bdeaf3d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:01.529713 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f077a8-14d0-4fc3-98d0-2f5f9bdeaf3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:01.551359 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-45f077a8-14d0-4fc3-98d0-2f5f9bdeaf3d None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:01.552587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-45f077a8-14d0-4fc3-98d0-2f5f9bdeaf3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:01.604232 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:21:01.626239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1115/2226] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:21:01 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:01.638630 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb5385-b6ac-48f1-8c5b-e893dfb29db5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:01.651139 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65bb5385-b6ac-48f1-8c5b-e893dfb29db5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:01.655753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463206aa-3545-4188-92ac-09a0a130cfe1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:01.656375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463206aa-3545-4188-92ac-09a0a130cfe1 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:01.656654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463206aa-3545-4188-92ac-09a0a130cfe1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:01.656919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-463206aa-3545-4188-92ac-09a0a130cfe1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:01.669089 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463206aa-3545-4188-92ac-09a0a130cfe1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:01.670638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-463206aa-3545-4188-92ac-09a0a130cfe1 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:01.682397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1112/2227] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:21:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:21:02.535060 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e7018-581f-45e1-a4ff-80241a41ef33 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:02.536166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e7018-581f-45e1-a4ff-80241a41ef33 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:02.536517 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e7018-581f-45e1-a4ff-80241a41ef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:02.560896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-793e7018-581f-45e1-a4ff-80241a41ef33 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:02.562158 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-793e7018-581f-45e1-a4ff-80241a41ef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:02.639829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1116/2228] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 19:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:02.661450 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463206aa-3545-4188-92ac-09a0a130cfe1 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:02.663511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-463206aa-3545-4188-92ac-09a0a130cfe1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:02.681851 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-463206aa-3545-4188-92ac-09a0a130cfe1 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:02.688288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f133b8c-169b-43e9-a9db-476eba134761 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:02.689023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f133b8c-169b-43e9-a9db-476eba134761 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:02.689274 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f133b8c-169b-43e9-a9db-476eba134761 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:02.689543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f133b8c-169b-43e9-a9db-476eba134761 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:02.700147 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f133b8c-169b-43e9-a9db-476eba134761 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:02.701816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f133b8c-169b-43e9-a9db-476eba134761 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:02.714580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1113/2229] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:21:05.743723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec596e8-c31c-4b16-aff9-0ee304642ab9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:05.744319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec596e8-c31c-4b16-aff9-0ee304642ab9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:05.744319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec596e8-c31c-4b16-aff9-0ee304642ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:05.769531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4ec596e8-c31c-4b16-aff9-0ee304642ab9 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:05.770911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4ec596e8-c31c-4b16-aff9-0ee304642ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:05.784487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1117/2230] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 19:21:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:05.804088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f133b8c-169b-43e9-a9db-476eba134761 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:05.818113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f133b8c-169b-43e9-a9db-476eba134761 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:05.837690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb156b1d-be20-4814-b9c7-281d9118f1c8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:05.838670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb156b1d-be20-4814-b9c7-281d9118f1c8 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:05.839173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb156b1d-be20-4814-b9c7-281d9118f1c8 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:05.839679 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb156b1d-be20-4814-b9c7-281d9118f1c8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:05.853356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb156b1d-be20-4814-b9c7-281d9118f1c8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:05.855954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb156b1d-be20-4814-b9c7-281d9118f1c8 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:05.871063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1114/2231] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:21:07.922760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b89ed-b9a4-43f6-8135-88e870dfa707 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:07.923502 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b89ed-b9a4-43f6-8135-88e870dfa707 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:07.923502 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33b89ed-b9a4-43f6-8135-88e870dfa707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:07.943986 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a33b89ed-b9a4-43f6-8135-88e870dfa707 None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:07.945189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a33b89ed-b9a4-43f6-8135-88e870dfa707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:08.015290 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1118/2232] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:21:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:08.040104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb156b1d-be20-4814-b9c7-281d9118f1c8 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:08.041708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-eb156b1d-be20-4814-b9c7-281d9118f1c8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:08.052503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:21:08.126242 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb156b1d-be20-4814-b9c7-281d9118f1c8 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:08.132333 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c4397-a264-4e77-9889-e50dfdd265af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:08.133249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4397-a264-4e77-9889-e50dfdd265af service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:08.133554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4397-a264-4e77-9889-e50dfdd265af service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:08.134034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c4397-a264-4e77-9889-e50dfdd265af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:08.145205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c4397-a264-4e77-9889-e50dfdd265af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:08.147769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c4397-a264-4e77-9889-e50dfdd265af service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:08.161029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1115/2233] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:21:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 19:21:18.004418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=62 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:21:18.153245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=29 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:21:24.267415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7967a0-b9cc-4de6-b86e-adb29ef2d37a None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:24.267931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7967a0-b9cc-4de6-b86e-adb29ef2d37a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:24.268138 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7967a0-b9cc-4de6-b86e-adb29ef2d37a None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:24.269729 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1119/2234] 10.222.0.25 () {54 vars in 961 bytes} [Thu Sep 15 19:21:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:21:24.275884 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312fd56-a795-40f5-b4e4-53dab13ff3d5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:24.276396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312fd56-a795-40f5-b4e4-53dab13ff3d5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:24.276396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312fd56-a795-40f5-b4e4-53dab13ff3d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:24.299281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c312fd56-a795-40f5-b4e4-53dab13ff3d5 None None] MFA Rules not processed for user `35d5f3ec00844cf28c01a14f8a071a69`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:24.300730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c312fd56-a795-40f5-b4e4-53dab13ff3d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:24.378138 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1116/2235] 10.222.0.25 () {58 vars in 1058 bytes} [Thu Sep 15 19:21:24 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:24.386779 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7967a0-b9cc-4de6-b86e-adb29ef2d37a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:24.401205 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7967a0-b9cc-4de6-b86e-adb29ef2d37a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:24.406612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9094d-11d0-4734-836f-9cc0b1037460 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d5f3ec00844cf28c01a14f8a071a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:24.407253 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9094d-11d0-4734-836f-9cc0b1037460 service placement] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:24.407537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9094d-11d0-4734-836f-9cc0b1037460 service placement] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:24.407860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f9094d-11d0-4734-836f-9cc0b1037460 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:24.409665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-94f9094d-11d0-4734-836f-9cc0b1037460 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:24.422301 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9094d-11d0-4734-836f-9cc0b1037460 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:24.423798 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f9094d-11d0-4734-836f-9cc0b1037460 service placement] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:24.435160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1120/2236] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:21:24 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:21:32.672599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a93c07-1d5a-408d-a794-c5f73b4431c2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:32.673072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a93c07-1d5a-408d-a794-c5f73b4431c2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:32.673160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a93c07-1d5a-408d-a794-c5f73b4431c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:32.693480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a0a93c07-1d5a-408d-a794-c5f73b4431c2 None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:32.694783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a0a93c07-1d5a-408d-a794-c5f73b4431c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:32.703718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1117/2237] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 15 19:21:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:32.716760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9094d-11d0-4734-836f-9cc0b1037460 service placement] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:32.728618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f9094d-11d0-4734-836f-9cc0b1037460 service placement] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:32.735409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f93946-659d-41c7-bc7c-08b9881170fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:32.736035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f93946-659d-41c7-bc7c-08b9881170fe service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:32.736316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f93946-659d-41c7-bc7c-08b9881170fe service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:32.736588 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f93946-659d-41c7-bc7c-08b9881170fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:32.745686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f93946-659d-41c7-bc7c-08b9881170fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:32.747326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f93946-659d-41c7-bc7c-08b9881170fe service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:32.755718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1121/2238] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:21:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 19:21:37.362912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e69d4-7fd3-46dc-9c28-f9b5d3e40af2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:37.363349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e69d4-7fd3-46dc-9c28-f9b5d3e40af2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:37.363818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04e69d4-7fd3-46dc-9c28-f9b5d3e40af2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:37.385393 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b04e69d4-7fd3-46dc-9c28-f9b5d3e40af2 None None] MFA Rules not processed for user `4abbd18f03d64e06b319b9773d0b6dce`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:37.386636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b04e69d4-7fd3-46dc-9c28-f9b5d3e40af2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:37.452282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1118/2239] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:21:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:42.752275 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=12 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:21:47.444927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=57 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:21:52.708696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a037-f2c4-4575-b9bd-3a7c77d8bbd9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:52.709314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a037-f2c4-4575-b9bd-3a7c77d8bbd9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:52.709314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5482a037-f2c4-4575-b9bd-3a7c77d8bbd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:52.731224 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5482a037-f2c4-4575-b9bd-3a7c77d8bbd9 None None] MFA Rules not processed for user `a5a8b4618308488dabdef27763f291e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:52.733067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5482a037-f2c4-4575-b9bd-3a7c77d8bbd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:52.783594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a1b1c-f235-4401-ac3a-2e7138306826 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:52.784192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a1b1c-f235-4401-ac3a-2e7138306826 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:52.784192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2a1b1c-f235-4401-ac3a-2e7138306826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:52.807038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5c2a1b1c-f235-4401-ac3a-2e7138306826 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:52.807854 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1122/2240] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:21:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:52.820864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5c2a1b1c-f235-4401-ac3a-2e7138306826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:52.836929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1119/2241] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 19:21:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:52.887153 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482a037-f2c4-4575-b9bd-3a7c77d8bbd9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:52.901594 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5482a037-f2c4-4575-b9bd-3a7c77d8bbd9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:52.909542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0da80-0981-4cb4-8f15-00d7e164d707 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:52.910364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0da80-0981-4cb4-8f15-00d7e164d707 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:52.910605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0da80-0981-4cb4-8f15-00d7e164d707 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:52.910963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0da80-0981-4cb4-8f15-00d7e164d707 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:52.921112 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0da80-0981-4cb4-8f15-00d7e164d707 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:52.922784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0da80-0981-4cb4-8f15-00d7e164d707 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:52.934103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1123/2242] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:21:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:21:56.077236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06890570-4673-4e75-b278-0505f1435878 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:56.077911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06890570-4673-4e75-b278-0505f1435878 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:56.077911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06890570-4673-4e75-b278-0505f1435878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:56.100628 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-06890570-4673-4e75-b278-0505f1435878 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:56.101994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-06890570-4673-4e75-b278-0505f1435878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:56.112088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1120/2243] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 19:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:56.128249 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0da80-0981-4cb4-8f15-00d7e164d707 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:56.129955 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cab0da80-0981-4cb4-8f15-00d7e164d707 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:56.146280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0da80-0981-4cb4-8f15-00d7e164d707 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:56.153345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce4754-3317-4a7f-a8f4-d6194111566a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:56.154016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce4754-3317-4a7f-a8f4-d6194111566a service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:56.154303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce4754-3317-4a7f-a8f4-d6194111566a service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:56.154575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ce4754-3317-4a7f-a8f4-d6194111566a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:56.164444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce4754-3317-4a7f-a8f4-d6194111566a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:56.166146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ce4754-3317-4a7f-a8f4-d6194111566a service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:56.177421 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1124/2244] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:21:59.185756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37141f84-21d2-429e-9894-62703130adf1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:59.186366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37141f84-21d2-429e-9894-62703130adf1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:59.186366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37141f84-21d2-429e-9894-62703130adf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:59.210382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-37141f84-21d2-429e-9894-62703130adf1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:21:59.211969 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-37141f84-21d2-429e-9894-62703130adf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:21:59.222489 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1121/2245] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 19:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:21:59.490543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce4754-3317-4a7f-a8f4-d6194111566a service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:21:59.502729 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ce4754-3317-4a7f-a8f4-d6194111566a service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:21:59.510151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9ce1b-7537-4436-9e63-967f83484e1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:21:59.510868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9ce1b-7537-4436-9e63-967f83484e1c service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:21:59.511033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9ce1b-7537-4436-9e63-967f83484e1c service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:21:59.511308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f9ce1b-7537-4436-9e63-967f83484e1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:21:59.520308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9ce1b-7537-4436-9e63-967f83484e1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:21:59.522022 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f9ce1b-7537-4436-9e63-967f83484e1c service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:21:59.533404 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1125/2246] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:22:03.389452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8d918-dbf9-4aee-a0dd-acecdfbd5fa5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:03.390016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8d918-dbf9-4aee-a0dd-acecdfbd5fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:03.390144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf8d918-dbf9-4aee-a0dd-acecdfbd5fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:03.410324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ddf8d918-dbf9-4aee-a0dd-acecdfbd5fa5 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:22:03.411700 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ddf8d918-dbf9-4aee-a0dd-acecdfbd5fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:03.424281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1122/2247] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 19:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:22:03.444005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9ce1b-7537-4436-9e63-967f83484e1c service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:03.455698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f9ce1b-7537-4436-9e63-967f83484e1c service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:03.462325 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546233c-efea-43cb-9505-5e2c7cffb505 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:03.462927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546233c-efea-43cb-9505-5e2c7cffb505 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:03.463202 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546233c-efea-43cb-9505-5e2c7cffb505 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:03.463470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0546233c-efea-43cb-9505-5e2c7cffb505 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:03.471964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546233c-efea-43cb-9505-5e2c7cffb505 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:03.473567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0546233c-efea-43cb-9505-5e2c7cffb505 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:03.483571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1126/2248] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:22:07.618945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14b8cb-f195-498b-a551-faa85c9602f3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:07.619578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14b8cb-f195-498b-a551-faa85c9602f3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:07.619578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a14b8cb-f195-498b-a551-faa85c9602f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:07.640917 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8a14b8cb-f195-498b-a551-faa85c9602f3 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:22:07.642312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8a14b8cb-f195-498b-a551-faa85c9602f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:07.651900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1123/2249] 10.222.0.16 () {58 vars in 1016 bytes} [Thu Sep 15 19:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:22:07.678307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546233c-efea-43cb-9505-5e2c7cffb505 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:07.690714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0546233c-efea-43cb-9505-5e2c7cffb505 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:07.697092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3236e2-4cc9-40a7-90f2-c4cabd569f9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:07.698180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3236e2-4cc9-40a7-90f2-c4cabd569f9f service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:07.699346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3236e2-4cc9-40a7-90f2-c4cabd569f9f service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:07.699787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3236e2-4cc9-40a7-90f2-c4cabd569f9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:07.717185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3236e2-4cc9-40a7-90f2-c4cabd569f9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:07.718855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3236e2-4cc9-40a7-90f2-c4cabd569f9f service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:07.741200 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1127/2250] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:22:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:22:11.574568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baec53f-399d-4b4c-b72d-b01c7d33acf1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:11.575172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baec53f-399d-4b4c-b72d-b01c7d33acf1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:11.575298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baec53f-399d-4b4c-b72d-b01c7d33acf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:11.604173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2baec53f-399d-4b4c-b72d-b01c7d33acf1 None None] MFA Rules not processed for user `6a7f1fb1137c4fa7aa572631db1b00ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:22:11.605406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2baec53f-399d-4b4c-b72d-b01c7d33acf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:11.668747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1124/2251] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:22:11 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:22:17.725729 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=55 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:22:21.661054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=40 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:22:26.864809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae0700-01c2-47a1-8677-aaf18e030d34 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:26.864809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae0700-01c2-47a1-8677-aaf18e030d34 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:26.865496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ae0700-01c2-47a1-8677-aaf18e030d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:26.887699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-82ae0700-01c2-47a1-8677-aaf18e030d34 None None] MFA Rules not processed for user `45156089d449401abc9a163bf1e15d32`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:22:26.888942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-82ae0700-01c2-47a1-8677-aaf18e030d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:26.962189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1128/2252] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:22:26 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:22:36.948948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=25 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:22:41.028519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081730dd-eaf8-4bb4-a4f2-2876cde133a3 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:41.029092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081730dd-eaf8-4bb4-a4f2-2876cde133a3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:41.029092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081730dd-eaf8-4bb4-a4f2-2876cde133a3 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:41.030546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1125/2253] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:22:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:22:41.040383 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0817d-03e3-4f48-864d-ba31811c03ff None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:41.041190 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0817d-03e3-4f48-864d-ba31811c03ff None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:41.041480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb0817d-03e3-4f48-864d-ba31811c03ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:41.063212 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4fb0817d-03e3-4f48-864d-ba31811c03ff None None] MFA Rules not processed for user `35d5f3ec00844cf28c01a14f8a071a69`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:22:41.064428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4fb0817d-03e3-4f48-864d-ba31811c03ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:41.073802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1129/2254] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:22:41 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:22:41.091650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081730dd-eaf8-4bb4-a4f2-2876cde133a3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:41.110059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081730dd-eaf8-4bb4-a4f2-2876cde133a3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:41.111314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0817d-03e3-4f48-864d-ba31811c03ff None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:41.113152 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4fb0817d-03e3-4f48-864d-ba31811c03ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:41.113640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f752d3-b99f-44df-95ff-21da3d09f608 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d5f3ec00844cf28c01a14f8a071a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:41.114293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f752d3-b99f-44df-95ff-21da3d09f608 service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:41.114758 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f752d3-b99f-44df-95ff-21da3d09f608 service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:41.115029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f752d3-b99f-44df-95ff-21da3d09f608 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:41.126053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f752d3-b99f-44df-95ff-21da3d09f608 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:41.127744 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f752d3-b99f-44df-95ff-21da3d09f608 service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:41.128095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb0817d-03e3-4f48-864d-ba31811c03ff None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:41.135292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f649a808-6c43-43ed-b7bb-86634a172e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:41.136133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649a808-6c43-43ed-b7bb-86634a172e2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:41.136454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649a808-6c43-43ed-b7bb-86634a172e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:41.136818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f649a808-6c43-43ed-b7bb-86634a172e2d admin admin] PATH_INFO: `/v3/users/4abbd18f03d64e06b319b9773d0b6dce` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:41.138102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649a808-6c43-43ed-b7bb-86634a172e2d admin admin] RBAC: Authorizing `identity:delete_user(user_id=4abbd18f03d64e06b319b9773d0b6dce)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:41.140094 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f649a808-6c43-43ed-b7bb-86634a172e2d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:41.140699 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1126/2255] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:22:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:22:41.191418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f649a808-6c43-43ed-b7bb-86634a172e2d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4abbd18f03d64e06b319b9773d0b6dce'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:22:41.200755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f649a808-6c43-43ed-b7bb-86634a172e2d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4abbd18f03d64e06b319b9773d0b6dce'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:22:41.201431 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f649a808-6c43-43ed-b7bb-86634a172e2d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4abbd18f03d64e06b319b9773d0b6dce'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:22:41.202159 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f649a808-6c43-43ed-b7bb-86634a172e2d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4abbd18f03d64e06b319b9773d0b6dce'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:22:41.210059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f649a808-6c43-43ed-b7bb-86634a172e2d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4abbd18f03d64e06b319b9773d0b6dce'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:22:41.227226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1130/2256] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:22:41 2022] DELETE /identity/v3/users/4abbd18f03d64e06b319b9773d0b6dce => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:22:41.405364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f752d3-b99f-44df-95ff-21da3d09f608 service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:41.426072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f752d3-b99f-44df-95ff-21da3d09f608 service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:41.487259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6955866-2dd8-4c46-9a71-e903f3132911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:41.487899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6955866-2dd8-4c46-9a71-e903f3132911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:41.488181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6955866-2dd8-4c46-9a71-e903f3132911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:41.488457 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6955866-2dd8-4c46-9a71-e903f3132911 admin admin] PATH_INFO: `/v3/projects/bece4709db5e4c8fa74b9dac13499ea4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:41.489748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6955866-2dd8-4c46-9a71-e903f3132911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bece4709db5e4c8fa74b9dac13499ea4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:41.491739 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6955866-2dd8-4c46-9a71-e903f3132911 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:41.545991 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6955866-2dd8-4c46-9a71-e903f3132911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bece4709db5e4c8fa74b9dac13499ea4', 'request_id': 'req-d6955866-2dd8-4c46-9a71-e903f3132911'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:22:41.552501 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6955866-2dd8-4c46-9a71-e903f3132911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bece4709db5e4c8fa74b9dac13499ea4', 'request_id': 'req-d6955866-2dd8-4c46-9a71-e903f3132911'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:22:41.563742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6955866-2dd8-4c46-9a71-e903f3132911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bece4709db5e4c8fa74b9dac13499ea4', 'request_id': 'req-d6955866-2dd8-4c46-9a71-e903f3132911'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:22:41.580321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6955866-2dd8-4c46-9a71-e903f3132911 admin admin] The token cache is being invalidate because project bece4709db5e4c8fa74b9dac13499ea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:22:41.580725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6955866-2dd8-4c46-9a71-e903f3132911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:22:41.581852 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d6955866-2dd8-4c46-9a71-e903f3132911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:22:41.583746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1127/2257] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:22:41 2022] DELETE /identity/v3/projects/bece4709db5e4c8fa74b9dac13499ea4 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:22:41.589436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f587f-5a4b-47b3-b16f-9d72aa61fc1a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:41.589735 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f587f-5a4b-47b3-b16f-9d72aa61fc1a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:41.590119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3f587f-5a4b-47b3-b16f-9d72aa61fc1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:41.612310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-bf3f587f-5a4b-47b3-b16f-9d72aa61fc1a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:22:41.613756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bf3f587f-5a4b-47b3-b16f-9d72aa61fc1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:41.679910 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1131/2258] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:22:41.749309 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb8d87-c320-48cc-89f3-b46a94bcb2db None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:41.749607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb8d87-c320-48cc-89f3-b46a94bcb2db None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:41.749968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdb8d87-c320-48cc-89f3-b46a94bcb2db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:41.778444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5cdb8d87-c320-48cc-89f3-b46a94bcb2db None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:22:41.779648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5cdb8d87-c320-48cc-89f3-b46a94bcb2db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:41.788984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1128/2259] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:22:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:22:41.795213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f587f-5a4b-47b3-b16f-9d72aa61fc1a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:41.810116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3f587f-5a4b-47b3-b16f-9d72aa61fc1a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:41.817188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75189d80-5912-4ffe-861f-7b34d9da42fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:41.817821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75189d80-5912-4ffe-861f-7b34d9da42fd admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:41.818096 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75189d80-5912-4ffe-861f-7b34d9da42fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:41.818363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75189d80-5912-4ffe-861f-7b34d9da42fd admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:41.819016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75189d80-5912-4ffe-861f-7b34d9da42fd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:22:41.819342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75189d80-5912-4ffe-861f-7b34d9da42fd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:41.821075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75189d80-5912-4ffe-861f-7b34d9da42fd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:41.834087 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1132/2260] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:22:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:22:41.839300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb8d87-c320-48cc-89f3-b46a94bcb2db None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:41.849151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdb8d87-c320-48cc-89f3-b46a94bcb2db None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:41.854612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bfca7-8532-4d07-8413-71a0d47ba9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:41.855242 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bfca7-8532-4d07-8413-71a0d47ba9ce admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:41.855510 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bfca7-8532-4d07-8413-71a0d47ba9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:41.855766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bfca7-8532-4d07-8413-71a0d47ba9ce admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:41.856428 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bfca7-8532-4d07-8413-71a0d47ba9ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:41.858371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34bfca7-8532-4d07-8413-71a0d47ba9ce admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:41.899355 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1129/2261] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:22:41 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:22:41.903824 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75189d80-5912-4ffe-861f-7b34d9da42fd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:41.918104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75189d80-5912-4ffe-861f-7b34d9da42fd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:41.983843 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:22:41.994742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd457b-e5f6-4403-8b62-6b9ac36a9f2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:41.995362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd457b-e5f6-4403-8b62-6b9ac36a9f2a admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:41.995806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd457b-e5f6-4403-8b62-6b9ac36a9f2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:41.996302 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cd457b-e5f6-4403-8b62-6b9ac36a9f2a admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:41.997005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd457b-e5f6-4403-8b62-6b9ac36a9f2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:41.999257 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cd457b-e5f6-4403-8b62-6b9ac36a9f2a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:42.025610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1133/2262] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:22:41 2022] POST /identity/v3/users => generated 293 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:22:42.030301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bfca7-8532-4d07-8413-71a0d47ba9ce admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:42.041982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34bfca7-8532-4d07-8413-71a0d47ba9ce admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:42.046833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ff99c-3fe0-415c-bc9d-ffb21d14586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:42.047482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ff99c-3fe0-415c-bc9d-ffb21d14586b admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:42.047757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ff99c-3fe0-415c-bc9d-ffb21d14586b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:42.048023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921ff99c-3fe0-415c-bc9d-ffb21d14586b admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:42.048677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ff99c-3fe0-415c-bc9d-ffb21d14586b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:42.050327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921ff99c-3fe0-415c-bc9d-ffb21d14586b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:42.061870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1130/2263] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:22:42.066187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd457b-e5f6-4403-8b62-6b9ac36a9f2a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:42.076574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cd457b-e5f6-4403-8b62-6b9ac36a9f2a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:42.081428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cccbff3-353a-438a-8e06-f121f3dead80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:42.082070 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccbff3-353a-438a-8e06-f121f3dead80 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:42.082352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccbff3-353a-438a-8e06-f121f3dead80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:42.082623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cccbff3-353a-438a-8e06-f121f3dead80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:42.083269 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccbff3-353a-438a-8e06-f121f3dead80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:42.085220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cccbff3-353a-438a-8e06-f121f3dead80 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:42.098536 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1134/2264] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:22:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:22:42.100723 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ff99c-3fe0-415c-bc9d-ffb21d14586b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:42.111217 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921ff99c-3fe0-415c-bc9d-ffb21d14586b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:42.116264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cdc34-2ebd-4188-80d0-8d35f11f91e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:42.116914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cdc34-2ebd-4188-80d0-8d35f11f91e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:42.117464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cdc34-2ebd-4188-80d0-8d35f11f91e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:42.117464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1cdc34-2ebd-4188-80d0-8d35f11f91e9 admin admin] PATH_INFO: `/v3/projects/e7aba0d1093340eea44243dc385cc55b/users/c411936d2ad447f1a58ecfd3d068607e/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:42.132404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cdc34-2ebd-4188-80d0-8d35f11f91e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7aba0d1093340eea44243dc385cc55b, user_id=c411936d2ad447f1a58ecfd3d068607e, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:42.135279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1cdc34-2ebd-4188-80d0-8d35f11f91e9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:42.151725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1131/2265] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:22:42 2022] PUT /identity/v3/projects/e7aba0d1093340eea44243dc385cc55b/users/c411936d2ad447f1a58ecfd3d068607e/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:22:42.157029 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07c235-9903-4c0c-b3bb-405840f1561b None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:42.157313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07c235-9903-4c0c-b3bb-405840f1561b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:42.157607 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe07c235-9903-4c0c-b3bb-405840f1561b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:42.177988 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fe07c235-9903-4c0c-b3bb-405840f1561b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:22:42.179193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fe07c235-9903-4c0c-b3bb-405840f1561b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:42.257849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1135/2266] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:22:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:22:42.271035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cdc34-2ebd-4188-80d0-8d35f11f91e9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:42.273184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cf1cdc34-2ebd-4188-80d0-8d35f11f91e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:42.295970 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:22:42.344121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1cdc34-2ebd-4188-80d0-8d35f11f91e9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:42.348186 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c92e96-a181-4159-83b1-e043fec582c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:42.348806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c92e96-a181-4159-83b1-e043fec582c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:42.349083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c92e96-a181-4159-83b1-e043fec582c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:42.349352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c92e96-a181-4159-83b1-e043fec582c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:42.360263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c92e96-a181-4159-83b1-e043fec582c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:42.361693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c92e96-a181-4159-83b1-e043fec582c7 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:42.372095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1132/2267] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:22:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:22:46.776369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52019cee-f172-4853-942a-3e2181f07b15 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:46.776887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52019cee-f172-4853-942a-3e2181f07b15 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:46.777041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52019cee-f172-4853-942a-3e2181f07b15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:46.813454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-52019cee-f172-4853-942a-3e2181f07b15 None None] MFA Rules not processed for user `c411936d2ad447f1a58ecfd3d068607e`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:22:46.815265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-52019cee-f172-4853-942a-3e2181f07b15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:46.910327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1136/2268] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:22:46 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:22:46.915430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c92e96-a181-4159-83b1-e043fec582c7 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:46.927268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c92e96-a181-4159-83b1-e043fec582c7 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:46.934579 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370d809-17b6-4312-a887-2bc90efc79d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:46.935506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370d809-17b6-4312-a887-2bc90efc79d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:46.936003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370d809-17b6-4312-a887-2bc90efc79d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:46.936520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d370d809-17b6-4312-a887-2bc90efc79d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:46.937377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370d809-17b6-4312-a887-2bc90efc79d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:46.939554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d370d809-17b6-4312-a887-2bc90efc79d1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:46.981001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1133/2269] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:22:46 2022] POST /identity/v3/projects => generated 383 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:22:46.984452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52019cee-f172-4853-942a-3e2181f07b15 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:47.000706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52019cee-f172-4853-942a-3e2181f07b15 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:47.083041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b87efa-fd54-43e0-bb3c-c5497d99dee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:47.083692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b87efa-fd54-43e0-bb3c-c5497d99dee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:47.083958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b87efa-fd54-43e0-bb3c-c5497d99dee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:47.084225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b87efa-fd54-43e0-bb3c-c5497d99dee7 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:47.088878 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b87efa-fd54-43e0-bb3c-c5497d99dee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:47.088878 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b87efa-fd54-43e0-bb3c-c5497d99dee7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:47.097662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:22:47.114963 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1137/2270] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:22:46 2022] POST /identity/v3/users => generated 298 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:22:47.119023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370d809-17b6-4312-a887-2bc90efc79d1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:47.129514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d370d809-17b6-4312-a887-2bc90efc79d1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:47.134564 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea3cb3-1728-48a1-9a86-9677717c86f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:47.135184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea3cb3-1728-48a1-9a86-9677717c86f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:47.135460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea3cb3-1728-48a1-9a86-9677717c86f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:47.135732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dea3cb3-1728-48a1-9a86-9677717c86f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:47.136384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea3cb3-1728-48a1-9a86-9677717c86f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:47.138045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dea3cb3-1728-48a1-9a86-9677717c86f0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:47.151074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1134/2271] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:22:47.155722 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b87efa-fd54-43e0-bb3c-c5497d99dee7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:47.168111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b87efa-fd54-43e0-bb3c-c5497d99dee7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:47.173109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc3698-3b73-4df6-a2b8-88bdd91cf25b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:47.173812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc3698-3b73-4df6-a2b8-88bdd91cf25b admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:47.174095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc3698-3b73-4df6-a2b8-88bdd91cf25b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:47.174370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8afc3698-3b73-4df6-a2b8-88bdd91cf25b admin admin] PATH_INFO: `/v3/projects/415eeb500b004e538624ce3dff7e3509/users/c63ad0527ddb446b97ecda738980cdeb/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:47.197137 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc3698-3b73-4df6-a2b8-88bdd91cf25b admin admin] RBAC: Authorizing `identity:create_grant(project_id=415eeb500b004e538624ce3dff7e3509, user_id=c63ad0527ddb446b97ecda738980cdeb, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:47.199876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8afc3698-3b73-4df6-a2b8-88bdd91cf25b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:47.215033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1138/2272] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:22:47 2022] PUT /identity/v3/projects/415eeb500b004e538624ce3dff7e3509/users/c63ad0527ddb446b97ecda738980cdeb/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:22:47.219189 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea3cb3-1728-48a1-9a86-9677717c86f0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:47.230114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dea3cb3-1728-48a1-9a86-9677717c86f0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:47.295811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc23aef-0309-40af-81c4-e5a6538a85f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:47.296442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc23aef-0309-40af-81c4-e5a6538a85f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:47.296718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc23aef-0309-40af-81c4-e5a6538a85f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:47.297049 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc23aef-0309-40af-81c4-e5a6538a85f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:47.297729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc23aef-0309-40af-81c4-e5a6538a85f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:47.299445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc23aef-0309-40af-81c4-e5a6538a85f9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:47.311943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1135/2273] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:22:47.316321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc3698-3b73-4df6-a2b8-88bdd91cf25b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:47.327207 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8afc3698-3b73-4df6-a2b8-88bdd91cf25b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:47.332139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd230b1e-4371-4889-802f-6618afd6c5bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:47.332816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd230b1e-4371-4889-802f-6618afd6c5bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:47.333094 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd230b1e-4371-4889-802f-6618afd6c5bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:47.333372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd230b1e-4371-4889-802f-6618afd6c5bb admin admin] PATH_INFO: `/v3/projects/415eeb500b004e538624ce3dff7e3509/users/c63ad0527ddb446b97ecda738980cdeb/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:47.335666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd230b1e-4371-4889-802f-6618afd6c5bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=415eeb500b004e538624ce3dff7e3509, user_id=c63ad0527ddb446b97ecda738980cdeb, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:47.338431 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd230b1e-4371-4889-802f-6618afd6c5bb admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:47.350086 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1139/2274] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:22:47 2022] PUT /identity/v3/projects/415eeb500b004e538624ce3dff7e3509/users/c63ad0527ddb446b97ecda738980cdeb/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:22:52.668709 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269886b3-2337-48c8-b1fa-1e5351102b9b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:52.669875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269886b3-2337-48c8-b1fa-1e5351102b9b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:52.669875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269886b3-2337-48c8-b1fa-1e5351102b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:52.704330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-269886b3-2337-48c8-b1fa-1e5351102b9b None None] MFA Rules not processed for user `4e5cb514da72438ab36c05399083f109`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:22:52.705899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-269886b3-2337-48c8-b1fa-1e5351102b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:52.802110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1136/2275] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:22:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:22:53.776125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad3ebb-6c66-47f8-8219-0d8b0aaf6691 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:53.776666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad3ebb-6c66-47f8-8219-0d8b0aaf6691 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:53.776666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fad3ebb-6c66-47f8-8219-0d8b0aaf6691 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:53.808693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-3fad3ebb-6c66-47f8-8219-0d8b0aaf6691 None None] MFA Rules not processed for user `c63ad0527ddb446b97ecda738980cdeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:22:53.809945 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3fad3ebb-6c66-47f8-8219-0d8b0aaf6691 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:53.894937 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1140/2276] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:22:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:22:53.907042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269886b3-2337-48c8-b1fa-1e5351102b9b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:53.908466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-269886b3-2337-48c8-b1fa-1e5351102b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:53.944730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:22:53.997579 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269886b3-2337-48c8-b1fa-1e5351102b9b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:54.001334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710afb2-4089-40c9-91e9-9589f086da1c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06d8a144ecf43fc8de82346758b6065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:54.002189 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710afb2-4089-40c9-91e9-9589f086da1c service glance] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:54.002724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710afb2-4089-40c9-91e9-9589f086da1c service glance] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:54.003058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7710afb2-4089-40c9-91e9-9589f086da1c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:54.078033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710afb2-4089-40c9-91e9-9589f086da1c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:54.084965 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7710afb2-4089-40c9-91e9-9589f086da1c service glance] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:54.094104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1137/2277] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:22:53 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:22:54.271222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c284fa-25a1-4be0-998d-ea7ba278ed52 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:54.271505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c284fa-25a1-4be0-998d-ea7ba278ed52 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:54.271828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c284fa-25a1-4be0-998d-ea7ba278ed52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:54.302396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-78c284fa-25a1-4be0-998d-ea7ba278ed52 None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:22:54.304121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-78c284fa-25a1-4be0-998d-ea7ba278ed52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:54.389405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1141/2278] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:22:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:22:54.440731 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710afb2-4089-40c9-91e9-9589f086da1c service glance] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:22:54.442190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7710afb2-4089-40c9-91e9-9589f086da1c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:22:54.551538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7710afb2-4089-40c9-91e9-9589f086da1c service glance] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:22:54.560974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb378278-79dc-41b7-954b-9d15637edebf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:22:54.562012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb378278-79dc-41b7-954b-9d15637edebf service swift] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:22:54.562513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb378278-79dc-41b7-954b-9d15637edebf service swift] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:22:54.562870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb378278-79dc-41b7-954b-9d15637edebf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:22:54.574036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb378278-79dc-41b7-954b-9d15637edebf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:22:54.576241 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb378278-79dc-41b7-954b-9d15637edebf service swift] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:22:54.585971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1138/2279] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:22:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 19:23:03.561156 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a61af-1417-43b7-b440-a24a99f36f7d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:03.561687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a61af-1417-43b7-b440-a24a99f36f7d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:03.561687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2a61af-1417-43b7-b440-a24a99f36f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:03.592795 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fa2a61af-1417-43b7-b440-a24a99f36f7d None None] MFA Rules not processed for user `a5a8b4618308488dabdef27763f291e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:03.594849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fa2a61af-1417-43b7-b440-a24a99f36f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:03.659416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:03.689557 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1142/2280] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:03 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:04.582278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=69 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:06.106547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335428c4-3071-40f1-9e27-50d3244fa360 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:06.107195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335428c4-3071-40f1-9e27-50d3244fa360 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:06.107195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335428c4-3071-40f1-9e27-50d3244fa360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:06.131421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-335428c4-3071-40f1-9e27-50d3244fa360 None None] MFA Rules not processed for user `c411936d2ad447f1a58ecfd3d068607e`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:06.133261 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-335428c4-3071-40f1-9e27-50d3244fa360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:06.143935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1139/2281] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:09.234122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a61af-1417-43b7-b440-a24a99f36f7d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:09.334034 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2a61af-1417-43b7-b440-a24a99f36f7d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:09.340139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f54c19-a20f-42d9-b664-03cb60b46184 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:09.341009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f54c19-a20f-42d9-b664-03cb60b46184 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:09.341359 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f54c19-a20f-42d9-b664-03cb60b46184 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:09.341655 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f54c19-a20f-42d9-b664-03cb60b46184 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:09.343926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f6f54c19-a20f-42d9-b664-03cb60b46184 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:09.458356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f54c19-a20f-42d9-b664-03cb60b46184 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:09.461262 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f54c19-a20f-42d9-b664-03cb60b46184 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:09.475184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1143/2282] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:10.258046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f709ff-592e-4c62-a9e8-ed55c5a7a5f2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:10.258046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f709ff-592e-4c62-a9e8-ed55c5a7a5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:10.258927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f709ff-592e-4c62-a9e8-ed55c5a7a5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:10.287754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c6f709ff-592e-4c62-a9e8-ed55c5a7a5f2 None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:10.289554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c6f709ff-592e-4c62-a9e8-ed55c5a7a5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:10.300524 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1140/2283] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:23:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:10.331347 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f54c19-a20f-42d9-b664-03cb60b46184 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:10.356103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f54c19-a20f-42d9-b664-03cb60b46184 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:10.365754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc89a37-9d38-4e48-8e51-968772427921 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:10.367400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc89a37-9d38-4e48-8e51-968772427921 service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:10.368976 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc89a37-9d38-4e48-8e51-968772427921 service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:10.370953 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc89a37-9d38-4e48-8e51-968772427921 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:10.391014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc89a37-9d38-4e48-8e51-968772427921 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:10.393605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc89a37-9d38-4e48-8e51-968772427921 service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:10.408031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1144/2284] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:23:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 19:23:13.244994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f709ff-592e-4c62-a9e8-ed55c5a7a5f2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:13.266133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f709ff-592e-4c62-a9e8-ed55c5a7a5f2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:13.300544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcd0b2-1344-49bf-b3c5-a85ba5b13d4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:13.301200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd0b2-1344-49bf-b3c5-a85ba5b13d4a service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:13.301476 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd0b2-1344-49bf-b3c5-a85ba5b13d4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:13.301744 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16dcd0b2-1344-49bf-b3c5-a85ba5b13d4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:13.322205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-16dcd0b2-1344-49bf-b3c5-a85ba5b13d4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:13.393025 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcd0b2-1344-49bf-b3c5-a85ba5b13d4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:13.395458 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16dcd0b2-1344-49bf-b3c5-a85ba5b13d4a service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:13.461075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1141/2285] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:20.403686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=65 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:23.427617 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=12 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:25.814115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc89a37-9d38-4e48-8e51-968772427921 service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:25.815565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0bc89a37-9d38-4e48-8e51-968772427921 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:25.832903 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc89a37-9d38-4e48-8e51-968772427921 service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:25.839997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c854a-57a8-490c-a60c-cf93288f5c5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:25.840611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c854a-57a8-490c-a60c-cf93288f5c5a service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:25.840891 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c854a-57a8-490c-a60c-cf93288f5c5a service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:25.841165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5c854a-57a8-490c-a60c-cf93288f5c5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:25.843130 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2a5c854a-57a8-490c-a60c-cf93288f5c5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:25.854979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c854a-57a8-490c-a60c-cf93288f5c5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:25.856635 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5c854a-57a8-490c-a60c-cf93288f5c5a service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:25.867349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1145/2286] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:33.247495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcd0b2-1344-49bf-b3c5-a85ba5b13d4a service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:33.259069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16dcd0b2-1344-49bf-b3c5-a85ba5b13d4a service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:33.264333 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c944a5-af66-4f51-9f4c-35bd968da193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:33.265144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c944a5-af66-4f51-9f4c-35bd968da193 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:33.265509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c944a5-af66-4f51-9f4c-35bd968da193 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:33.266352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c944a5-af66-4f51-9f4c-35bd968da193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:33.269265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c0c944a5-af66-4f51-9f4c-35bd968da193 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:33.337855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c854a-57a8-490c-a60c-cf93288f5c5a service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:33.350171 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5c854a-57a8-490c-a60c-cf93288f5c5a service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:33.357161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45058a6-b9d7-4eea-8bf8-c60ee89b1565 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:33.357464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c944a5-af66-4f51-9f4c-35bd968da193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:33.357904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45058a6-b9d7-4eea-8bf8-c60ee89b1565 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:33.358382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45058a6-b9d7-4eea-8bf8-c60ee89b1565 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:33.358801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45058a6-b9d7-4eea-8bf8-c60ee89b1565 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:33.359001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c944a5-af66-4f51-9f4c-35bd968da193 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:33.361016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a45058a6-b9d7-4eea-8bf8-c60ee89b1565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:33.375472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1142/2287] 10.222.0.25 () {60 vars in 1396 bytes} [Thu Sep 15 19:23:33 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:33.431607 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45058a6-b9d7-4eea-8bf8-c60ee89b1565 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:33.433180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45058a6-b9d7-4eea-8bf8-c60ee89b1565 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:33.443497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1146/2288] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:33 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:33.492528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c944a5-af66-4f51-9f4c-35bd968da193 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:33.502439 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c944a5-af66-4f51-9f4c-35bd968da193 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:33.506653 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ccdd8-2bf0-465e-af85-eb8ca1118a04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:33.507458 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ccdd8-2bf0-465e-af85-eb8ca1118a04 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:33.507815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ccdd8-2bf0-465e-af85-eb8ca1118a04 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:33.508091 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36ccdd8-2bf0-465e-af85-eb8ca1118a04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:33.510250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d36ccdd8-2bf0-465e-af85-eb8ca1118a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:33.585748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ccdd8-2bf0-465e-af85-eb8ca1118a04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:33.587730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d36ccdd8-2bf0-465e-af85-eb8ca1118a04 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:33.598276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1143/2289] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:37.505984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45058a6-b9d7-4eea-8bf8-c60ee89b1565 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:37.508613 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a45058a6-b9d7-4eea-8bf8-c60ee89b1565 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:37.528870 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45058a6-b9d7-4eea-8bf8-c60ee89b1565 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:37.533423 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea993b9e-21a8-44c1-87bb-aa86ff8ed043 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:37.534285 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea993b9e-21a8-44c1-87bb-aa86ff8ed043 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:37.534746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea993b9e-21a8-44c1-87bb-aa86ff8ed043 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:37.535085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea993b9e-21a8-44c1-87bb-aa86ff8ed043 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:37.546625 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea993b9e-21a8-44c1-87bb-aa86ff8ed043 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:37.548638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea993b9e-21a8-44c1-87bb-aa86ff8ed043 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:37.563783 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1147/2290] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:37 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:37.836795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ccdd8-2bf0-465e-af85-eb8ca1118a04 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:37.838508 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d36ccdd8-2bf0-465e-af85-eb8ca1118a04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:37.857545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36ccdd8-2bf0-465e-af85-eb8ca1118a04 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:37.862702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012341e4-16a0-4c90-848a-c393b1a868d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:37.863354 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012341e4-16a0-4c90-848a-c393b1a868d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:37.863636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012341e4-16a0-4c90-848a-c393b1a868d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:37.864050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012341e4-16a0-4c90-848a-c393b1a868d2 admin admin] PATH_INFO: `/v3/users/6a7f1fb1137c4fa7aa572631db1b00ac` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:37.865315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012341e4-16a0-4c90-848a-c393b1a868d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6a7f1fb1137c4fa7aa572631db1b00ac)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:37.867583 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012341e4-16a0-4c90-848a-c393b1a868d2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:37.924508 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-012341e4-16a0-4c90-848a-c393b1a868d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6a7f1fb1137c4fa7aa572631db1b00ac'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:37.933018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-012341e4-16a0-4c90-848a-c393b1a868d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6a7f1fb1137c4fa7aa572631db1b00ac'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:37.933636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-012341e4-16a0-4c90-848a-c393b1a868d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6a7f1fb1137c4fa7aa572631db1b00ac'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:37.934376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-012341e4-16a0-4c90-848a-c393b1a868d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6a7f1fb1137c4fa7aa572631db1b00ac'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:37.942748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-012341e4-16a0-4c90-848a-c393b1a868d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6a7f1fb1137c4fa7aa572631db1b00ac'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:37.961916 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1144/2291] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:23:37 2022] DELETE /identity/v3/users/6a7f1fb1137c4fa7aa572631db1b00ac => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:38.143994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea993b9e-21a8-44c1-87bb-aa86ff8ed043 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:38.156280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea993b9e-21a8-44c1-87bb-aa86ff8ed043 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:38.216105 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:38.216714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:38.216992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:38.217265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f admin admin] PATH_INFO: `/v3/projects/7c59cc347b2a427f8eda457aba90cdf5` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:38.218429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c59cc347b2a427f8eda457aba90cdf5)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:38.220390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:38.274358 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c59cc347b2a427f8eda457aba90cdf5', 'request_id': 'req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:38.280320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c59cc347b2a427f8eda457aba90cdf5', 'request_id': 'req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:38.289724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c59cc347b2a427f8eda457aba90cdf5', 'request_id': 'req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:38.303285 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f admin admin] The token cache is being invalidate because project 7c59cc347b2a427f8eda457aba90cdf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:23:38.303707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:38.304447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1d00ff45-a5fa-4bf6-9ff9-e941f05bb61f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:38.306322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1148/2292] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:23:38 2022] DELETE /identity/v3/projects/7c59cc347b2a427f8eda457aba90cdf5 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:38.311352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b6a1a-ced2-41df-8ea8-5f35bf3e5d82 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:38.311639 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b6a1a-ced2-41df-8ea8-5f35bf3e5d82 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:38.311915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304b6a1a-ced2-41df-8ea8-5f35bf3e5d82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:38.321121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:38.334456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-304b6a1a-ced2-41df-8ea8-5f35bf3e5d82 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:38.336196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-304b6a1a-ced2-41df-8ea8-5f35bf3e5d82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:38.406132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1145/2293] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:38.414318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeb9b3-ccbb-418f-844f-0b5737105af3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:38.414735 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeb9b3-ccbb-418f-844f-0b5737105af3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:38.415217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedeb9b3-ccbb-418f-844f-0b5737105af3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:38.422976 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:38.436450 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-bedeb9b3-ccbb-418f-844f-0b5737105af3 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:38.439493 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bedeb9b3-ccbb-418f-844f-0b5737105af3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:38.447709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1149/2294] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:38.452197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b6a1a-ced2-41df-8ea8-5f35bf3e5d82 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:38.463028 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304b6a1a-ced2-41df-8ea8-5f35bf3e5d82 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:38.468652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc87888-eeda-48b9-ba4c-ec054b097bcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:38.469254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc87888-eeda-48b9-ba4c-ec054b097bcf admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:38.469501 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc87888-eeda-48b9-ba4c-ec054b097bcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:38.469751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc87888-eeda-48b9-ba4c-ec054b097bcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:38.470448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc87888-eeda-48b9-ba4c-ec054b097bcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:23:38.470769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc87888-eeda-48b9-ba4c-ec054b097bcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:38.472819 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc87888-eeda-48b9-ba4c-ec054b097bcf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:38.485014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1146/2295] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:23:38.490064 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeb9b3-ccbb-418f-844f-0b5737105af3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:38.500982 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedeb9b3-ccbb-418f-844f-0b5737105af3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:38.508270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22817f-a913-443a-a66a-334edbe5d071 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:38.510197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22817f-a913-443a-a66a-334edbe5d071 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:38.510719 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22817f-a913-443a-a66a-334edbe5d071 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:38.511077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a22817f-a913-443a-a66a-334edbe5d071 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:38.511934 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22817f-a913-443a-a66a-334edbe5d071 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:38.513951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a22817f-a913-443a-a66a-334edbe5d071 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:38.549225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1150/2296] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:23:38 2022] POST /identity/v3/projects => generated 363 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:38.554690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc87888-eeda-48b9-ba4c-ec054b097bcf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:38.567941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc87888-eeda-48b9-ba4c-ec054b097bcf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:38.641215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3eeb6-6079-4df7-a984-4ac3dd74b1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:38.643089 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3eeb6-6079-4df7-a984-4ac3dd74b1f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:38.643372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3eeb6-6079-4df7-a984-4ac3dd74b1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:38.643642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a3eeb6-6079-4df7-a984-4ac3dd74b1f6 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:38.644298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3eeb6-6079-4df7-a984-4ac3dd74b1f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:38.646271 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a3eeb6-6079-4df7-a984-4ac3dd74b1f6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:38.674101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1147/2297] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:23:38 2022] POST /identity/v3/users => generated 282 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:23:38.678325 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22817f-a913-443a-a66a-334edbe5d071 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:38.690949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a22817f-a913-443a-a66a-334edbe5d071 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:38.697175 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb274b-37c1-4b88-9ce9-295792b2f5fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:38.698037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb274b-37c1-4b88-9ce9-295792b2f5fa admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:38.698541 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb274b-37c1-4b88-9ce9-295792b2f5fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:38.699489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bb274b-37c1-4b88-9ce9-295792b2f5fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:38.700528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb274b-37c1-4b88-9ce9-295792b2f5fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:38.703348 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bb274b-37c1-4b88-9ce9-295792b2f5fa admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:38.715888 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1151/2298] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:38.720237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3eeb6-6079-4df7-a984-4ac3dd74b1f6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:38.730765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a3eeb6-6079-4df7-a984-4ac3dd74b1f6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:38.735837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fef9fa5-c1b6-43ec-962f-81fbd1a0ef82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:38.736463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9fa5-c1b6-43ec-962f-81fbd1a0ef82 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:38.736743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9fa5-c1b6-43ec-962f-81fbd1a0ef82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:38.737491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fef9fa5-c1b6-43ec-962f-81fbd1a0ef82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:38.737669 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef9fa5-c1b6-43ec-962f-81fbd1a0ef82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:38.739519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fef9fa5-c1b6-43ec-962f-81fbd1a0ef82 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:38.755114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1148/2299] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:23:38.756294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb274b-37c1-4b88-9ce9-295792b2f5fa admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:38.767395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bb274b-37c1-4b88-9ce9-295792b2f5fa admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:38.772158 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfad5f-0085-40b4-bbf3-d134739f5732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:38.773504 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfad5f-0085-40b4-bbf3-d134739f5732 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:38.773808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfad5f-0085-40b4-bbf3-d134739f5732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:38.774251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbfad5f-0085-40b4-bbf3-d134739f5732 admin admin] PATH_INFO: `/v3/projects/6688730734374be4857ad32670816a55/users/9659dd6de3aa4c1c87bb28c04d0d91b3/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:38.790120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfad5f-0085-40b4-bbf3-d134739f5732 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6688730734374be4857ad32670816a55, user_id=9659dd6de3aa4c1c87bb28c04d0d91b3, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:38.792784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbfad5f-0085-40b4-bbf3-d134739f5732 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:38.808158 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1152/2300] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:23:38 2022] PUT /identity/v3/projects/6688730734374be4857ad32670816a55/users/9659dd6de3aa4c1c87bb28c04d0d91b3/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:23:38.818641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5e765-2b82-4a97-a243-36a4ee3bf217 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:38.818931 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5e765-2b82-4a97-a243-36a4ee3bf217 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:38.819399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f5e765-2b82-4a97-a243-36a4ee3bf217 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:38.856743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-56f5e765-2b82-4a97-a243-36a4ee3bf217 None None] MFA Rules not processed for user `9659dd6de3aa4c1c87bb28c04d0d91b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:38.858078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-56f5e765-2b82-4a97-a243-36a4ee3bf217 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:38.920253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:38.923966 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1149/2301] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:38.928881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfad5f-0085-40b4-bbf3-d134739f5732 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:38.996058 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbfad5f-0085-40b4-bbf3-d134739f5732 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:39.002288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700b842-227b-41d1-a037-658d1b239033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:39.002938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700b842-227b-41d1-a037-658d1b239033 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:39.003210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700b842-227b-41d1-a037-658d1b239033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:39.003485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3700b842-227b-41d1-a037-658d1b239033 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:39.004116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700b842-227b-41d1-a037-658d1b239033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:39.006039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3700b842-227b-41d1-a037-658d1b239033 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:39.039331 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1153/2302] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:23:38 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:39.040649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5e765-2b82-4a97-a243-36a4ee3bf217 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:39.057471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f5e765-2b82-4a97-a243-36a4ee3bf217 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:39.122721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b798bc-fd84-40e4-b860-29b4ec3eb928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:39.123468 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b798bc-fd84-40e4-b860-29b4ec3eb928 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:39.123744 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b798bc-fd84-40e4-b860-29b4ec3eb928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:39.124036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b798bc-fd84-40e4-b860-29b4ec3eb928 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:39.124842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b798bc-fd84-40e4-b860-29b4ec3eb928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:39.126815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b798bc-fd84-40e4-b860-29b4ec3eb928 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:39.150514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1150/2303] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:23:39 2022] POST /identity/v3/users => generated 288 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:39.154593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700b842-227b-41d1-a037-658d1b239033 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:39.165898 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3700b842-227b-41d1-a037-658d1b239033 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:39.171392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0088d1b-2ccf-4dc4-ac59-7c407fec285a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:39.172018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0088d1b-2ccf-4dc4-ac59-7c407fec285a admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:39.172297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0088d1b-2ccf-4dc4-ac59-7c407fec285a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:39.172579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0088d1b-2ccf-4dc4-ac59-7c407fec285a admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:39.173252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0088d1b-2ccf-4dc4-ac59-7c407fec285a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:39.174950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0088d1b-2ccf-4dc4-ac59-7c407fec285a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:39.186434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1154/2304] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:39.190762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b798bc-fd84-40e4-b860-29b4ec3eb928 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:39.201389 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b798bc-fd84-40e4-b860-29b4ec3eb928 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:39.206297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4355483-78bd-4941-8798-0df8973fb4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:39.206977 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4355483-78bd-4941-8798-0df8973fb4aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:39.207257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4355483-78bd-4941-8798-0df8973fb4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:39.207529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4355483-78bd-4941-8798-0df8973fb4aa admin admin] PATH_INFO: `/v3/projects/c6b15b0275c8437788b49ed08415d627/users/099caa62e5bd4691bbbc3525a4f95473/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:39.224708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4355483-78bd-4941-8798-0df8973fb4aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b15b0275c8437788b49ed08415d627, user_id=099caa62e5bd4691bbbc3525a4f95473, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:39.227650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4355483-78bd-4941-8798-0df8973fb4aa admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:39.244409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1151/2305] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:23:39 2022] PUT /identity/v3/projects/c6b15b0275c8437788b49ed08415d627/users/099caa62e5bd4691bbbc3525a4f95473/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:39.248425 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0088d1b-2ccf-4dc4-ac59-7c407fec285a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:39.259232 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0088d1b-2ccf-4dc4-ac59-7c407fec285a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:39.325989 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d35549c-9498-4d48-95e8-2a6d2cf45125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:39.326610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35549c-9498-4d48-95e8-2a6d2cf45125 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:39.326895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35549c-9498-4d48-95e8-2a6d2cf45125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:39.327160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d35549c-9498-4d48-95e8-2a6d2cf45125 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:39.327939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35549c-9498-4d48-95e8-2a6d2cf45125 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:39.329561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d35549c-9498-4d48-95e8-2a6d2cf45125 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:39.341748 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1155/2306] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:39.346209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4355483-78bd-4941-8798-0df8973fb4aa admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:39.357769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4355483-78bd-4941-8798-0df8973fb4aa admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:39.362851 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ad3ed-9c7b-440a-8831-83f95740feee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:39.363551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ad3ed-9c7b-440a-8831-83f95740feee admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:39.364538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ad3ed-9c7b-440a-8831-83f95740feee admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:39.364538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811ad3ed-9c7b-440a-8831-83f95740feee admin admin] PATH_INFO: `/v3/projects/c6b15b0275c8437788b49ed08415d627/users/099caa62e5bd4691bbbc3525a4f95473/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:39.366402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ad3ed-9c7b-440a-8831-83f95740feee admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b15b0275c8437788b49ed08415d627, user_id=099caa62e5bd4691bbbc3525a4f95473, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:39.369201 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811ad3ed-9c7b-440a-8831-83f95740feee admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:39.381664 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1152/2307] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:23:39 2022] PUT /identity/v3/projects/c6b15b0275c8437788b49ed08415d627/users/099caa62e5bd4691bbbc3525a4f95473/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:39.394081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8d6f1-d8a7-46c9-86a1-723ff02b842e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:39.394321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8d6f1-d8a7-46c9-86a1-723ff02b842e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:39.394581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d8d6f1-d8a7-46c9-86a1-723ff02b842e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:39.416199 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:39.426314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-59d8d6f1-d8a7-46c9-86a1-723ff02b842e None None] MFA Rules not processed for user `099caa62e5bd4691bbbc3525a4f95473`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:39.427776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-59d8d6f1-d8a7-46c9-86a1-723ff02b842e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:39.518576 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1156/2308] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:39 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:39.530326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ad3ed-9c7b-440a-8831-83f95740feee admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:39.532930 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-811ad3ed-9c7b-440a-8831-83f95740feee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:39.632522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811ad3ed-9c7b-440a-8831-83f95740feee admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:39.636265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cdc6b1-7821-433e-856d-966fe1fd1e35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:39.636889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdc6b1-7821-433e-856d-966fe1fd1e35 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:39.637177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdc6b1-7821-433e-856d-966fe1fd1e35 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:39.637440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cdc6b1-7821-433e-856d-966fe1fd1e35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:39.649681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdc6b1-7821-433e-856d-966fe1fd1e35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:39.651286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cdc6b1-7821-433e-856d-966fe1fd1e35 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:39.662822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1153/2309] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:39 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:39.766867 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8d6f1-d8a7-46c9-86a1-723ff02b842e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:39.782375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d8d6f1-d8a7-46c9-86a1-723ff02b842e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:39.787283 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d998cb4-5e77-4f5a-be57-3b8d7123f423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:39.789115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d998cb4-5e77-4f5a-be57-3b8d7123f423 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:39.789246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d998cb4-5e77-4f5a-be57-3b8d7123f423 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:39.789467 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d998cb4-5e77-4f5a-be57-3b8d7123f423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:39.875099 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d998cb4-5e77-4f5a-be57-3b8d7123f423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:39.877893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d998cb4-5e77-4f5a-be57-3b8d7123f423 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:39.900546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1157/2310] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:40.421771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe047c9-044e-4492-b84f-9bfe8a0838f0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:40.422436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe047c9-044e-4492-b84f-9bfe8a0838f0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:40.422436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe047c9-044e-4492-b84f-9bfe8a0838f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:40.445656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7fe047c9-044e-4492-b84f-9bfe8a0838f0 None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:40.447103 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7fe047c9-044e-4492-b84f-9bfe8a0838f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:40.509034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:40.519078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1154/2311] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:23:40 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:40.536954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d998cb4-5e77-4f5a-be57-3b8d7123f423 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:40.540540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5d998cb4-5e77-4f5a-be57-3b8d7123f423 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:40.638257 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d998cb4-5e77-4f5a-be57-3b8d7123f423 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:40.643884 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b34b0-8703-47b5-903d-63154cddd2a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:40.644685 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b34b0-8703-47b5-903d-63154cddd2a2 service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:40.644961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b34b0-8703-47b5-903d-63154cddd2a2 service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:40.645231 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145b34b0-8703-47b5-903d-63154cddd2a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:40.656531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b34b0-8703-47b5-903d-63154cddd2a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:40.658466 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-145b34b0-8703-47b5-903d-63154cddd2a2 service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:40.669564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1158/2312] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:23:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 19:23:43.292216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe047c9-044e-4492-b84f-9bfe8a0838f0 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:43.293819 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7fe047c9-044e-4492-b84f-9bfe8a0838f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:43.400961 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe047c9-044e-4492-b84f-9bfe8a0838f0 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:43.408594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba71cdd-c693-4279-b4e8-8c7310a1255a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:43.408594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba71cdd-c693-4279-b4e8-8c7310a1255a service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:43.408594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba71cdd-c693-4279-b4e8-8c7310a1255a service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:43.408594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba71cdd-c693-4279-b4e8-8c7310a1255a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:43.411160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-aba71cdd-c693-4279-b4e8-8c7310a1255a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:43.431305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba71cdd-c693-4279-b4e8-8c7310a1255a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:43.432671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba71cdd-c693-4279-b4e8-8c7310a1255a service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:43.444771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1155/2313] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:47.049270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b34b0-8703-47b5-903d-63154cddd2a2 service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:47.086357 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:47.172689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145b34b0-8703-47b5-903d-63154cddd2a2 service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:47.178807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:47.181470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:47.181470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:47.181470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] PATH_INFO: `/v3/users/9659dd6de3aa4c1c87bb28c04d0d91b3` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:47.181877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9659dd6de3aa4c1c87bb28c04d0d91b3)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:47.183720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:47.295591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9659dd6de3aa4c1c87bb28c04d0d91b3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:47.310806 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9659dd6de3aa4c1c87bb28c04d0d91b3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:47.311515 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9659dd6de3aa4c1c87bb28c04d0d91b3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:47.312215 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9659dd6de3aa4c1c87bb28c04d0d91b3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:47.320716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9659dd6de3aa4c1c87bb28c04d0d91b3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:47.340982 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1159/2314] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:23:47 2022] DELETE /identity/v3/users/9659dd6de3aa4c1c87bb28c04d0d91b3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:47.347362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0b59f-6d91-4533-a0e1-a045fff488af None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:47.347970 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0b59f-6d91-4533-a0e1-a045fff488af None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:47.348222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a0b59f-6d91-4533-a0e1-a045fff488af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:47.370919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-72a0b59f-6d91-4533-a0e1-a045fff488af None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:47.372619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-72a0b59f-6d91-4533-a0e1-a045fff488af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:47.452098 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1156/2315] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:47.462188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:47.465208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:47.538295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d88e0-c2f4-455a-bceb-060ed50f0e6a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:47.542157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9504b-b3e8-4d09-958d-fc13646d14bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:47.542783 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9504b-b3e8-4d09-958d-fc13646d14bb service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:47.543198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9504b-b3e8-4d09-958d-fc13646d14bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:47.543473 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd9504b-b3e8-4d09-958d-fc13646d14bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:47.558738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9504b-b3e8-4d09-958d-fc13646d14bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:47.560109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd9504b-b3e8-4d09-958d-fc13646d14bb service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:47.573528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1160/2316] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:47.932012 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0b59f-6d91-4533-a0e1-a045fff488af None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:47.933575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-72a0b59f-6d91-4533-a0e1-a045fff488af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:47.948033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a0b59f-6d91-4533-a0e1-a045fff488af None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:47.953765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:47.954911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:47.955396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:47.955880 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] PATH_INFO: `/v3/projects/6688730734374be4857ad32670816a55` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:47.957999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6688730734374be4857ad32670816a55)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:47.960448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:48.028952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6688730734374be4857ad32670816a55', 'request_id': 'req-655dc862-7ca0-48b4-ad5a-7b51f2722062'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.038368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6688730734374be4857ad32670816a55', 'request_id': 'req-655dc862-7ca0-48b4-ad5a-7b51f2722062'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.054761 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6688730734374be4857ad32670816a55', 'request_id': 'req-655dc862-7ca0-48b4-ad5a-7b51f2722062'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.067838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] The token cache is being invalidate because project 6688730734374be4857ad32670816a55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:23:48.068463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.069459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.071742 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1157/2317] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:23:47 2022] DELETE /identity/v3/projects/6688730734374be4857ad32670816a55 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:48.078163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9504b-b3e8-4d09-958d-fc13646d14bb service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:48.089417 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd9504b-b3e8-4d09-958d-fc13646d14bb service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:48.141986 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:48.162133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cf700f-208b-4d95-a41c-dc7180065c90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:48.162811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf700f-208b-4d95-a41c-dc7180065c90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:48.163092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf700f-208b-4d95-a41c-dc7180065c90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:48.163366 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cf700f-208b-4d95-a41c-dc7180065c90 admin admin] PATH_INFO: `/v3/users/099caa62e5bd4691bbbc3525a4f95473` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:48.168227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf700f-208b-4d95-a41c-dc7180065c90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=099caa62e5bd4691bbbc3525a4f95473)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:48.171387 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cf700f-208b-4d95-a41c-dc7180065c90 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:48.238599 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b6cf700f-208b-4d95-a41c-dc7180065c90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099caa62e5bd4691bbbc3525a4f95473'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.248320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b6cf700f-208b-4d95-a41c-dc7180065c90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099caa62e5bd4691bbbc3525a4f95473'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.249566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b6cf700f-208b-4d95-a41c-dc7180065c90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099caa62e5bd4691bbbc3525a4f95473'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.250566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b6cf700f-208b-4d95-a41c-dc7180065c90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099caa62e5bd4691bbbc3525a4f95473'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.265892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b6cf700f-208b-4d95-a41c-dc7180065c90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099caa62e5bd4691bbbc3525a4f95473'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.288077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1161/2318] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:23:48 2022] DELETE /identity/v3/users/099caa62e5bd4691bbbc3525a4f95473 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:48.641216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:48.642975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:48.659627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655dc862-7ca0-48b4-ad5a-7b51f2722062 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:48.695731 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:48.740740 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ac9593-8ec5-4600-bf8e-d3320d9d509e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:48.742015 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac9593-8ec5-4600-bf8e-d3320d9d509e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:48.742490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac9593-8ec5-4600-bf8e-d3320d9d509e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:48.742923 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ac9593-8ec5-4600-bf8e-d3320d9d509e admin admin] PATH_INFO: `/v3/projects/c6b15b0275c8437788b49ed08415d627` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:48.744278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac9593-8ec5-4600-bf8e-d3320d9d509e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b15b0275c8437788b49ed08415d627)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:48.746263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ac9593-8ec5-4600-bf8e-d3320d9d509e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:48.806473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-07ac9593-8ec5-4600-bf8e-d3320d9d509e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b15b0275c8437788b49ed08415d627', 'request_id': 'req-07ac9593-8ec5-4600-bf8e-d3320d9d509e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.815036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-07ac9593-8ec5-4600-bf8e-d3320d9d509e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b15b0275c8437788b49ed08415d627', 'request_id': 'req-07ac9593-8ec5-4600-bf8e-d3320d9d509e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.829004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-07ac9593-8ec5-4600-bf8e-d3320d9d509e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b15b0275c8437788b49ed08415d627', 'request_id': 'req-07ac9593-8ec5-4600-bf8e-d3320d9d509e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.847370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-07ac9593-8ec5-4600-bf8e-d3320d9d509e admin admin] The token cache is being invalidate because project c6b15b0275c8437788b49ed08415d627 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:23:48.847918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-07ac9593-8ec5-4600-bf8e-d3320d9d509e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.848733 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-07ac9593-8ec5-4600-bf8e-d3320d9d509e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:48.851487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1158/2319] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:23:48 2022] DELETE /identity/v3/projects/c6b15b0275c8437788b49ed08415d627 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:48.856593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037871b5-cb4a-420a-b6ea-3dc8254bb53d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:48.856950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037871b5-cb4a-420a-b6ea-3dc8254bb53d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:48.857446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037871b5-cb4a-420a-b6ea-3dc8254bb53d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:48.884360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-037871b5-cb4a-420a-b6ea-3dc8254bb53d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:48.886739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-037871b5-cb4a-420a-b6ea-3dc8254bb53d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:48.970666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1162/2320] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:48.979259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7baf28-d384-40df-9417-f7030875cab7 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:48.979552 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7baf28-d384-40df-9417-f7030875cab7 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:48.979829 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7baf28-d384-40df-9417-f7030875cab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:49.004373 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1b7baf28-d384-40df-9417-f7030875cab7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:49.005636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1b7baf28-d384-40df-9417-f7030875cab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:49.021200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1159/2321] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:49.023054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037871b5-cb4a-420a-b6ea-3dc8254bb53d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:49.036190 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-037871b5-cb4a-420a-b6ea-3dc8254bb53d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:49.042224 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e49de-d150-4404-98ac-c6cdf619ecbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:49.042865 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e49de-d150-4404-98ac-c6cdf619ecbd admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:49.043146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e49de-d150-4404-98ac-c6cdf619ecbd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:49.043417 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2e49de-d150-4404-98ac-c6cdf619ecbd admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:49.044085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e49de-d150-4404-98ac-c6cdf619ecbd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:23:49.044389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e49de-d150-4404-98ac-c6cdf619ecbd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:49.046090 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2e49de-d150-4404-98ac-c6cdf619ecbd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:49.063083 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1163/2322] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:23:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:23:49.067627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7baf28-d384-40df-9417-f7030875cab7 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:49.078088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b7baf28-d384-40df-9417-f7030875cab7 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:49.087315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039441c-4803-4596-836c-9cb28dae70a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:49.088132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039441c-4803-4596-836c-9cb28dae70a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:49.088500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039441c-4803-4596-836c-9cb28dae70a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:49.088869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4039441c-4803-4596-836c-9cb28dae70a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:49.089648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039441c-4803-4596-836c-9cb28dae70a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:49.091646 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4039441c-4803-4596-836c-9cb28dae70a2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:49.136155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1160/2323] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:23:49 2022] POST /identity/v3/projects => generated 367 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:49.137749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e49de-d150-4404-98ac-c6cdf619ecbd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:49.156701 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2e49de-d150-4404-98ac-c6cdf619ecbd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:49.227616 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:49.245495 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23a87b-f79e-4da7-88ce-3070ab45bc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:49.246727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a87b-f79e-4da7-88ce-3070ab45bc01 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:49.247167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a87b-f79e-4da7-88ce-3070ab45bc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:49.247879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a23a87b-f79e-4da7-88ce-3070ab45bc01 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:49.248873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23a87b-f79e-4da7-88ce-3070ab45bc01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:49.252754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a23a87b-f79e-4da7-88ce-3070ab45bc01 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:49.289446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1164/2324] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:23:49 2022] POST /identity/v3/users => generated 284 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:49.290779 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039441c-4803-4596-836c-9cb28dae70a2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:49.304990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4039441c-4803-4596-836c-9cb28dae70a2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:49.315899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd01464-cee1-4791-a724-5c27ca7ecbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:49.316544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd01464-cee1-4791-a724-5c27ca7ecbae admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:49.316818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd01464-cee1-4791-a724-5c27ca7ecbae admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:49.317900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd01464-cee1-4791-a724-5c27ca7ecbae admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:49.318689 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd01464-cee1-4791-a724-5c27ca7ecbae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:49.321179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd01464-cee1-4791-a724-5c27ca7ecbae admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:49.335877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1161/2325] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:49.340820 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23a87b-f79e-4da7-88ce-3070ab45bc01 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:49.351900 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a23a87b-f79e-4da7-88ce-3070ab45bc01 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:49.356856 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8348f5-0190-471d-add2-2a1bcfbf6843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:49.357466 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8348f5-0190-471d-add2-2a1bcfbf6843 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:49.359682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8348f5-0190-471d-add2-2a1bcfbf6843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:49.359682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8348f5-0190-471d-add2-2a1bcfbf6843 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:49.359682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8348f5-0190-471d-add2-2a1bcfbf6843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:49.360346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8348f5-0190-471d-add2-2a1bcfbf6843 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:49.373307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1165/2326] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:49.377607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd01464-cee1-4791-a724-5c27ca7ecbae admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:49.388785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd01464-cee1-4791-a724-5c27ca7ecbae admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:49.394474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d2d76-e716-4007-9875-e1211dfface2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:49.395159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d2d76-e716-4007-9875-e1211dfface2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:49.395434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d2d76-e716-4007-9875-e1211dfface2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:49.395775 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe3d2d76-e716-4007-9875-e1211dfface2 admin admin] PATH_INFO: `/v3/projects/d3f872731f6e47ab8bdbd786a358db68/users/9a0f5f58878948ccbd9306025d363853/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:49.415704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d2d76-e716-4007-9875-e1211dfface2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3f872731f6e47ab8bdbd786a358db68, user_id=9a0f5f58878948ccbd9306025d363853, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:49.418702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe3d2d76-e716-4007-9875-e1211dfface2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:49.439234 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1162/2327] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:23:49 2022] PUT /identity/v3/projects/d3f872731f6e47ab8bdbd786a358db68/users/9a0f5f58878948ccbd9306025d363853/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:49.451243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2eafd-f292-4880-8bce-3b8d300836a4 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:49.451526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2eafd-f292-4880-8bce-3b8d300836a4 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:49.451802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f2eafd-f292-4880-8bce-3b8d300836a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:49.487282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-37f2eafd-f292-4880-8bce-3b8d300836a4 None None] MFA Rules not processed for user `9a0f5f58878948ccbd9306025d363853`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:49.487855 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-37f2eafd-f292-4880-8bce-3b8d300836a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:49.573118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1166/2328] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:49 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:49.573895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d2d76-e716-4007-9875-e1211dfface2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:49.651541 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:49.667006 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe3d2d76-e716-4007-9875-e1211dfface2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:49.672376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28938169-3e90-405c-81de-8ad6d472fdd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:49.673003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28938169-3e90-405c-81de-8ad6d472fdd6 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:49.673280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28938169-3e90-405c-81de-8ad6d472fdd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:49.673557 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28938169-3e90-405c-81de-8ad6d472fdd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:49.674235 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28938169-3e90-405c-81de-8ad6d472fdd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:49.676275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28938169-3e90-405c-81de-8ad6d472fdd6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:49.719596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1163/2329] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:23:49 2022] POST /identity/v3/projects => generated 369 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:23:49.721165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2eafd-f292-4880-8bce-3b8d300836a4 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:49.734829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f2eafd-f292-4880-8bce-3b8d300836a4 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:49.811375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b2bdc-cf70-4a77-a25e-f1fbddaa91b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:49.812016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b2bdc-cf70-4a77-a25e-f1fbddaa91b8 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:49.812302 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b2bdc-cf70-4a77-a25e-f1fbddaa91b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:49.812574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8b2bdc-cf70-4a77-a25e-f1fbddaa91b8 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:49.813213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b2bdc-cf70-4a77-a25e-f1fbddaa91b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:49.815405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8b2bdc-cf70-4a77-a25e-f1fbddaa91b8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:49.841310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28938169-3e90-405c-81de-8ad6d472fdd6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:49.843210 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-28938169-3e90-405c-81de-8ad6d472fdd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:49.849428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1167/2330] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:23:49 2022] POST /identity/v3/users => generated 291 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:23:49.853442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b2bdc-cf70-4a77-a25e-f1fbddaa91b8 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:49.876488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8b2bdc-cf70-4a77-a25e-f1fbddaa91b8 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:49.882595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7878c58-42dd-4043-a3b4-8ed5556f764e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:49.883466 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7878c58-42dd-4043-a3b4-8ed5556f764e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:49.883749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7878c58-42dd-4043-a3b4-8ed5556f764e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:49.884022 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7878c58-42dd-4043-a3b4-8ed5556f764e admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:49.884683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7878c58-42dd-4043-a3b4-8ed5556f764e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:49.886434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7878c58-42dd-4043-a3b4-8ed5556f764e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:49.898346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1168/2331] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:23:49.903229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7878c58-42dd-4043-a3b4-8ed5556f764e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:49.914599 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7878c58-42dd-4043-a3b4-8ed5556f764e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:49.920443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c47ef-8d68-480b-a8c7-6abf83e81590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:49.921134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c47ef-8d68-480b-a8c7-6abf83e81590 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:49.921414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c47ef-8d68-480b-a8c7-6abf83e81590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:49.921771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84c47ef-8d68-480b-a8c7-6abf83e81590 admin admin] PATH_INFO: `/v3/projects/db441c46d2194d25b391d781776335f9/users/6aeee75dd5f846a89f292d4185213719/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:49.941398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c47ef-8d68-480b-a8c7-6abf83e81590 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db441c46d2194d25b391d781776335f9, user_id=6aeee75dd5f846a89f292d4185213719, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:49.944450 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84c47ef-8d68-480b-a8c7-6abf83e81590 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:49.967502 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1169/2332] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:23:49 2022] PUT /identity/v3/projects/db441c46d2194d25b391d781776335f9/users/6aeee75dd5f846a89f292d4185213719/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:23:49.968546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c47ef-8d68-480b-a8c7-6abf83e81590 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:49.972292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28938169-3e90-405c-81de-8ad6d472fdd6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:49.985152 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:50.068324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a00881-fc00-4410-8ff0-8efed5fedf38 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:50.069302 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a00881-fc00-4410-8ff0-8efed5fedf38 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:50.069590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a00881-fc00-4410-8ff0-8efed5fedf38 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:50.069896 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a00881-fc00-4410-8ff0-8efed5fedf38 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:50.073829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84c47ef-8d68-480b-a8c7-6abf83e81590 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:50.076258 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e4a00881-fc00-4410-8ff0-8efed5fedf38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:50.083956 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ea5f4-6cf9-48fa-b027-82611ce783de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:50.085129 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ea5f4-6cf9-48fa-b027-82611ce783de admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:50.085420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ea5f4-6cf9-48fa-b027-82611ce783de admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:50.085697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8ea5f4-6cf9-48fa-b027-82611ce783de admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:50.086415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ea5f4-6cf9-48fa-b027-82611ce783de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:50.088144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8ea5f4-6cf9-48fa-b027-82611ce783de admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:50.100351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1170/2333] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:49 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:50.104553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ea5f4-6cf9-48fa-b027-82611ce783de admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:50.117875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8ea5f4-6cf9-48fa-b027-82611ce783de admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:50.128184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13f148e-ffb4-4f8c-be28-b77d74153022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:50.129095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f148e-ffb4-4f8c-be28-b77d74153022 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:50.129480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f148e-ffb4-4f8c-be28-b77d74153022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:50.129970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13f148e-ffb4-4f8c-be28-b77d74153022 admin admin] PATH_INFO: `/v3/projects/db441c46d2194d25b391d781776335f9/users/6aeee75dd5f846a89f292d4185213719/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:50.132420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f148e-ffb4-4f8c-be28-b77d74153022 admin admin] RBAC: Authorizing `identity:create_grant(project_id=db441c46d2194d25b391d781776335f9, user_id=6aeee75dd5f846a89f292d4185213719, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:50.136540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13f148e-ffb4-4f8c-be28-b77d74153022 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:50.156121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a00881-fc00-4410-8ff0-8efed5fedf38 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:50.157772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a00881-fc00-4410-8ff0-8efed5fedf38 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:50.163517 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1171/2334] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:23:50 2022] PUT /identity/v3/projects/db441c46d2194d25b391d781776335f9/users/6aeee75dd5f846a89f292d4185213719/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:50.175046 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c65b97-736e-473f-b658-ab4656af1390 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:50.175279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1164/2335] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:50.185099 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c65b97-736e-473f-b658-ab4656af1390 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:50.185382 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c65b97-736e-473f-b658-ab4656af1390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:50.220553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-a7c65b97-736e-473f-b658-ab4656af1390 None None] MFA Rules not processed for user `6aeee75dd5f846a89f292d4185213719`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:50.222242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a7c65b97-736e-473f-b658-ab4656af1390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:50.421734 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1172/2336] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:50 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:23:50.434009 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a00881-fc00-4410-8ff0-8efed5fedf38 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:50.436831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e4a00881-fc00-4410-8ff0-8efed5fedf38 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:50.465977 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:50.594945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a00881-fc00-4410-8ff0-8efed5fedf38 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:50.714899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf99dbe-8a3d-4dfb-bf80-f8954f63a844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:50.715639 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf99dbe-8a3d-4dfb-bf80-f8954f63a844 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:50.715823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf99dbe-8a3d-4dfb-bf80-f8954f63a844 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:50.716059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf99dbe-8a3d-4dfb-bf80-f8954f63a844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:50.730322 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf99dbe-8a3d-4dfb-bf80-f8954f63a844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:50.732199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf99dbe-8a3d-4dfb-bf80-f8954f63a844 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:50.745186 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1165/2337] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:50 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:52.446192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c65b97-736e-473f-b658-ab4656af1390 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:52.524511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c65b97-736e-473f-b658-ab4656af1390 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:52.529371 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:52.530077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:52.530362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:52.530874 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] PATH_INFO: `/v3/users/9a0f5f58878948ccbd9306025d363853` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:52.531807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0f5f58878948ccbd9306025d363853)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:52.533809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:52.563135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:52.598140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0f5f58878948ccbd9306025d363853'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:52.608930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0f5f58878948ccbd9306025d363853'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:52.609840 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0f5f58878948ccbd9306025d363853'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:52.610704 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0f5f58878948ccbd9306025d363853'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:52.619789 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0f5f58878948ccbd9306025d363853'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:52.641688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1173/2338] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:23:52 2022] DELETE /identity/v3/users/9a0f5f58878948ccbd9306025d363853 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:52.647571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d5ec1-2205-4b00-b2b5-b8248ccd6ae8 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:52.648128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d5ec1-2205-4b00-b2b5-b8248ccd6ae8 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:52.648128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810d5ec1-2205-4b00-b2b5-b8248ccd6ae8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:52.668913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-810d5ec1-2205-4b00-b2b5-b8248ccd6ae8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:52.670161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-810d5ec1-2205-4b00-b2b5-b8248ccd6ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:52.746065 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1166/2339] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:52.757552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:52.759085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:52.824809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd694c1-5d5b-45cd-aff0-66a785a13d32 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:52.828543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0f36-9898-4e39-b0ae-96401dfadacd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:52.829155 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0f36-9898-4e39-b0ae-96401dfadacd service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:52.829429 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0f36-9898-4e39-b0ae-96401dfadacd service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:52.829690 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862a0f36-9898-4e39-b0ae-96401dfadacd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:52.840964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a0f36-9898-4e39-b0ae-96401dfadacd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:52.842540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862a0f36-9898-4e39-b0ae-96401dfadacd service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:52.854399 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1174/2340] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:53.152154 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d5ec1-2205-4b00-b2b5-b8248ccd6ae8 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:53.153701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-810d5ec1-2205-4b00-b2b5-b8248ccd6ae8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:53.172005 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810d5ec1-2205-4b00-b2b5-b8248ccd6ae8 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:53.178620 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:53.179300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:53.179514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:53.179777 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] PATH_INFO: `/v3/projects/d3f872731f6e47ab8bdbd786a358db68` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:53.181056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3f872731f6e47ab8bdbd786a358db68)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:53.183111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:53.237866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3f872731f6e47ab8bdbd786a358db68', 'request_id': 'req-cde0448b-b354-48c3-a585-6e16295e6247'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.247359 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3f872731f6e47ab8bdbd786a358db68', 'request_id': 'req-cde0448b-b354-48c3-a585-6e16295e6247'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.258465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3f872731f6e47ab8bdbd786a358db68', 'request_id': 'req-cde0448b-b354-48c3-a585-6e16295e6247'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.263284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:53.271848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] The token cache is being invalidate because project d3f872731f6e47ab8bdbd786a358db68 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:23:53.272153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.273114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.274870 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1167/2341] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:23:53 2022] DELETE /identity/v3/projects/d3f872731f6e47ab8bdbd786a358db68 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:53.279114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0f36-9898-4e39-b0ae-96401dfadacd service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:53.288949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862a0f36-9898-4e39-b0ae-96401dfadacd service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:53.347883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656870d9-0183-46ad-9027-787a33ef8bdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:53.348511 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656870d9-0183-46ad-9027-787a33ef8bdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:53.348786 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656870d9-0183-46ad-9027-787a33ef8bdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:53.349054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656870d9-0183-46ad-9027-787a33ef8bdc admin admin] PATH_INFO: `/v3/users/6aeee75dd5f846a89f292d4185213719` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:53.350547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656870d9-0183-46ad-9027-787a33ef8bdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6aeee75dd5f846a89f292d4185213719)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:53.352481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656870d9-0183-46ad-9027-787a33ef8bdc admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:53.402396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:53.403726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-656870d9-0183-46ad-9027-787a33ef8bdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6aeee75dd5f846a89f292d4185213719'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.414876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-656870d9-0183-46ad-9027-787a33ef8bdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6aeee75dd5f846a89f292d4185213719'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.415911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-656870d9-0183-46ad-9027-787a33ef8bdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6aeee75dd5f846a89f292d4185213719'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.416931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-656870d9-0183-46ad-9027-787a33ef8bdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6aeee75dd5f846a89f292d4185213719'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.425802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-656870d9-0183-46ad-9027-787a33ef8bdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6aeee75dd5f846a89f292d4185213719'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.447691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1175/2342] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:23:53 2022] DELETE /identity/v3/users/6aeee75dd5f846a89f292d4185213719 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:53.740873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:53.742383 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:53.758853 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde0448b-b354-48c3-a585-6e16295e6247 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:53.821283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e9c079-1c81-4f9a-a387-4e3e254efa8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:53.821821 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c079-1c81-4f9a-a387-4e3e254efa8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:53.822135 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c079-1c81-4f9a-a387-4e3e254efa8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:53.822395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e9c079-1c81-4f9a-a387-4e3e254efa8c admin admin] PATH_INFO: `/v3/projects/db441c46d2194d25b391d781776335f9` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:53.823759 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9c079-1c81-4f9a-a387-4e3e254efa8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=db441c46d2194d25b391d781776335f9)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:53.825712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e9c079-1c81-4f9a-a387-4e3e254efa8c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:53.877166 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-24e9c079-1c81-4f9a-a387-4e3e254efa8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'db441c46d2194d25b391d781776335f9', 'request_id': 'req-24e9c079-1c81-4f9a-a387-4e3e254efa8c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.883853 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-24e9c079-1c81-4f9a-a387-4e3e254efa8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'db441c46d2194d25b391d781776335f9', 'request_id': 'req-24e9c079-1c81-4f9a-a387-4e3e254efa8c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.895058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-24e9c079-1c81-4f9a-a387-4e3e254efa8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'db441c46d2194d25b391d781776335f9', 'request_id': 'req-24e9c079-1c81-4f9a-a387-4e3e254efa8c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.910441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-24e9c079-1c81-4f9a-a387-4e3e254efa8c admin admin] The token cache is being invalidate because project db441c46d2194d25b391d781776335f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:23:53.910792 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-24e9c079-1c81-4f9a-a387-4e3e254efa8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.911716 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-24e9c079-1c81-4f9a-a387-4e3e254efa8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:53.913386 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1168/2343] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:23:53 2022] DELETE /identity/v3/projects/db441c46d2194d25b391d781776335f9 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:53.918933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cdaef-6a4c-4cc8-982f-926d4eefea74 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:53.919248 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cdaef-6a4c-4cc8-982f-926d4eefea74 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:53.919527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827cdaef-6a4c-4cc8-982f-926d4eefea74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:53.940015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-827cdaef-6a4c-4cc8-982f-926d4eefea74 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:53.941228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-827cdaef-6a4c-4cc8-982f-926d4eefea74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:54.014712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1176/2344] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:54.022301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fc15e-5574-4d1e-9193-e53f655fe094 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.022504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fc15e-5574-4d1e-9193-e53f655fe094 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.022784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451fc15e-5574-4d1e-9193-e53f655fe094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.043463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-451fc15e-5574-4d1e-9193-e53f655fe094 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:54.044693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-451fc15e-5574-4d1e-9193-e53f655fe094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:54.053231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1169/2345] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:54.058502 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cdaef-6a4c-4cc8-982f-926d4eefea74 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:54.069214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827cdaef-6a4c-4cc8-982f-926d4eefea74 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:54.074068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ac998-9bda-441a-9a75-2182e8d46113 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:54.074620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ac998-9bda-441a-9a75-2182e8d46113 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.074898 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ac998-9bda-441a-9a75-2182e8d46113 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.075169 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ac998-9bda-441a-9a75-2182e8d46113 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.075818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ac998-9bda-441a-9a75-2182e8d46113 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:23:54.076116 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ac998-9bda-441a-9a75-2182e8d46113 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:54.077872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ac998-9bda-441a-9a75-2182e8d46113 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:54.091736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1177/2346] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:23:54.096166 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fc15e-5574-4d1e-9193-e53f655fe094 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:54.106304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451fc15e-5574-4d1e-9193-e53f655fe094 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:54.111483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728c33e-bc37-42fc-912f-7b4b1ca50928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:54.112100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728c33e-bc37-42fc-912f-7b4b1ca50928 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.112377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728c33e-bc37-42fc-912f-7b4b1ca50928 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.112648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1728c33e-bc37-42fc-912f-7b4b1ca50928 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.113318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728c33e-bc37-42fc-912f-7b4b1ca50928 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:54.115316 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1728c33e-bc37-42fc-912f-7b4b1ca50928 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:54.146754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1170/2347] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:23:54 2022] POST /identity/v3/projects => generated 379 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:54.150956 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ac998-9bda-441a-9a75-2182e8d46113 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:54.161487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ac998-9bda-441a-9a75-2182e8d46113 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:54.222560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685d291-cbba-4b3e-abe4-0ad5ca7c728b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:54.223140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d291-cbba-4b3e-abe4-0ad5ca7c728b admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.223417 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d291-cbba-4b3e-abe4-0ad5ca7c728b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.223685 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3685d291-cbba-4b3e-abe4-0ad5ca7c728b admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.224315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685d291-cbba-4b3e-abe4-0ad5ca7c728b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:54.226366 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3685d291-cbba-4b3e-abe4-0ad5ca7c728b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:54.253108 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1178/2348] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:23:54 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:54.258938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728c33e-bc37-42fc-912f-7b4b1ca50928 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:54.273926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1728c33e-bc37-42fc-912f-7b4b1ca50928 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:54.278980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829b1f8-b61c-48ea-902b-fba832ad7fd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:54.279612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829b1f8-b61c-48ea-902b-fba832ad7fd3 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.279890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829b1f8-b61c-48ea-902b-fba832ad7fd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.280162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2829b1f8-b61c-48ea-902b-fba832ad7fd3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.280812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829b1f8-b61c-48ea-902b-fba832ad7fd3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:54.282480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2829b1f8-b61c-48ea-902b-fba832ad7fd3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:54.293107 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1171/2349] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:54.297375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685d291-cbba-4b3e-abe4-0ad5ca7c728b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:54.310190 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3685d291-cbba-4b3e-abe4-0ad5ca7c728b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:54.317647 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a6fd53-880d-4b47-bf41-fd728986882e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:54.318550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6fd53-880d-4b47-bf41-fd728986882e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.318915 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6fd53-880d-4b47-bf41-fd728986882e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.319261 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a6fd53-880d-4b47-bf41-fd728986882e admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.320149 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6fd53-880d-4b47-bf41-fd728986882e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:54.322544 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a6fd53-880d-4b47-bf41-fd728986882e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:54.337369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1179/2350] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:54.342581 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829b1f8-b61c-48ea-902b-fba832ad7fd3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:54.357984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2829b1f8-b61c-48ea-902b-fba832ad7fd3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:54.365624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352734f-92ab-4d8a-b9bc-ad4141ae7711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:54.366084 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352734f-92ab-4d8a-b9bc-ad4141ae7711 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.366364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352734f-92ab-4d8a-b9bc-ad4141ae7711 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.366631 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6352734f-92ab-4d8a-b9bc-ad4141ae7711 admin admin] PATH_INFO: `/v3/projects/9adf7777aacd487cb0b291af05fa57b0/users/72eeb6d4e12f478b850cf29f568f9e32/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.382526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352734f-92ab-4d8a-b9bc-ad4141ae7711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9adf7777aacd487cb0b291af05fa57b0, user_id=72eeb6d4e12f478b850cf29f568f9e32, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:54.385182 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6352734f-92ab-4d8a-b9bc-ad4141ae7711 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:54.401935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1172/2351] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:23:54 2022] PUT /identity/v3/projects/9adf7777aacd487cb0b291af05fa57b0/users/72eeb6d4e12f478b850cf29f568f9e32/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:54.413643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cd611-4d05-4926-a68c-a3d1706020fe None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.413983 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cd611-4d05-4926-a68c-a3d1706020fe None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.414372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5cd611-4d05-4926-a68c-a3d1706020fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.444333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1d5cd611-4d05-4926-a68c-a3d1706020fe None None] MFA Rules not processed for user `72eeb6d4e12f478b850cf29f568f9e32`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:54.445567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1d5cd611-4d05-4926-a68c-a3d1706020fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:54.464312 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:54.530683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1180/2352] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:54.535764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352734f-92ab-4d8a-b9bc-ad4141ae7711 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:54.568170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:54.614264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6352734f-92ab-4d8a-b9bc-ad4141ae7711 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:54.619092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3141a-d357-472f-8044-3937ac84a7aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:54.619708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3141a-d357-472f-8044-3937ac84a7aa admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.619987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3141a-d357-472f-8044-3937ac84a7aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.620260 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c3141a-d357-472f-8044-3937ac84a7aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.620911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3141a-d357-472f-8044-3937ac84a7aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:54.622902 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c3141a-d357-472f-8044-3937ac84a7aa admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:54.657053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1173/2353] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:23:54 2022] POST /identity/v3/projects => generated 381 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:54.658474 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cd611-4d05-4926-a68c-a3d1706020fe None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:54.670845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5cd611-4d05-4926-a68c-a3d1706020fe None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:54.730870 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b203a8-4e58-4650-9737-6a84371e1b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:54.731485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b203a8-4e58-4650-9737-6a84371e1b3c admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.731756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b203a8-4e58-4650-9737-6a84371e1b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.732021 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b203a8-4e58-4650-9737-6a84371e1b3c admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.732639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b203a8-4e58-4650-9737-6a84371e1b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:54.734627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b203a8-4e58-4650-9737-6a84371e1b3c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:54.758707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1181/2354] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:23:54 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:54.762802 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3141a-d357-472f-8044-3937ac84a7aa admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:54.774250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c3141a-d357-472f-8044-3937ac84a7aa admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:54.779267 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81115-cebc-4290-8efd-fc1d5cf26b7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:54.779874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81115-cebc-4290-8efd-fc1d5cf26b7b admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.780176 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81115-cebc-4290-8efd-fc1d5cf26b7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.780580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c81115-cebc-4290-8efd-fc1d5cf26b7b admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.781233 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c81115-cebc-4290-8efd-fc1d5cf26b7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:54.782881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c81115-cebc-4290-8efd-fc1d5cf26b7b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:54.794078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1174/2355] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:54.798727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b203a8-4e58-4650-9737-6a84371e1b3c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:54.810668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b203a8-4e58-4650-9737-6a84371e1b3c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:54.816295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f72cf-55f2-4d30-b722-c965010b65c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:54.816960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f72cf-55f2-4d30-b722-c965010b65c7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.817233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f72cf-55f2-4d30-b722-c965010b65c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.817499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34f72cf-55f2-4d30-b722-c965010b65c7 admin admin] PATH_INFO: `/v3/projects/f728b57fcc5943d29028e39a7619222f/users/b7772bff0ba74ae5a8621b9b4d17ffb9/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.833731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f72cf-55f2-4d30-b722-c965010b65c7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f728b57fcc5943d29028e39a7619222f, user_id=b7772bff0ba74ae5a8621b9b4d17ffb9, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:54.836439 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c34f72cf-55f2-4d30-b722-c965010b65c7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:54.851498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1182/2356] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:23:54 2022] PUT /identity/v3/projects/f728b57fcc5943d29028e39a7619222f/users/b7772bff0ba74ae5a8621b9b4d17ffb9/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:23:54.856536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81115-cebc-4290-8efd-fc1d5cf26b7b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:54.873726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c81115-cebc-4290-8efd-fc1d5cf26b7b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:54.950270 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da1144f-927a-4848-8977-b61b2e12df02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:54.950967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1144f-927a-4848-8977-b61b2e12df02 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.951242 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1144f-927a-4848-8977-b61b2e12df02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.951425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da1144f-927a-4848-8977-b61b2e12df02 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.952075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1144f-927a-4848-8977-b61b2e12df02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:54.953748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da1144f-927a-4848-8977-b61b2e12df02 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:54.967298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1175/2357] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:54.972414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f72cf-55f2-4d30-b722-c965010b65c7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:54.985485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34f72cf-55f2-4d30-b722-c965010b65c7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:54.992911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf56c4b-be7f-4867-8330-6c841adaddea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:54.993739 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf56c4b-be7f-4867-8330-6c841adaddea admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:54.993967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf56c4b-be7f-4867-8330-6c841adaddea admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:54.994313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf56c4b-be7f-4867-8330-6c841adaddea admin admin] PATH_INFO: `/v3/projects/f728b57fcc5943d29028e39a7619222f/users/b7772bff0ba74ae5a8621b9b4d17ffb9/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:54.996403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf56c4b-be7f-4867-8330-6c841adaddea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f728b57fcc5943d29028e39a7619222f, user_id=b7772bff0ba74ae5a8621b9b4d17ffb9, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:54.999124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf56c4b-be7f-4867-8330-6c841adaddea admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:55.016884 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1183/2358] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:23:54 2022] PUT /identity/v3/projects/f728b57fcc5943d29028e39a7619222f/users/b7772bff0ba74ae5a8621b9b4d17ffb9/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:55.027795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d7105-6904-4f2c-9167-171783c0005b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:55.028084 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d7105-6904-4f2c-9167-171783c0005b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:55.028389 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072d7105-6904-4f2c-9167-171783c0005b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:55.062909 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-072d7105-6904-4f2c-9167-171783c0005b None None] MFA Rules not processed for user `b7772bff0ba74ae5a8621b9b4d17ffb9`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:55.064150 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-072d7105-6904-4f2c-9167-171783c0005b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:55.135398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1176/2359] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:55.148299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf56c4b-be7f-4867-8330-6c841adaddea admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:55.150271 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4bf56c4b-be7f-4867-8330-6c841adaddea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:55.212807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf56c4b-be7f-4867-8330-6c841adaddea admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:55.216632 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a257bae-5968-400e-9d25-d678f1128294 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:55.217255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a257bae-5968-400e-9d25-d678f1128294 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:55.217530 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a257bae-5968-400e-9d25-d678f1128294 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:55.217877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a257bae-5968-400e-9d25-d678f1128294 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:55.227936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a257bae-5968-400e-9d25-d678f1128294 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:55.229436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a257bae-5968-400e-9d25-d678f1128294 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:55.240351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1184/2360] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:55 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:55.676298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d7105-6904-4f2c-9167-171783c0005b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:55.687875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072d7105-6904-4f2c-9167-171783c0005b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:55.704352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f055b9-447c-40de-94b7-a01cb095c1de tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7772bff0ba74ae5a8621b9b4d17ffb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f728b57fcc5943d29028e39a7619222f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:55.709053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f055b9-447c-40de-94b7-a01cb095c1de tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:55.709556 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f055b9-447c-40de-94b7-a01cb095c1de tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:55.709929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f055b9-447c-40de-94b7-a01cb095c1de tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:55.711319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f055b9-447c-40de-94b7-a01cb095c1de tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:23:55.711319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f055b9-447c-40de-94b7-a01cb095c1de tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:55.713373 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f055b9-447c-40de-94b7-a01cb095c1de tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:55.732300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1177/2361] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:23:55.732798 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a257bae-5968-400e-9d25-d678f1128294 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:55.744596 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a257bae-5968-400e-9d25-d678f1128294 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:55.750369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb46d2-c829-4fa0-8e61-77bd7c389ffb tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7772bff0ba74ae5a8621b9b4d17ffb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f728b57fcc5943d29028e39a7619222f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:55.752697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb46d2-c829-4fa0-8e61-77bd7c389ffb tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:55.752697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb46d2-c829-4fa0-8e61-77bd7c389ffb tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:55.752697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babb46d2-c829-4fa0-8e61-77bd7c389ffb tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:55.752697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb46d2-c829-4fa0-8e61-77bd7c389ffb tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:55.754456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babb46d2-c829-4fa0-8e61-77bd7c389ffb tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:55.767418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:55.791250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1185/2362] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:23:55 2022] POST /identity/v3/projects => generated 354 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:23:55.797591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f055b9-447c-40de-94b7-a01cb095c1de tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:55.807336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:55.811677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f055b9-447c-40de-94b7-a01cb095c1de tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:55.881596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c340e03-baf1-4334-8eba-3592aad244d0 tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7772bff0ba74ae5a8621b9b4d17ffb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f728b57fcc5943d29028e39a7619222f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:55.882418 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c340e03-baf1-4334-8eba-3592aad244d0 tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:55.882706 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c340e03-baf1-4334-8eba-3592aad244d0 tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:55.882989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c340e03-baf1-4334-8eba-3592aad244d0 tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:55.883710 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c340e03-baf1-4334-8eba-3592aad244d0 tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:23:55.884029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c340e03-baf1-4334-8eba-3592aad244d0 tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:55.886105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c340e03-baf1-4334-8eba-3592aad244d0 tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:55.900645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1178/2363] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:23:55.944701 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb46d2-c829-4fa0-8e61-77bd7c389ffb tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:55.956577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babb46d2-c829-4fa0-8e61-77bd7c389ffb tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:55.962506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b7772bff0ba74ae5a8621b9b4d17ffb9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'f728b57fcc5943d29028e39a7619222f', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:55.963205 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:55.963535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:55.963818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] PATH_INFO: `/v3/projects/9d77c26c81f24fcb98ed4aa321f39306` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:55.964966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: Authorizing `identity:delete_project(project_id=9d77c26c81f24fcb98ed4aa321f39306)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:55.966922 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:56.024758 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d77c26c81f24fcb98ed4aa321f39306', 'request_id': 'req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:56.031974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d77c26c81f24fcb98ed4aa321f39306', 'request_id': 'req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:56.042081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d77c26c81f24fcb98ed4aa321f39306', 'request_id': 'req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:56.057648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] The token cache is being invalidate because project 9d77c26c81f24fcb98ed4aa321f39306 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:23:56.058328 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:56.059039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-ad63bb8a-bc0a-4f2f-9aa5-c62dff2fca1b tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:56.060726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1186/2364] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:23:55 2022] DELETE /identity/v3/projects/9d77c26c81f24fcb98ed4aa321f39306 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:56.345135 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c340e03-baf1-4334-8eba-3592aad244d0 tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:56.346990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0c340e03-baf1-4334-8eba-3592aad244d0 tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:56.443202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c340e03-baf1-4334-8eba-3592aad244d0 tempest-VolumeQuotaClassesTest-1579002409 tempest-VolumeQuotaClassesTest-1579002409-project-admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:56.534944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe65b05-5bee-4f62-81ae-0597dcfc7236 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:56.536142 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe65b05-5bee-4f62-81ae-0597dcfc7236 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:56.536695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe65b05-5bee-4f62-81ae-0597dcfc7236 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:56.537325 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe65b05-5bee-4f62-81ae-0597dcfc7236 admin admin] PATH_INFO: `/v3/users/72eeb6d4e12f478b850cf29f568f9e32` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:56.539337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe65b05-5bee-4f62-81ae-0597dcfc7236 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72eeb6d4e12f478b850cf29f568f9e32)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:56.543912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe65b05-5bee-4f62-81ae-0597dcfc7236 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:56.560950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787990c2-a5b0-48b6-b28a-b0c1169fdf0b None None] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:56.561532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787990c2-a5b0-48b6-b28a-b0c1169fdf0b None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:56.561838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787990c2-a5b0-48b6-b28a-b0c1169fdf0b None None] PATH_INFO: `/` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:56.563239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1187/2365] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:23:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:23:56.573538 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd34c99-8612-4ea0-9188-61b40138e54f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:56.574157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd34c99-8612-4ea0-9188-61b40138e54f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:56.574625 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd34c99-8612-4ea0-9188-61b40138e54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:56.602077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1fd34c99-8612-4ea0-9188-61b40138e54f None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:56.603343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1fd34c99-8612-4ea0-9188-61b40138e54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:56.612843 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bfe65b05-5bee-4f62-81ae-0597dcfc7236 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72eeb6d4e12f478b850cf29f568f9e32'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:56.615339 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:56.625268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bfe65b05-5bee-4f62-81ae-0597dcfc7236 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72eeb6d4e12f478b850cf29f568f9e32'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:56.626654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bfe65b05-5bee-4f62-81ae-0597dcfc7236 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72eeb6d4e12f478b850cf29f568f9e32'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:56.627464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bfe65b05-5bee-4f62-81ae-0597dcfc7236 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72eeb6d4e12f478b850cf29f568f9e32'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:56.636142 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bfe65b05-5bee-4f62-81ae-0597dcfc7236 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72eeb6d4e12f478b850cf29f568f9e32'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:56.663656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1179/2366] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:23:56 2022] DELETE /identity/v3/users/72eeb6d4e12f478b850cf29f568f9e32 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:56.669159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c627bb-06d0-425c-aa73-2927fec7a6ba None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:56.669447 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c627bb-06d0-425c-aa73-2927fec7a6ba None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:56.669739 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c627bb-06d0-425c-aa73-2927fec7a6ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:56.690845 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-95c627bb-06d0-425c-aa73-2927fec7a6ba None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:56.692080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-95c627bb-06d0-425c-aa73-2927fec7a6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:56.697733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1188/2367] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:23:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:23:56.715668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd34c99-8612-4ea0-9188-61b40138e54f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:56.717754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1fd34c99-8612-4ea0-9188-61b40138e54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:56.772099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1180/2368] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:23:56.782623 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c627bb-06d0-425c-aa73-2927fec7a6ba None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:56.784237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-95c627bb-06d0-425c-aa73-2927fec7a6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:56.784889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd34c99-8612-4ea0-9188-61b40138e54f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:56.809121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:56.851165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e751c7b-0b0b-4980-85d0-2bf08c829678 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b06d8a144ecf43fc8de82346758b6065', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:56.851405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c627bb-06d0-425c-aa73-2927fec7a6ba None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:56.851852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e751c7b-0b0b-4980-85d0-2bf08c829678 service glance] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:56.852101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e751c7b-0b0b-4980-85d0-2bf08c829678 service glance] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:56.852378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e751c7b-0b0b-4980-85d0-2bf08c829678 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:56.855253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdfab23-57a9-4797-8d39-7c4581b1adbf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:56.855865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfab23-57a9-4797-8d39-7c4581b1adbf service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:56.856137 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfab23-57a9-4797-8d39-7c4581b1adbf service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:56.856404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdfab23-57a9-4797-8d39-7c4581b1adbf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:56.866092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfab23-57a9-4797-8d39-7c4581b1adbf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:56.867521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdfab23-57a9-4797-8d39-7c4581b1adbf service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:56.877473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1181/2369] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:23:56.927501 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e751c7b-0b0b-4980-85d0-2bf08c829678 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:56.928891 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e751c7b-0b0b-4980-85d0-2bf08c829678 service glance] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:56.941673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1189/2370] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:23:57.020088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d043bf-dd36-4c48-87bd-b8fc8229fb22 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:57.020422 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d043bf-dd36-4c48-87bd-b8fc8229fb22 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:57.020698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d043bf-dd36-4c48-87bd-b8fc8229fb22 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:57.022613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1182/2371] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:23:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 15 19:23:57.033697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471eff6-0601-4b45-a1cd-0f755c9dd667 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:57.034072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471eff6-0601-4b45-a1cd-0f755c9dd667 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:57.034406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7471eff6-0601-4b45-a1cd-0f755c9dd667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:57.055151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7471eff6-0601-4b45-a1cd-0f755c9dd667 None None] MFA Rules not processed for user `4591e01ab4954b22a81f6b09cdb2d544`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:57.056731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7471eff6-0601-4b45-a1cd-0f755c9dd667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:57.064129 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1190/2372] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:23:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:57.077515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d043bf-dd36-4c48-87bd-b8fc8229fb22 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:57.079631 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c6d043bf-dd36-4c48-87bd-b8fc8229fb22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:57.094905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d043bf-dd36-4c48-87bd-b8fc8229fb22 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:57.098874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d993506c-f7a9-4d76-8717-b8b9ef3f0d6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:57.099652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993506c-f7a9-4d76-8717-b8b9ef3f0d6b service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:57.099859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993506c-f7a9-4d76-8717-b8b9ef3f0d6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:57.100125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d993506c-f7a9-4d76-8717-b8b9ef3f0d6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:57.107867 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993506c-f7a9-4d76-8717-b8b9ef3f0d6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:57.109318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d993506c-f7a9-4d76-8717-b8b9ef3f0d6b service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:57.118244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1183/2373] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:57 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:57.171608 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471eff6-0601-4b45-a1cd-0f755c9dd667 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:57.173483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7471eff6-0601-4b45-a1cd-0f755c9dd667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:57.199866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7471eff6-0601-4b45-a1cd-0f755c9dd667 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:57.208978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:57.209893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:57.210020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:57.212123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] PATH_INFO: `/v3/projects/9adf7777aacd487cb0b291af05fa57b0` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:57.214932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] RBAC: Authorizing `identity:delete_project(project_id=9adf7777aacd487cb0b291af05fa57b0)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:57.217292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:57.224185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1059e24-9f3e-4306-b06d-bfdd528b2a93 None None] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:57.225004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1059e24-9f3e-4306-b06d-bfdd528b2a93 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:57.225004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1059e24-9f3e-4306-b06d-bfdd528b2a93 None None] PATH_INFO: `/` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:57.226317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1184/2374] 10.222.0.25 () {54 vars in 921 bytes} [Thu Sep 15 19:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 15 19:23:57.232096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc9d00-ce9e-437a-a247-6114581fbfa6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:57.232377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc9d00-ce9e-437a-a247-6114581fbfa6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:57.232648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fc9d00-ce9e-437a-a247-6114581fbfa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:57.257428 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c2fc9d00-ce9e-437a-a247-6114581fbfa6 None None] MFA Rules not processed for user `38b19e4add2a4321a2fbfeb9a3a1b61d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:57.258694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c2fc9d00-ce9e-437a-a247-6114581fbfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:57.271984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9adf7777aacd487cb0b291af05fa57b0', 'request_id': 'req-084ede21-5da2-4c3b-b002-e39934b758ab'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:57.279409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9adf7777aacd487cb0b291af05fa57b0', 'request_id': 'req-084ede21-5da2-4c3b-b002-e39934b758ab'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:57.289192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9adf7777aacd487cb0b291af05fa57b0', 'request_id': 'req-084ede21-5da2-4c3b-b002-e39934b758ab'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:57.301442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] The token cache is being invalidate because project 9adf7777aacd487cb0b291af05fa57b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:23:57.301730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:57.306036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:57.306036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1191/2375] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:23:57 2022] DELETE /identity/v3/projects/9adf7777aacd487cb0b291af05fa57b0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:57.309447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:57.314921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:57.326933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:INSERT=1,keystone:DELETE=3,keystone:SELECT=96 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:57.352706 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1185/2376] 10.222.0.25 () {58 vars in 1018 bytes} [Thu Sep 15 19:23:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:23:57.367782 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:57.368030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc9d00-ce9e-437a-a247-6114581fbfa6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:57.369466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c2fc9d00-ce9e-437a-a247-6114581fbfa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:57.394990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084ede21-5da2-4c3b-b002-e39934b758ab admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:57.402015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9151647-0081-4171-b223-862c2460518b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:57.402821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9151647-0081-4171-b223-862c2460518b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:57.403206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9151647-0081-4171-b223-862c2460518b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:57.403397 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9151647-0081-4171-b223-862c2460518b admin admin] PATH_INFO: `/v3/users/b7772bff0ba74ae5a8621b9b4d17ffb9` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:57.404624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9151647-0081-4171-b223-862c2460518b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7772bff0ba74ae5a8621b9b4d17ffb9)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:57.406601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9151647-0081-4171-b223-862c2460518b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:57.435278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fc9d00-ce9e-437a-a247-6114581fbfa6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:57.439607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9b628-5655-4db4-ab23-b5f506f31815 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:57.440367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9b628-5655-4db4-ab23-b5f506f31815 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:57.440700 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9b628-5655-4db4-ab23-b5f506f31815 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:57.441364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f9b628-5655-4db4-ab23-b5f506f31815 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:57.454015 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9b628-5655-4db4-ab23-b5f506f31815 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:57.455769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f9b628-5655-4db4-ab23-b5f506f31815 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:57.462040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f9151647-0081-4171-b223-862c2460518b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7772bff0ba74ae5a8621b9b4d17ffb9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:57.469134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1186/2377] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:57.471919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f9151647-0081-4171-b223-862c2460518b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7772bff0ba74ae5a8621b9b4d17ffb9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:57.472697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f9151647-0081-4171-b223-862c2460518b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7772bff0ba74ae5a8621b9b4d17ffb9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:57.473441 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f9151647-0081-4171-b223-862c2460518b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7772bff0ba74ae5a8621b9b4d17ffb9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:57.482157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f9151647-0081-4171-b223-862c2460518b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7772bff0ba74ae5a8621b9b4d17ffb9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:57.506069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1192/2378] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:23:57 2022] DELETE /identity/v3/users/b7772bff0ba74ae5a8621b9b4d17ffb9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:23:57.547221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9b628-5655-4db4-ab23-b5f506f31815 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:57.549984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e9f9b628-5655-4db4-ab23-b5f506f31815 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:57.648997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f9b628-5655-4db4-ab23-b5f506f31815 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:57.747109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a415235-0010-4d81-b9de-4df8a02052a4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d5f3ec00844cf28c01a14f8a071a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:57.747751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a415235-0010-4d81-b9de-4df8a02052a4 service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:57.748027 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a415235-0010-4d81-b9de-4df8a02052a4 service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:57.748293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a415235-0010-4d81-b9de-4df8a02052a4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:57.750474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0a415235-0010-4d81-b9de-4df8a02052a4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:57.763513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a415235-0010-4d81-b9de-4df8a02052a4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:57.765121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a415235-0010-4d81-b9de-4df8a02052a4 service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:57.777638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1187/2379] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 231 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:23:57.922348 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9151647-0081-4171-b223-862c2460518b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:57.923962 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f9151647-0081-4171-b223-862c2460518b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:58.027944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9151647-0081-4171-b223-862c2460518b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:58.033404 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7d9b4-a9ef-4a17-823d-03770060d943 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:58.034126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7d9b4-a9ef-4a17-823d-03770060d943 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:58.034414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7d9b4-a9ef-4a17-823d-03770060d943 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:58.034692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7d9b4-a9ef-4a17-823d-03770060d943 admin admin] PATH_INFO: `/v3/projects/f728b57fcc5943d29028e39a7619222f` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:58.035954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7d9b4-a9ef-4a17-823d-03770060d943 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f728b57fcc5943d29028e39a7619222f)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:58.037917 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b7d9b4-a9ef-4a17-823d-03770060d943 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:58.101377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-11b7d9b4-a9ef-4a17-823d-03770060d943 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f728b57fcc5943d29028e39a7619222f', 'request_id': 'req-11b7d9b4-a9ef-4a17-823d-03770060d943'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:58.111053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-11b7d9b4-a9ef-4a17-823d-03770060d943 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f728b57fcc5943d29028e39a7619222f', 'request_id': 'req-11b7d9b4-a9ef-4a17-823d-03770060d943'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:58.120858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-11b7d9b4-a9ef-4a17-823d-03770060d943 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f728b57fcc5943d29028e39a7619222f', 'request_id': 'req-11b7d9b4-a9ef-4a17-823d-03770060d943'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:58.122319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:58.135119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-11b7d9b4-a9ef-4a17-823d-03770060d943 admin admin] The token cache is being invalidate because project f728b57fcc5943d29028e39a7619222f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:23:58.135390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-11b7d9b4-a9ef-4a17-823d-03770060d943 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:58.136225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-11b7d9b4-a9ef-4a17-823d-03770060d943 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:23:58.138040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1193/2380] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:23:57 2022] DELETE /identity/v3/projects/f728b57fcc5943d29028e39a7619222f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:58.144708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567b299-8a80-4d85-9770-6e29964c1289 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:58.145226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567b299-8a80-4d85-9770-6e29964c1289 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:58.145226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2567b299-8a80-4d85-9770-6e29964c1289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:58.167041 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2567b299-8a80-4d85-9770-6e29964c1289 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:58.168236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2567b299-8a80-4d85-9770-6e29964c1289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:58.186798 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:58.237273 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1188/2381] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:23:58.247075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c74b6-4cba-48aa-89e1-f202c564d5cd None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:58.247341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c74b6-4cba-48aa-89e1-f202c564d5cd None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:58.247629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479c74b6-4cba-48aa-89e1-f202c564d5cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:58.270188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-479c74b6-4cba-48aa-89e1-f202c564d5cd None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:58.271768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-479c74b6-4cba-48aa-89e1-f202c564d5cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:58.282173 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1194/2382] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:58.286353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567b299-8a80-4d85-9770-6e29964c1289 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:58.298168 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2567b299-8a80-4d85-9770-6e29964c1289 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:58.306659 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39052c-9f14-4639-b70e-27d09d8188d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:58.307278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39052c-9f14-4639-b70e-27d09d8188d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:58.307554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39052c-9f14-4639-b70e-27d09d8188d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:58.309456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa39052c-9f14-4639-b70e-27d09d8188d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:58.311019 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39052c-9f14-4639-b70e-27d09d8188d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:23:58.311329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39052c-9f14-4639-b70e-27d09d8188d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:58.313275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa39052c-9f14-4639-b70e-27d09d8188d6 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:58.332169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1189/2383] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:23:58.338204 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c74b6-4cba-48aa-89e1-f202c564d5cd None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:58.350662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479c74b6-4cba-48aa-89e1-f202c564d5cd None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:58.356027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e4308-39b3-448a-9da6-130d81f5b306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:58.356697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e4308-39b3-448a-9da6-130d81f5b306 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:58.356966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e4308-39b3-448a-9da6-130d81f5b306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:58.357237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91e4308-39b3-448a-9da6-130d81f5b306 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:58.357892 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e4308-39b3-448a-9da6-130d81f5b306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:58.359791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91e4308-39b3-448a-9da6-130d81f5b306 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:58.390489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1195/2384] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:23:58 2022] POST /identity/v3/projects => generated 379 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:58.394810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39052c-9f14-4639-b70e-27d09d8188d6 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:58.416723 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa39052c-9f14-4639-b70e-27d09d8188d6 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:58.477738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b172058-ae78-4e02-8857-da165b451c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:58.478743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b172058-ae78-4e02-8857-da165b451c1b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:58.479104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b172058-ae78-4e02-8857-da165b451c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:58.479508 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b172058-ae78-4e02-8857-da165b451c1b admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:58.480591 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b172058-ae78-4e02-8857-da165b451c1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:58.483812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b172058-ae78-4e02-8857-da165b451c1b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:58.514704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1190/2385] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:23:58 2022] POST /identity/v3/users => generated 290 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:58.518987 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e4308-39b3-448a-9da6-130d81f5b306 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:58.529812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91e4308-39b3-448a-9da6-130d81f5b306 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:58.535085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04846f-99bf-4b02-af64-fde18f3733cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:58.535684 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04846f-99bf-4b02-af64-fde18f3733cc admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:58.536008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04846f-99bf-4b02-af64-fde18f3733cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:58.536294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d04846f-99bf-4b02-af64-fde18f3733cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:58.537174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04846f-99bf-4b02-af64-fde18f3733cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:58.538915 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d04846f-99bf-4b02-af64-fde18f3733cc admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:58.549323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1196/2386] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:58.553521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b172058-ae78-4e02-8857-da165b451c1b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:58.563797 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b172058-ae78-4e02-8857-da165b451c1b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:58.569138 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb13d869-e794-47b3-b92f-0aba0033616e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:58.569749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13d869-e794-47b3-b92f-0aba0033616e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:58.570057 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13d869-e794-47b3-b92f-0aba0033616e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:58.570336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb13d869-e794-47b3-b92f-0aba0033616e admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:58.570985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13d869-e794-47b3-b92f-0aba0033616e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:58.572599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb13d869-e794-47b3-b92f-0aba0033616e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:58.583995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1191/2387] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:58.588499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04846f-99bf-4b02-af64-fde18f3733cc admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:58.598844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d04846f-99bf-4b02-af64-fde18f3733cc admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:58.603848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f90df-c3d0-4d25-8b30-b8bb4df5115a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:58.604512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f90df-c3d0-4d25-8b30-b8bb4df5115a admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:58.604785 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f90df-c3d0-4d25-8b30-b8bb4df5115a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:58.605064 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97f90df-c3d0-4d25-8b30-b8bb4df5115a admin admin] PATH_INFO: `/v3/projects/f1e3e4bc6ed44e248b3eda2410badbbe/users/8405d59b087a4b79a05d55ce1492079f/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:58.621469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f90df-c3d0-4d25-8b30-b8bb4df5115a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1e3e4bc6ed44e248b3eda2410badbbe, user_id=8405d59b087a4b79a05d55ce1492079f, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:58.624132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97f90df-c3d0-4d25-8b30-b8bb4df5115a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:58.643237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1197/2388] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:23:58 2022] PUT /identity/v3/projects/f1e3e4bc6ed44e248b3eda2410badbbe/users/8405d59b087a4b79a05d55ce1492079f/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:58.659304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383f5c5-36f2-400f-9cd2-a69db8dfb507 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:58.659582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383f5c5-36f2-400f-9cd2-a69db8dfb507 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:58.659876 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2383f5c5-36f2-400f-9cd2-a69db8dfb507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:58.690046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2383f5c5-36f2-400f-9cd2-a69db8dfb507 None None] MFA Rules not processed for user `8405d59b087a4b79a05d55ce1492079f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:58.691276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2383f5c5-36f2-400f-9cd2-a69db8dfb507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:58.774016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1192/2389] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:58.775813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f90df-c3d0-4d25-8b30-b8bb4df5115a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:58.846371 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97f90df-c3d0-4d25-8b30-b8bb4df5115a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:58.851700 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a573987-7472-48a0-bdfd-ad9c8e87c69b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:58.852281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573987-7472-48a0-bdfd-ad9c8e87c69b admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:58.852557 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573987-7472-48a0-bdfd-ad9c8e87c69b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:58.853307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a573987-7472-48a0-bdfd-ad9c8e87c69b admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:58.853455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a573987-7472-48a0-bdfd-ad9c8e87c69b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:58.855407 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a573987-7472-48a0-bdfd-ad9c8e87c69b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:58.890609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1198/2390] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:23:58 2022] POST /identity/v3/projects => generated 379 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:58.896573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383f5c5-36f2-400f-9cd2-a69db8dfb507 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:58.910621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2383f5c5-36f2-400f-9cd2-a69db8dfb507 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:58.927386 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:58.989477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd920c3-6e20-4e53-bfe8-d9fa0cefe8d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:58.990386 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd920c3-6e20-4e53-bfe8-d9fa0cefe8d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:58.990724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd920c3-6e20-4e53-bfe8-d9fa0cefe8d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:58.991185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd920c3-6e20-4e53-bfe8-d9fa0cefe8d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:58.991833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd920c3-6e20-4e53-bfe8-d9fa0cefe8d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:58.993765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd920c3-6e20-4e53-bfe8-d9fa0cefe8d1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:59.031425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1193/2391] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:23:58 2022] POST /identity/v3/users => generated 290 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:59.035918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a573987-7472-48a0-bdfd-ad9c8e87c69b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:59.052067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a573987-7472-48a0-bdfd-ad9c8e87c69b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:59.058879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d96de-9888-431c-893c-c94ea987772e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:59.059810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d96de-9888-431c-893c-c94ea987772e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:59.060273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d96de-9888-431c-893c-c94ea987772e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:59.060747 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504d96de-9888-431c-893c-c94ea987772e admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:59.061609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d96de-9888-431c-893c-c94ea987772e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:59.063542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504d96de-9888-431c-893c-c94ea987772e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:59.080446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1199/2392] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:59.084594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd920c3-6e20-4e53-bfe8-d9fa0cefe8d1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:59.098537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd920c3-6e20-4e53-bfe8-d9fa0cefe8d1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:59.104484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf74d0f2-6095-4e40-809d-21abb450b8ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:59.105217 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74d0f2-6095-4e40-809d-21abb450b8ee admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:59.105561 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74d0f2-6095-4e40-809d-21abb450b8ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:59.105926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf74d0f2-6095-4e40-809d-21abb450b8ee admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:59.106697 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74d0f2-6095-4e40-809d-21abb450b8ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:59.108374 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf74d0f2-6095-4e40-809d-21abb450b8ee admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:59.128479 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1194/2393] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:23:59.129890 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d96de-9888-431c-893c-c94ea987772e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:59.145128 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504d96de-9888-431c-893c-c94ea987772e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:59.151000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ecc96-8f02-4c1f-b682-01dae2cc8c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:59.151683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ecc96-8f02-4c1f-b682-01dae2cc8c27 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:59.151959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ecc96-8f02-4c1f-b682-01dae2cc8c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:59.152231 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ecc96-8f02-4c1f-b682-01dae2cc8c27 admin admin] PATH_INFO: `/v3/projects/fe3f8a76abc94cb3b102aff2c9b62855/users/1289c8d7cfd448f88e1dd533d928aae2/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:59.172061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ecc96-8f02-4c1f-b682-01dae2cc8c27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fe3f8a76abc94cb3b102aff2c9b62855, user_id=1289c8d7cfd448f88e1dd533d928aae2, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:59.174737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8ecc96-8f02-4c1f-b682-01dae2cc8c27 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:59.204924 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1200/2394] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:23:59 2022] PUT /identity/v3/projects/fe3f8a76abc94cb3b102aff2c9b62855/users/1289c8d7cfd448f88e1dd533d928aae2/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:59.217962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bb291-d0f7-49b3-bd49-c996d65296e3 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:59.218442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bb291-d0f7-49b3-bd49-c996d65296e3 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:59.218543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2bb291-d0f7-49b3-bd49-c996d65296e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:59.248822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-af2bb291-d0f7-49b3-bd49-c996d65296e3 None None] MFA Rules not processed for user `1289c8d7cfd448f88e1dd533d928aae2`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:59.250128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-af2bb291-d0f7-49b3-bd49-c996d65296e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:59.322490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1195/2395] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:59 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:59.327456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ecc96-8f02-4c1f-b682-01dae2cc8c27 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:59.378027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:59.410670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8ecc96-8f02-4c1f-b682-01dae2cc8c27 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:59.420060 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d13260-1a1e-441a-a2e3-6aaf7af88671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:59.420773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13260-1a1e-441a-a2e3-6aaf7af88671 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:59.421107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13260-1a1e-441a-a2e3-6aaf7af88671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:59.421445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13260-1a1e-441a-a2e3-6aaf7af88671 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:59.422241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d13260-1a1e-441a-a2e3-6aaf7af88671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:59.424804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d13260-1a1e-441a-a2e3-6aaf7af88671 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:59.464292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1201/2396] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:23:59 2022] POST /identity/v3/projects => generated 379 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:59.470460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bb291-d0f7-49b3-bd49-c996d65296e3 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:59.486290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2bb291-d0f7-49b3-bd49-c996d65296e3 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:59.549032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb773ba7-a4cd-46ed-b641-066bc59db0ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:59.549584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb773ba7-a4cd-46ed-b641-066bc59db0ce admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:59.549979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb773ba7-a4cd-46ed-b641-066bc59db0ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:59.550240 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb773ba7-a4cd-46ed-b641-066bc59db0ce admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:59.550898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb773ba7-a4cd-46ed-b641-066bc59db0ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:59.552869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb773ba7-a4cd-46ed-b641-066bc59db0ce admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:59.577166 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1196/2397] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:23:59 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:23:59.581213 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d13260-1a1e-441a-a2e3-6aaf7af88671 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:59.594173 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d13260-1a1e-441a-a2e3-6aaf7af88671 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:59.600066 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82013d-a844-4c42-8450-fac6a5c7ac4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:59.600648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82013d-a844-4c42-8450-fac6a5c7ac4b admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:59.600927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82013d-a844-4c42-8450-fac6a5c7ac4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:59.601202 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82013d-a844-4c42-8450-fac6a5c7ac4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:59.601896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82013d-a844-4c42-8450-fac6a5c7ac4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:59.603581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82013d-a844-4c42-8450-fac6a5c7ac4b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:59.615180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1202/2398] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:23:59.619635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb773ba7-a4cd-46ed-b641-066bc59db0ce admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:59.631304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb773ba7-a4cd-46ed-b641-066bc59db0ce admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:59.636185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddba68-dbcd-4d7c-b6c4-bf54e60de555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:59.636854 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddba68-dbcd-4d7c-b6c4-bf54e60de555 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:59.637130 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddba68-dbcd-4d7c-b6c4-bf54e60de555 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:59.637432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ddba68-dbcd-4d7c-b6c4-bf54e60de555 admin admin] PATH_INFO: `/v3/projects/63c7c3fbc31d4c4b88fe3aebc214efc9/users/231c4ad0a7444d7e82de176e1a38db05/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:59.652062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:23:59.655766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddba68-dbcd-4d7c-b6c4-bf54e60de555 admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c7c3fbc31d4c4b88fe3aebc214efc9, user_id=231c4ad0a7444d7e82de176e1a38db05, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:59.660202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ddba68-dbcd-4d7c-b6c4-bf54e60de555 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:59.676004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1197/2399] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:23:59 2022] PUT /identity/v3/projects/63c7c3fbc31d4c4b88fe3aebc214efc9/users/231c4ad0a7444d7e82de176e1a38db05/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:59.681063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82013d-a844-4c42-8450-fac6a5c7ac4b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:59.691909 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82013d-a844-4c42-8450-fac6a5c7ac4b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:59.757404 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b78d0b-6e40-4e0b-bb32-85600ccc01a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:59.758028 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b78d0b-6e40-4e0b-bb32-85600ccc01a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:59.758319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b78d0b-6e40-4e0b-bb32-85600ccc01a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:59.758591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b78d0b-6e40-4e0b-bb32-85600ccc01a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:59.759237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b78d0b-6e40-4e0b-bb32-85600ccc01a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:59.760867 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b78d0b-6e40-4e0b-bb32-85600ccc01a1 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:59.771436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1203/2400] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:23:59 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:23:59.775996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddba68-dbcd-4d7c-b6c4-bf54e60de555 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:59.790094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ddba68-dbcd-4d7c-b6c4-bf54e60de555 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:23:59.795637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33751b3b-58de-44f5-a6b4-826042437f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:23:59.796537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33751b3b-58de-44f5-a6b4-826042437f4a admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:59.796994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33751b3b-58de-44f5-a6b4-826042437f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:59.797269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33751b3b-58de-44f5-a6b4-826042437f4a admin admin] PATH_INFO: `/v3/projects/63c7c3fbc31d4c4b88fe3aebc214efc9/users/231c4ad0a7444d7e82de176e1a38db05/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:59.799396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33751b3b-58de-44f5-a6b4-826042437f4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=63c7c3fbc31d4c4b88fe3aebc214efc9, user_id=231c4ad0a7444d7e82de176e1a38db05, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:23:59.802085 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33751b3b-58de-44f5-a6b4-826042437f4a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:23:59.813751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1198/2401] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:23:59 2022] PUT /identity/v3/projects/63c7c3fbc31d4c4b88fe3aebc214efc9/users/231c4ad0a7444d7e82de176e1a38db05/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:23:59.825968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962b9da-e6ff-47ad-9591-cdf396276426 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:23:59.826259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962b9da-e6ff-47ad-9591-cdf396276426 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:23:59.826849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962b9da-e6ff-47ad-9591-cdf396276426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:23:59.860006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e962b9da-e6ff-47ad-9591-cdf396276426 None None] MFA Rules not processed for user `231c4ad0a7444d7e82de176e1a38db05`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:23:59.862307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e962b9da-e6ff-47ad-9591-cdf396276426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:23:59.950425 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1204/2402] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:23:59 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:23:59.963094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33751b3b-58de-44f5-a6b4-826042437f4a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:23:59.964978 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-33751b3b-58de-44f5-a6b4-826042437f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:00.027926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33751b3b-58de-44f5-a6b4-826042437f4a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:00.031872 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da50fa4c-8f41-495a-b4d0-240d7c8fa83f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:00.032510 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50fa4c-8f41-495a-b4d0-240d7c8fa83f service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:00.032786 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50fa4c-8f41-495a-b4d0-240d7c8fa83f service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:00.033057 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da50fa4c-8f41-495a-b4d0-240d7c8fa83f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:00.043866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50fa4c-8f41-495a-b4d0-240d7c8fa83f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:00.045477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da50fa4c-8f41-495a-b4d0-240d7c8fa83f service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:00.062629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1199/2403] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:23:59 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:00.112018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962b9da-e6ff-47ad-9591-cdf396276426 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:00.113479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e962b9da-e6ff-47ad-9591-cdf396276426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:00.130824 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962b9da-e6ff-47ad-9591-cdf396276426 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:00.135584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34dc32-0d45-49b5-9a48-7395f7daa779 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:00.136441 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34dc32-0d45-49b5-9a48-7395f7daa779 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:00.136722 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34dc32-0d45-49b5-9a48-7395f7daa779 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:00.137091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e34dc32-0d45-49b5-9a48-7395f7daa779 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:00.173106 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:00.205279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34dc32-0d45-49b5-9a48-7395f7daa779 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:00.206763 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e34dc32-0d45-49b5-9a48-7395f7daa779 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:00.218816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1205/2404] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:24:00.418348 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5cb9c-88e6-493c-8fb9-332dae4b256a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:00.419282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5cb9c-88e6-493c-8fb9-332dae4b256a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:00.420194 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d5cb9c-88e6-493c-8fb9-332dae4b256a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:00.452462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d7d5cb9c-88e6-493c-8fb9-332dae4b256a None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:00.459159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d7d5cb9c-88e6-493c-8fb9-332dae4b256a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:00.534775 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1200/2405] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:24:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:00.566277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34dc32-0d45-49b5-9a48-7395f7daa779 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:00.569310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4e34dc32-0d45-49b5-9a48-7395f7daa779 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:00.660518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e34dc32-0d45-49b5-9a48-7395f7daa779 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:00.667089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc451b2-6a44-46c8-8e3e-c39bf6ca2acc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:00.667713 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc451b2-6a44-46c8-8e3e-c39bf6ca2acc service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:00.668059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc451b2-6a44-46c8-8e3e-c39bf6ca2acc service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:00.668251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc451b2-6a44-46c8-8e3e-c39bf6ca2acc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:00.677058 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc451b2-6a44-46c8-8e3e-c39bf6ca2acc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:00.679512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc451b2-6a44-46c8-8e3e-c39bf6ca2acc service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:00.689685 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1206/2406] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:24:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 19:24:03.465554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5cb9c-88e6-493c-8fb9-332dae4b256a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:03.551334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d5cb9c-88e6-493c-8fb9-332dae4b256a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:03.556562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:03.557222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:03.557496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:03.557903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] PATH_INFO: `/v3/users/8405d59b087a4b79a05d55ce1492079f` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:03.559059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8405d59b087a4b79a05d55ce1492079f)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:03.561023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:03.599619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:03.634505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8405d59b087a4b79a05d55ce1492079f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:03.651123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8405d59b087a4b79a05d55ce1492079f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:03.652544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8405d59b087a4b79a05d55ce1492079f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:03.653717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8405d59b087a4b79a05d55ce1492079f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:03.669212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8405d59b087a4b79a05d55ce1492079f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:03.692835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1201/2407] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:03 2022] DELETE /identity/v3/users/8405d59b087a4b79a05d55ce1492079f => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:03.697696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4e508-f3ad-4cfe-b116-9608e6287c4f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:03.698262 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4e508-f3ad-4cfe-b116-9608e6287c4f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:03.698394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba4e508-f3ad-4cfe-b116-9608e6287c4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:03.737939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-3ba4e508-f3ad-4cfe-b116-9608e6287c4f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:03.739461 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3ba4e508-f3ad-4cfe-b116-9608e6287c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:03.833571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1207/2408] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:03.846402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:03.848058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:03.942349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c212d3e-af1d-4574-88ed-26f251b1d631 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:03.952926 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcaaf6-d637-43c2-b581-124ffef6b4ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:03.953659 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcaaf6-d637-43c2-b581-124ffef6b4ea service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:03.953979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcaaf6-d637-43c2-b581-124ffef6b4ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:03.954257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fcaaf6-d637-43c2-b581-124ffef6b4ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:03.966408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcaaf6-d637-43c2-b581-124ffef6b4ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:03.967900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fcaaf6-d637-43c2-b581-124ffef6b4ea service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:03.979368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1202/2409] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:04.449841 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4e508-f3ad-4cfe-b116-9608e6287c4f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:04.451650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3ba4e508-f3ad-4cfe-b116-9608e6287c4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:04.464117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba4e508-f3ad-4cfe-b116-9608e6287c4f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:04.473951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:04.474839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:04.475189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:04.475481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] PATH_INFO: `/v3/projects/f1e3e4bc6ed44e248b3eda2410badbbe` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:04.476679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1e3e4bc6ed44e248b3eda2410badbbe)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:04.478622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:04.541279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1e3e4bc6ed44e248b3eda2410badbbe', 'request_id': 'req-93ab771f-369f-4c34-9f6d-24a0983cbffb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:04.560797 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1e3e4bc6ed44e248b3eda2410badbbe', 'request_id': 'req-93ab771f-369f-4c34-9f6d-24a0983cbffb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:04.562701 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:04.571408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1e3e4bc6ed44e248b3eda2410badbbe', 'request_id': 'req-93ab771f-369f-4c34-9f6d-24a0983cbffb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:04.583185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] The token cache is being invalidate because project f1e3e4bc6ed44e248b3eda2410badbbe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:04.583530 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:04.584187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:04.585839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1208/2410] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:04 2022] DELETE /identity/v3/projects/f1e3e4bc6ed44e248b3eda2410badbbe => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:04.590257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcaaf6-d637-43c2-b581-124ffef6b4ea service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:04.600607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fcaaf6-d637-43c2-b581-124ffef6b4ea service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:04.659373 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:04.660018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:04.660293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:04.660563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] PATH_INFO: `/v3/users/1289c8d7cfd448f88e1dd533d928aae2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:04.662004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1289c8d7cfd448f88e1dd533d928aae2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:04.664133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:04.750925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1289c8d7cfd448f88e1dd533d928aae2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:04.754126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:04.762257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1289c8d7cfd448f88e1dd533d928aae2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:04.762893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1289c8d7cfd448f88e1dd533d928aae2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:04.763635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1289c8d7cfd448f88e1dd533d928aae2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:04.773306 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1289c8d7cfd448f88e1dd533d928aae2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:04.810669 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1203/2411] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:04 2022] DELETE /identity/v3/users/1289c8d7cfd448f88e1dd533d928aae2 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:05.139121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:05.141972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:05.174432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ab771f-369f-4c34-9f6d-24a0983cbffb admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:05.245079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:05.245639 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:05.245959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:05.246234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] PATH_INFO: `/v3/projects/fe3f8a76abc94cb3b102aff2c9b62855` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:05.247383 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fe3f8a76abc94cb3b102aff2c9b62855)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:05.249299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:05.323868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fe3f8a76abc94cb3b102aff2c9b62855', 'request_id': 'req-f0caae71-19fb-4fa6-a928-48556a4fdb75'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:05.333758 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fe3f8a76abc94cb3b102aff2c9b62855', 'request_id': 'req-f0caae71-19fb-4fa6-a928-48556a4fdb75'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:05.346536 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fe3f8a76abc94cb3b102aff2c9b62855', 'request_id': 'req-f0caae71-19fb-4fa6-a928-48556a4fdb75'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:05.363250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] The token cache is being invalidate because project fe3f8a76abc94cb3b102aff2c9b62855 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:05.363720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:05.364265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:05.366766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1209/2412] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:05 2022] DELETE /identity/v3/projects/fe3f8a76abc94cb3b102aff2c9b62855 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:05.371017 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:05.372647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:05.386212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a8bde-546d-4a38-8ac4-a427f31ab909 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:05.467725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a852d879-8e9c-4d69-83b2-323659b76c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:05.469170 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852d879-8e9c-4d69-83b2-323659b76c14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:05.469416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852d879-8e9c-4d69-83b2-323659b76c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:05.469671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a852d879-8e9c-4d69-83b2-323659b76c14 admin admin] PATH_INFO: `/v3/users/231c4ad0a7444d7e82de176e1a38db05` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:05.471006 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852d879-8e9c-4d69-83b2-323659b76c14 admin admin] RBAC: Authorizing `identity:delete_user(user_id=231c4ad0a7444d7e82de176e1a38db05)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:05.472979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a852d879-8e9c-4d69-83b2-323659b76c14 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:05.553063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a852d879-8e9c-4d69-83b2-323659b76c14 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '231c4ad0a7444d7e82de176e1a38db05'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:05.574622 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a852d879-8e9c-4d69-83b2-323659b76c14 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '231c4ad0a7444d7e82de176e1a38db05'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:05.576187 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a852d879-8e9c-4d69-83b2-323659b76c14 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '231c4ad0a7444d7e82de176e1a38db05'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:05.576487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a852d879-8e9c-4d69-83b2-323659b76c14 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '231c4ad0a7444d7e82de176e1a38db05'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:05.586160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a852d879-8e9c-4d69-83b2-323659b76c14 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '231c4ad0a7444d7e82de176e1a38db05'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:05.606320 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1204/2413] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:05 2022] DELETE /identity/v3/users/231c4ad0a7444d7e82de176e1a38db05 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:05.999251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:06.000859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:06.028504 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0caae71-19fb-4fa6-a928-48556a4fdb75 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:06.098113 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c69601-08af-434f-baaa-aecbfa68e117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:06.098644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c69601-08af-434f-baaa-aecbfa68e117 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:06.098955 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c69601-08af-434f-baaa-aecbfa68e117 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:06.099278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c69601-08af-434f-baaa-aecbfa68e117 admin admin] PATH_INFO: `/v3/projects/63c7c3fbc31d4c4b88fe3aebc214efc9` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:06.100448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c69601-08af-434f-baaa-aecbfa68e117 admin admin] RBAC: Authorizing `identity:delete_project(project_id=63c7c3fbc31d4c4b88fe3aebc214efc9)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:06.102455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c69601-08af-434f-baaa-aecbfa68e117 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:06.124259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:06.176800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d7c69601-08af-434f-baaa-aecbfa68e117 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '63c7c3fbc31d4c4b88fe3aebc214efc9', 'request_id': 'req-d7c69601-08af-434f-baaa-aecbfa68e117'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:06.184307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d7c69601-08af-434f-baaa-aecbfa68e117 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '63c7c3fbc31d4c4b88fe3aebc214efc9', 'request_id': 'req-d7c69601-08af-434f-baaa-aecbfa68e117'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:06.197763 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d7c69601-08af-434f-baaa-aecbfa68e117 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '63c7c3fbc31d4c4b88fe3aebc214efc9', 'request_id': 'req-d7c69601-08af-434f-baaa-aecbfa68e117'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:06.215113 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d7c69601-08af-434f-baaa-aecbfa68e117 admin admin] The token cache is being invalidate because project 63c7c3fbc31d4c4b88fe3aebc214efc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:06.215370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d7c69601-08af-434f-baaa-aecbfa68e117 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:06.216126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d7c69601-08af-434f-baaa-aecbfa68e117 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:06.217558 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1210/2414] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:05 2022] DELETE /identity/v3/projects/63c7c3fbc31d4c4b88fe3aebc214efc9 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:06.225904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f893b-aaeb-47cf-921b-e6ab212a7462 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:06.225904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f893b-aaeb-47cf-921b-e6ab212a7462 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:06.225904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481f893b-aaeb-47cf-921b-e6ab212a7462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:06.247177 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-481f893b-aaeb-47cf-921b-e6ab212a7462 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:06.248606 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-481f893b-aaeb-47cf-921b-e6ab212a7462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:06.302345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:06.326976 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1205/2415] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:06.340484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11e8bc-200a-4129-9cb3-c9762df1e308 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:06.340756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11e8bc-200a-4129-9cb3-c9762df1e308 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:06.341481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e11e8bc-200a-4129-9cb3-c9762df1e308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:06.371541 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1e11e8bc-200a-4129-9cb3-c9762df1e308 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:06.372770 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1e11e8bc-200a-4129-9cb3-c9762df1e308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:06.381875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1211/2416] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:06.387172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f893b-aaeb-47cf-921b-e6ab212a7462 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:06.398204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481f893b-aaeb-47cf-921b-e6ab212a7462 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:06.409370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5aa1ed-5155-42e7-a0b1-2797b8fe2908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:06.410044 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aa1ed-5155-42e7-a0b1-2797b8fe2908 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:06.410315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aa1ed-5155-42e7-a0b1-2797b8fe2908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:06.410579 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5aa1ed-5155-42e7-a0b1-2797b8fe2908 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:06.411330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aa1ed-5155-42e7-a0b1-2797b8fe2908 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:24:06.411550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aa1ed-5155-42e7-a0b1-2797b8fe2908 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:06.413266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5aa1ed-5155-42e7-a0b1-2797b8fe2908 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:06.431484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1206/2417] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:24:06.439457 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11e8bc-200a-4129-9cb3-c9762df1e308 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:06.460008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e11e8bc-200a-4129-9cb3-c9762df1e308 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:06.470246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736efb47-04b9-47c7-9ee3-e3825c2284bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:06.471780 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736efb47-04b9-47c7-9ee3-e3825c2284bd admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:06.472540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736efb47-04b9-47c7-9ee3-e3825c2284bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:06.473274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736efb47-04b9-47c7-9ee3-e3825c2284bd admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:06.474990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736efb47-04b9-47c7-9ee3-e3825c2284bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:06.479286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-736efb47-04b9-47c7-9ee3-e3825c2284bd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:06.537609 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1212/2418] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:06 2022] POST /identity/v3/projects => generated 365 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:06.542354 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5aa1ed-5155-42e7-a0b1-2797b8fe2908 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:06.552964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5aa1ed-5155-42e7-a0b1-2797b8fe2908 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:06.625178 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc695e-3b3a-48dc-9310-8e67eb06d8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:06.627831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc695e-3b3a-48dc-9310-8e67eb06d8cf admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:06.627831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc695e-3b3a-48dc-9310-8e67eb06d8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:06.627831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc695e-3b3a-48dc-9310-8e67eb06d8cf admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:06.627831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc695e-3b3a-48dc-9310-8e67eb06d8cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:06.629810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc695e-3b3a-48dc-9310-8e67eb06d8cf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:06.673967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1207/2419] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:06 2022] POST /identity/v3/users => generated 283 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:06.678180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736efb47-04b9-47c7-9ee3-e3825c2284bd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:06.689486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-736efb47-04b9-47c7-9ee3-e3825c2284bd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:06.694686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078f741-cd5f-42ee-a12d-80fc93d95f89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:06.695313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078f741-cd5f-42ee-a12d-80fc93d95f89 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:06.695596 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078f741-cd5f-42ee-a12d-80fc93d95f89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:06.695865 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078f741-cd5f-42ee-a12d-80fc93d95f89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:06.696542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078f741-cd5f-42ee-a12d-80fc93d95f89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:06.698313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078f741-cd5f-42ee-a12d-80fc93d95f89 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:06.716316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1213/2420] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:06.720318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc695e-3b3a-48dc-9310-8e67eb06d8cf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:06.732547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc695e-3b3a-48dc-9310-8e67eb06d8cf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:06.739556 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0321151d-6b58-4ee7-a940-107536fafa24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:06.740893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321151d-6b58-4ee7-a940-107536fafa24 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:06.741149 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321151d-6b58-4ee7-a940-107536fafa24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:06.742526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0321151d-6b58-4ee7-a940-107536fafa24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:06.744014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321151d-6b58-4ee7-a940-107536fafa24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:06.747236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0321151d-6b58-4ee7-a940-107536fafa24 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:06.769862 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1208/2421] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:06 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:06.774932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078f741-cd5f-42ee-a12d-80fc93d95f89 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:06.787948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078f741-cd5f-42ee-a12d-80fc93d95f89 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:06.794716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552b470-ae80-4953-b511-761027f0b2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:06.795585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b470-ae80-4953-b511-761027f0b2be admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:06.796112 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b470-ae80-4953-b511-761027f0b2be admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:06.796532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0552b470-ae80-4953-b511-761027f0b2be admin admin] PATH_INFO: `/v3/projects/cfcb7e7131584b948547d0a552ae125d/users/d95d33f04b994b889ef52359ec02d6b4/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:06.817874 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552b470-ae80-4953-b511-761027f0b2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfcb7e7131584b948547d0a552ae125d, user_id=d95d33f04b994b889ef52359ec02d6b4, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:06.820916 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0552b470-ae80-4953-b511-761027f0b2be admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:06.841180 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1214/2422] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:06 2022] PUT /identity/v3/projects/cfcb7e7131584b948547d0a552ae125d/users/d95d33f04b994b889ef52359ec02d6b4/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:06.854594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91c4cd-2988-491d-ae4e-1f760ed7df18 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:06.854881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91c4cd-2988-491d-ae4e-1f760ed7df18 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:06.855153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df91c4cd-2988-491d-ae4e-1f760ed7df18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:06.886325 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-df91c4cd-2988-491d-ae4e-1f760ed7df18 None None] MFA Rules not processed for user `d95d33f04b994b889ef52359ec02d6b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:06.888122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-df91c4cd-2988-491d-ae4e-1f760ed7df18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:06.965503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1209/2423] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:06 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:06.971088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552b470-ae80-4953-b511-761027f0b2be admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:07.049422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0552b470-ae80-4953-b511-761027f0b2be admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:07.055901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08548f06-b0d9-457b-b9d2-b59bbb9a13aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:07.056786 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548f06-b0d9-457b-b9d2-b59bbb9a13aa admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:07.057078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548f06-b0d9-457b-b9d2-b59bbb9a13aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:07.057531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08548f06-b0d9-457b-b9d2-b59bbb9a13aa admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:07.058228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08548f06-b0d9-457b-b9d2-b59bbb9a13aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:07.060514 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08548f06-b0d9-457b-b9d2-b59bbb9a13aa admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:07.098113 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1215/2424] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:06 2022] POST /identity/v3/projects => generated 365 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:07.103214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91c4cd-2988-491d-ae4e-1f760ed7df18 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:07.118604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df91c4cd-2988-491d-ae4e-1f760ed7df18 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:07.175334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:07.214372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28b6d0-f44b-4ddc-81e7-e8c675ff884c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:07.215253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28b6d0-f44b-4ddc-81e7-e8c675ff884c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:07.215408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28b6d0-f44b-4ddc-81e7-e8c675ff884c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:07.215603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28b6d0-f44b-4ddc-81e7-e8c675ff884c admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:07.216425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28b6d0-f44b-4ddc-81e7-e8c675ff884c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:07.218800 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28b6d0-f44b-4ddc-81e7-e8c675ff884c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:07.247259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1210/2425] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:07 2022] POST /identity/v3/users => generated 289 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:07.251273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08548f06-b0d9-457b-b9d2-b59bbb9a13aa admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:07.264364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08548f06-b0d9-457b-b9d2-b59bbb9a13aa admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:07.269805 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e8e36-c40f-463b-ae61-47fb0abde7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:07.270458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8e36-c40f-463b-ae61-47fb0abde7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:07.270762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8e36-c40f-463b-ae61-47fb0abde7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:07.271038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77e8e36-c40f-463b-ae61-47fb0abde7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:07.272162 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e8e36-c40f-463b-ae61-47fb0abde7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:07.273363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77e8e36-c40f-463b-ae61-47fb0abde7c8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:07.285137 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1216/2426] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:07.291175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28b6d0-f44b-4ddc-81e7-e8c675ff884c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:07.304250 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28b6d0-f44b-4ddc-81e7-e8c675ff884c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:07.309932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c40c7-2013-4fa4-828d-d6ecb3abad03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:07.310757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c40c7-2013-4fa4-828d-d6ecb3abad03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:07.311125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c40c7-2013-4fa4-828d-d6ecb3abad03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:07.311504 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7c40c7-2013-4fa4-828d-d6ecb3abad03 admin admin] PATH_INFO: `/v3/projects/634b1f289487420a81798aa31be7ca15/users/d35c2a326b194901a741e127b4c18872/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:07.328933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c40c7-2013-4fa4-828d-d6ecb3abad03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634b1f289487420a81798aa31be7ca15, user_id=d35c2a326b194901a741e127b4c18872, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:07.332061 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7c40c7-2013-4fa4-828d-d6ecb3abad03 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:07.350874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1211/2427] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:07 2022] PUT /identity/v3/projects/634b1f289487420a81798aa31be7ca15/users/d35c2a326b194901a741e127b4c18872/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:07.360984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e8e36-c40f-463b-ae61-47fb0abde7c8 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:07.373345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77e8e36-c40f-463b-ae61-47fb0abde7c8 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:07.383459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:07.441343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9939b9-5753-4e86-a1cf-fbc75999bbf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:07.441979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9939b9-5753-4e86-a1cf-fbc75999bbf9 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:07.442259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9939b9-5753-4e86-a1cf-fbc75999bbf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:07.442526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9939b9-5753-4e86-a1cf-fbc75999bbf9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:07.443243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9939b9-5753-4e86-a1cf-fbc75999bbf9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:07.444861 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9939b9-5753-4e86-a1cf-fbc75999bbf9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:07.454862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1217/2428] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:07.459928 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c40c7-2013-4fa4-828d-d6ecb3abad03 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:07.470572 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7c40c7-2013-4fa4-828d-d6ecb3abad03 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:07.480730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8724c3-4a9f-47ae-8ea4-624dce667584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:07.481425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8724c3-4a9f-47ae-8ea4-624dce667584 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:07.481936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8724c3-4a9f-47ae-8ea4-624dce667584 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:07.482214 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8724c3-4a9f-47ae-8ea4-624dce667584 admin admin] PATH_INFO: `/v3/projects/634b1f289487420a81798aa31be7ca15/users/d35c2a326b194901a741e127b4c18872/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:07.484703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8724c3-4a9f-47ae-8ea4-624dce667584 admin admin] RBAC: Authorizing `identity:create_grant(project_id=634b1f289487420a81798aa31be7ca15, user_id=d35c2a326b194901a741e127b4c18872, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:07.488628 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8724c3-4a9f-47ae-8ea4-624dce667584 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:07.506036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1212/2429] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:07 2022] PUT /identity/v3/projects/634b1f289487420a81798aa31be7ca15/users/d35c2a326b194901a741e127b4c18872/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:07.580975 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352382b7-8023-4ae4-b26c-6606497e25d5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:07.581274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352382b7-8023-4ae4-b26c-6606497e25d5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:07.581544 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352382b7-8023-4ae4-b26c-6606497e25d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:07.618472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-352382b7-8023-4ae4-b26c-6606497e25d5 None None] MFA Rules not processed for user `d35c2a326b194901a741e127b4c18872`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:07.619764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-352382b7-8023-4ae4-b26c-6606497e25d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:07.704932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1218/2430] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:07 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:07.718036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8724c3-4a9f-47ae-8ea4-624dce667584 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:07.719963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fa8724c3-4a9f-47ae-8ea4-624dce667584 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:07.786532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8724c3-4a9f-47ae-8ea4-624dce667584 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:07.790750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6482b7-a1ad-46fb-ab03-cc9adbfdbede service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:07.791349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6482b7-a1ad-46fb-ab03-cc9adbfdbede service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:07.791627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6482b7-a1ad-46fb-ab03-cc9adbfdbede service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:07.791899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6482b7-a1ad-46fb-ab03-cc9adbfdbede service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:07.801805 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6482b7-a1ad-46fb-ab03-cc9adbfdbede service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:07.804505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6482b7-a1ad-46fb-ab03-cc9adbfdbede service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:07.816735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1213/2431] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:07 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:07.921610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352382b7-8023-4ae4-b26c-6606497e25d5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:07.946889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352382b7-8023-4ae4-b26c-6606497e25d5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:07.953759 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a52a40d-3613-4f50-ba14-b177b7974c1d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:07.954654 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52a40d-3613-4f50-ba14-b177b7974c1d service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:07.954996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52a40d-3613-4f50-ba14-b177b7974c1d service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:07.955209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a52a40d-3613-4f50-ba14-b177b7974c1d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:08.072714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52a40d-3613-4f50-ba14-b177b7974c1d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:08.074202 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a52a40d-3613-4f50-ba14-b177b7974c1d service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:08.098948 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1219/2432] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:07 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:13.096980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6482b7-a1ad-46fb-ab03-cc9adbfdbede service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:13.165344 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6482b7-a1ad-46fb-ab03-cc9adbfdbede service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:13.170560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:13.171227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:13.171499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:13.171773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] PATH_INFO: `/v3/users/d95d33f04b994b889ef52359ec02d6b4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:13.172940 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95d33f04b994b889ef52359ec02d6b4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:13.174922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:13.226700 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:13.237244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95d33f04b994b889ef52359ec02d6b4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:13.248614 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95d33f04b994b889ef52359ec02d6b4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:13.250088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95d33f04b994b889ef52359ec02d6b4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:13.250818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95d33f04b994b889ef52359ec02d6b4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:13.261140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95d33f04b994b889ef52359ec02d6b4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:13.282968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1214/2433] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:13 2022] DELETE /identity/v3/users/d95d33f04b994b889ef52359ec02d6b4 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:13.287742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2a49f-bb46-4f36-8a5b-946102310a4f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:13.288611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2a49f-bb46-4f36-8a5b-946102310a4f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:13.288611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2a49f-bb46-4f36-8a5b-946102310a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:13.311891 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0be2a49f-bb46-4f36-8a5b-946102310a4f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:13.313093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0be2a49f-bb46-4f36-8a5b-946102310a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:13.344106 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:13.374390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1220/2434] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:13.384281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:13.386003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:13.449421 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4c183-0df7-4a53-b319-3a0edd3c69fc admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:13.454404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8286d8-de59-4b13-b920-58040fc04e11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:13.455024 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8286d8-de59-4b13-b920-58040fc04e11 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:13.455296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8286d8-de59-4b13-b920-58040fc04e11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:13.455559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8286d8-de59-4b13-b920-58040fc04e11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:13.466146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8286d8-de59-4b13-b920-58040fc04e11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:13.467563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f8286d8-de59-4b13-b920-58040fc04e11 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:13.477600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1215/2435] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:13.929364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2a49f-bb46-4f36-8a5b-946102310a4f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:13.931254 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0be2a49f-bb46-4f36-8a5b-946102310a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:13.944310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2a49f-bb46-4f36-8a5b-946102310a4f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:13.949163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:13.949864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:13.950148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:13.950422 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] PATH_INFO: `/v3/projects/cfcb7e7131584b948547d0a552ae125d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:13.951633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfcb7e7131584b948547d0a552ae125d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:13.953544 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:14.016810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfcb7e7131584b948547d0a552ae125d', 'request_id': 'req-defee94b-7c59-416b-b4c6-8fbe75c40200'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.026819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfcb7e7131584b948547d0a552ae125d', 'request_id': 'req-defee94b-7c59-416b-b4c6-8fbe75c40200'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.038203 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfcb7e7131584b948547d0a552ae125d', 'request_id': 'req-defee94b-7c59-416b-b4c6-8fbe75c40200'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.054730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] The token cache is being invalidate because project cfcb7e7131584b948547d0a552ae125d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:14.055103 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.056068 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.061580 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1221/2436] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:13 2022] DELETE /identity/v3/projects/cfcb7e7131584b948547d0a552ae125d => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:14.063086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8286d8-de59-4b13-b920-58040fc04e11 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:14.076558 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8286d8-de59-4b13-b920-58040fc04e11 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:14.156064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1379252c-376c-4e36-aa4b-597dd59bb5bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:14.156744 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379252c-376c-4e36-aa4b-597dd59bb5bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:14.157003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379252c-376c-4e36-aa4b-597dd59bb5bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:14.157480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1379252c-376c-4e36-aa4b-597dd59bb5bd admin admin] PATH_INFO: `/v3/users/d35c2a326b194901a741e127b4c18872` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:14.158849 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379252c-376c-4e36-aa4b-597dd59bb5bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=d35c2a326b194901a741e127b4c18872)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:14.160827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1379252c-376c-4e36-aa4b-597dd59bb5bd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:14.215672 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1379252c-376c-4e36-aa4b-597dd59bb5bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd35c2a326b194901a741e127b4c18872'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.225353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1379252c-376c-4e36-aa4b-597dd59bb5bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd35c2a326b194901a741e127b4c18872'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.226153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1379252c-376c-4e36-aa4b-597dd59bb5bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd35c2a326b194901a741e127b4c18872'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.226997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1379252c-376c-4e36-aa4b-597dd59bb5bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd35c2a326b194901a741e127b4c18872'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.233202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:14.235761 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-1379252c-376c-4e36-aa4b-597dd59bb5bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd35c2a326b194901a741e127b4c18872'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.257840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1216/2437] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:14 2022] DELETE /identity/v3/users/d35c2a326b194901a741e127b4c18872 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:14.567604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:14.569696 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:14.583199 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defee94b-7c59-416b-b4c6-8fbe75c40200 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:14.652933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2951740a-b3f7-44f5-a86d-76046beb89cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:14.653679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951740a-b3f7-44f5-a86d-76046beb89cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:14.654088 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951740a-b3f7-44f5-a86d-76046beb89cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:14.654444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2951740a-b3f7-44f5-a86d-76046beb89cc admin admin] PATH_INFO: `/v3/projects/634b1f289487420a81798aa31be7ca15` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:14.655744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951740a-b3f7-44f5-a86d-76046beb89cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=634b1f289487420a81798aa31be7ca15)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:14.657946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2951740a-b3f7-44f5-a86d-76046beb89cc admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:14.716433 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2951740a-b3f7-44f5-a86d-76046beb89cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '634b1f289487420a81798aa31be7ca15', 'request_id': 'req-2951740a-b3f7-44f5-a86d-76046beb89cc'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.724388 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2951740a-b3f7-44f5-a86d-76046beb89cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '634b1f289487420a81798aa31be7ca15', 'request_id': 'req-2951740a-b3f7-44f5-a86d-76046beb89cc'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.730421 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:14.735803 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2951740a-b3f7-44f5-a86d-76046beb89cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '634b1f289487420a81798aa31be7ca15', 'request_id': 'req-2951740a-b3f7-44f5-a86d-76046beb89cc'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.750012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2951740a-b3f7-44f5-a86d-76046beb89cc admin admin] The token cache is being invalidate because project 634b1f289487420a81798aa31be7ca15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:14.750961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2951740a-b3f7-44f5-a86d-76046beb89cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.751463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2951740a-b3f7-44f5-a86d-76046beb89cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:14.757028 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1222/2438] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:14 2022] DELETE /identity/v3/projects/634b1f289487420a81798aa31be7ca15 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:14.759080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceae80-10fe-432f-8469-ca564b08936d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:14.759367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceae80-10fe-432f-8469-ca564b08936d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:14.759642 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cceae80-10fe-432f-8469-ca564b08936d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:14.783484 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5cceae80-10fe-432f-8469-ca564b08936d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:14.784967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5cceae80-10fe-432f-8469-ca564b08936d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:14.890387 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1217/2439] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:14.897191 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a9a36-ba3c-47c1-a836-9b8965f8d9f5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:14.897593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a9a36-ba3c-47c1-a836-9b8965f8d9f5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:14.897996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8a9a36-ba3c-47c1-a836-9b8965f8d9f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:14.921013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-3f8a9a36-ba3c-47c1-a836-9b8965f8d9f5 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:14.926054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3f8a9a36-ba3c-47c1-a836-9b8965f8d9f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:14.934757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1223/2440] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:14.939158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceae80-10fe-432f-8469-ca564b08936d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:14.950147 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cceae80-10fe-432f-8469-ca564b08936d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:14.955792 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68054e10-4a8a-4b6a-8da1-50d1264ad36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:14.956403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68054e10-4a8a-4b6a-8da1-50d1264ad36e admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:14.956678 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68054e10-4a8a-4b6a-8da1-50d1264ad36e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:14.957275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68054e10-4a8a-4b6a-8da1-50d1264ad36e admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:14.958278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68054e10-4a8a-4b6a-8da1-50d1264ad36e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:24:14.958602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68054e10-4a8a-4b6a-8da1-50d1264ad36e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:14.961724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68054e10-4a8a-4b6a-8da1-50d1264ad36e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:14.977850 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1218/2441] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:24:14.979370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a9a36-ba3c-47c1-a836-9b8965f8d9f5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:14.988754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8a9a36-ba3c-47c1-a836-9b8965f8d9f5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:14.993674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddfabe-f52d-454c-bec5-59f2d36be8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:14.994484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddfabe-f52d-454c-bec5-59f2d36be8f4 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:14.994766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddfabe-f52d-454c-bec5-59f2d36be8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:14.995032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eddfabe-f52d-454c-bec5-59f2d36be8f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:14.995675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddfabe-f52d-454c-bec5-59f2d36be8f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:14.997572 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eddfabe-f52d-454c-bec5-59f2d36be8f4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:15.031824 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1224/2442] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:14 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:15.032972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68054e10-4a8a-4b6a-8da1-50d1264ad36e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:15.044184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68054e10-4a8a-4b6a-8da1-50d1264ad36e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:15.108604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83bda4-eb5d-4658-b390-3abeabc62083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:15.109320 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bda4-eb5d-4658-b390-3abeabc62083 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:15.109664 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bda4-eb5d-4658-b390-3abeabc62083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:15.110036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b83bda4-eb5d-4658-b390-3abeabc62083 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:15.110737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83bda4-eb5d-4658-b390-3abeabc62083 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:15.112731 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b83bda4-eb5d-4658-b390-3abeabc62083 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:15.163948 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1219/2443] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:15 2022] POST /identity/v3/users => generated 291 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:15.168276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddfabe-f52d-454c-bec5-59f2d36be8f4 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:15.184965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eddfabe-f52d-454c-bec5-59f2d36be8f4 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:15.203009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1ed4d-f257-41d2-bf21-df7e46565165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:15.204108 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1ed4d-f257-41d2-bf21-df7e46565165 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:15.204549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1ed4d-f257-41d2-bf21-df7e46565165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:15.204967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc1ed4d-f257-41d2-bf21-df7e46565165 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:15.205767 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1ed4d-f257-41d2-bf21-df7e46565165 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:15.207750 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc1ed4d-f257-41d2-bf21-df7e46565165 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:15.220177 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1225/2444] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:15.224370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83bda4-eb5d-4658-b390-3abeabc62083 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:15.234711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b83bda4-eb5d-4658-b390-3abeabc62083 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:15.239436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dff1de1-80f8-4046-98a8-1fb7a734a17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:15.240239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1de1-80f8-4046-98a8-1fb7a734a17d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:15.240592 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1de1-80f8-4046-98a8-1fb7a734a17d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:15.240865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dff1de1-80f8-4046-98a8-1fb7a734a17d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:15.241530 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff1de1-80f8-4046-98a8-1fb7a734a17d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:15.243151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dff1de1-80f8-4046-98a8-1fb7a734a17d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:15.258965 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1220/2445] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:15.263297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1ed4d-f257-41d2-bf21-df7e46565165 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:15.275567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc1ed4d-f257-41d2-bf21-df7e46565165 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:15.281460 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8cd90-b142-4270-8670-ae4d6c5db932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:15.283196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8cd90-b142-4270-8670-ae4d6c5db932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:15.283196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8cd90-b142-4270-8670-ae4d6c5db932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:15.283196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b8cd90-b142-4270-8670-ae4d6c5db932 admin admin] PATH_INFO: `/v3/projects/0eb0e52f46ff47e7ab6c715357db8685/users/d1dee102ebab453384947a3d032b89ca/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:15.304432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8cd90-b142-4270-8670-ae4d6c5db932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eb0e52f46ff47e7ab6c715357db8685, user_id=d1dee102ebab453384947a3d032b89ca, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:15.307447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b8cd90-b142-4270-8670-ae4d6c5db932 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:15.322751 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1226/2446] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:15 2022] PUT /identity/v3/projects/0eb0e52f46ff47e7ab6c715357db8685/users/d1dee102ebab453384947a3d032b89ca/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:15.335254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0581d85-f0bd-4d1c-9286-f9086f64134a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:15.335468 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0581d85-f0bd-4d1c-9286-f9086f64134a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:15.335737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0581d85-f0bd-4d1c-9286-f9086f64134a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:15.366785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a0581d85-f0bd-4d1c-9286-f9086f64134a None None] MFA Rules not processed for user `d1dee102ebab453384947a3d032b89ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:15.368372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a0581d85-f0bd-4d1c-9286-f9086f64134a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:15.404558 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:15.447023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1221/2447] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:15 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:15.451848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8cd90-b142-4270-8670-ae4d6c5db932 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:15.531084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b8cd90-b142-4270-8670-ae4d6c5db932 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:15.537633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276c255-f0e6-426e-8e12-8789d73eec37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:15.538885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276c255-f0e6-426e-8e12-8789d73eec37 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:15.538885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276c255-f0e6-426e-8e12-8789d73eec37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:15.538885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2276c255-f0e6-426e-8e12-8789d73eec37 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:15.539457 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276c255-f0e6-426e-8e12-8789d73eec37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:15.541403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2276c255-f0e6-426e-8e12-8789d73eec37 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:15.584096 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1227/2448] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:15 2022] POST /identity/v3/projects => generated 383 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:15.586245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0581d85-f0bd-4d1c-9286-f9086f64134a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:15.600497 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0581d85-f0bd-4d1c-9286-f9086f64134a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:15.703412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1e853-c447-4048-9f40-ad335751ac65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:15.703942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1e853-c447-4048-9f40-ad335751ac65 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:15.704219 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1e853-c447-4048-9f40-ad335751ac65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:15.704488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df1e853-c447-4048-9f40-ad335751ac65 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:15.705165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1e853-c447-4048-9f40-ad335751ac65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:15.707539 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df1e853-c447-4048-9f40-ad335751ac65 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:15.746360 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1222/2449] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:15 2022] POST /identity/v3/users => generated 298 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:15.747623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276c255-f0e6-426e-8e12-8789d73eec37 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:15.759831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2276c255-f0e6-426e-8e12-8789d73eec37 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:15.764577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06181e92-ca2f-43d0-be8b-9121401f6b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:15.765196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181e92-ca2f-43d0-be8b-9121401f6b65 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:15.765476 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181e92-ca2f-43d0-be8b-9121401f6b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:15.765746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06181e92-ca2f-43d0-be8b-9121401f6b65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:15.766464 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06181e92-ca2f-43d0-be8b-9121401f6b65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:15.768085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06181e92-ca2f-43d0-be8b-9121401f6b65 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:15.782076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1228/2450] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:15.788158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1e853-c447-4048-9f40-ad335751ac65 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:15.800063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df1e853-c447-4048-9f40-ad335751ac65 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:15.805934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de079d4-29a7-49bc-a227-79c69898ccd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:15.806610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de079d4-29a7-49bc-a227-79c69898ccd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:15.806889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de079d4-29a7-49bc-a227-79c69898ccd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:15.807161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de079d4-29a7-49bc-a227-79c69898ccd1 admin admin] PATH_INFO: `/v3/projects/82c8b0ca229547be8741c2ca28ba6da7/users/8deca180baf84af38a8180b48c686977/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:15.824982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de079d4-29a7-49bc-a227-79c69898ccd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c8b0ca229547be8741c2ca28ba6da7, user_id=8deca180baf84af38a8180b48c686977, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:15.827668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de079d4-29a7-49bc-a227-79c69898ccd1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:15.844009 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1223/2451] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:15 2022] PUT /identity/v3/projects/82c8b0ca229547be8741c2ca28ba6da7/users/8deca180baf84af38a8180b48c686977/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:15.848086 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06181e92-ca2f-43d0-be8b-9121401f6b65 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:15.859268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06181e92-ca2f-43d0-be8b-9121401f6b65 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:15.914283 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:15.921030 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6e8632-b259-4318-aae6-1f47c2bfedbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:15.921654 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e8632-b259-4318-aae6-1f47c2bfedbe admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:15.921958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e8632-b259-4318-aae6-1f47c2bfedbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:15.922221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6e8632-b259-4318-aae6-1f47c2bfedbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:15.922893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e8632-b259-4318-aae6-1f47c2bfedbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:15.925264 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6e8632-b259-4318-aae6-1f47c2bfedbe admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:15.935620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1229/2452] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:15 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:15.940198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de079d4-29a7-49bc-a227-79c69898ccd1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:15.951829 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de079d4-29a7-49bc-a227-79c69898ccd1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:15.956711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce37239-4693-45a1-8ea0-3c4ddb4a5ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:15.957640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce37239-4693-45a1-8ea0-3c4ddb4a5ec9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:15.958046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce37239-4693-45a1-8ea0-3c4ddb4a5ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:15.959092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce37239-4693-45a1-8ea0-3c4ddb4a5ec9 admin admin] PATH_INFO: `/v3/projects/82c8b0ca229547be8741c2ca28ba6da7/users/8deca180baf84af38a8180b48c686977/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:15.961111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce37239-4693-45a1-8ea0-3c4ddb4a5ec9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82c8b0ca229547be8741c2ca28ba6da7, user_id=8deca180baf84af38a8180b48c686977, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:15.963748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce37239-4693-45a1-8ea0-3c4ddb4a5ec9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:15.975111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1224/2453] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:15 2022] PUT /identity/v3/projects/82c8b0ca229547be8741c2ca28ba6da7/users/8deca180baf84af38a8180b48c686977/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:15.985949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b14cfa-9be6-495f-9349-5d966b29dafe None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:15.986242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b14cfa-9be6-495f-9349-5d966b29dafe None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:15.986519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b14cfa-9be6-495f-9349-5d966b29dafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:16.018222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d2b14cfa-9be6-495f-9349-5d966b29dafe None None] MFA Rules not processed for user `8deca180baf84af38a8180b48c686977`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:16.019453 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d2b14cfa-9be6-495f-9349-5d966b29dafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:16.110469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1230/2454] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:15 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:16.122733 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce37239-4693-45a1-8ea0-3c4ddb4a5ec9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:16.124719 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fce37239-4693-45a1-8ea0-3c4ddb4a5ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:16.184460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce37239-4693-45a1-8ea0-3c4ddb4a5ec9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:16.190389 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933556e-937f-465d-93bb-e798ecf9b5a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:16.191022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933556e-937f-465d-93bb-e798ecf9b5a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:16.191297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933556e-937f-465d-93bb-e798ecf9b5a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:16.191931 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a933556e-937f-465d-93bb-e798ecf9b5a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:16.202110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933556e-937f-465d-93bb-e798ecf9b5a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:16.203555 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a933556e-937f-465d-93bb-e798ecf9b5a7 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:16.214244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1225/2455] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:16.291321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b14cfa-9be6-495f-9349-5d966b29dafe None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:16.302454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b14cfa-9be6-495f-9349-5d966b29dafe None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:16.306945 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da1766-644c-4009-aa19-e19eb3b53e17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:16.307587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da1766-644c-4009-aa19-e19eb3b53e17 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:16.307936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da1766-644c-4009-aa19-e19eb3b53e17 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:16.308214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da1766-644c-4009-aa19-e19eb3b53e17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:16.370595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da1766-644c-4009-aa19-e19eb3b53e17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:16.372078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74da1766-644c-4009-aa19-e19eb3b53e17 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:16.381359 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1231/2456] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:16 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:16.685712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933556e-937f-465d-93bb-e798ecf9b5a7 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:16.720441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:16.760455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a933556e-937f-465d-93bb-e798ecf9b5a7 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:16.765658 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:16.766348 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:16.766624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:16.766890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] PATH_INFO: `/v3/users/d1dee102ebab453384947a3d032b89ca` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:16.768152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=d1dee102ebab453384947a3d032b89ca)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:16.770155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:16.829915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd1dee102ebab453384947a3d032b89ca'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:16.841904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd1dee102ebab453384947a3d032b89ca'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:16.842700 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd1dee102ebab453384947a3d032b89ca'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:16.843323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd1dee102ebab453384947a3d032b89ca'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:16.851706 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd1dee102ebab453384947a3d032b89ca'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:16.871751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1226/2457] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:16 2022] DELETE /identity/v3/users/d1dee102ebab453384947a3d032b89ca => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:16.876557 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca69d13-7ba3-4e83-92c8-fdfa522833de None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:16.877072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca69d13-7ba3-4e83-92c8-fdfa522833de None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:16.877072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca69d13-7ba3-4e83-92c8-fdfa522833de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:16.901904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1ca69d13-7ba3-4e83-92c8-fdfa522833de None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:16.901904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1ca69d13-7ba3-4e83-92c8-fdfa522833de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:16.971184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1232/2458] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:16.981547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:16.983172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:17.053400 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06f06c6-4a94-4407-a5e5-185b48b0b5cb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:17.058479 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304319f-fb4d-4563-a8e0-a70318b1dae4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:17.059239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304319f-fb4d-4563-a8e0-a70318b1dae4 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:17.059393 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304319f-fb4d-4563-a8e0-a70318b1dae4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:17.059714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8304319f-fb4d-4563-a8e0-a70318b1dae4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:17.070448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304319f-fb4d-4563-a8e0-a70318b1dae4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:17.071878 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8304319f-fb4d-4563-a8e0-a70318b1dae4 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:17.081593 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1227/2459] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:17.456698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca69d13-7ba3-4e83-92c8-fdfa522833de None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:17.458674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1ca69d13-7ba3-4e83-92c8-fdfa522833de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:17.478809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca69d13-7ba3-4e83-92c8-fdfa522833de None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:17.484646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:17.485317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:17.485576 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:17.485897 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] PATH_INFO: `/v3/projects/0eb0e52f46ff47e7ab6c715357db8685` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:17.487002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eb0e52f46ff47e7ab6c715357db8685)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:17.489038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:17.501557 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:17.544432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eb0e52f46ff47e7ab6c715357db8685', 'request_id': 'req-3e8d9baa-8639-432c-951c-3eb24dceb057'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:17.551753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eb0e52f46ff47e7ab6c715357db8685', 'request_id': 'req-3e8d9baa-8639-432c-951c-3eb24dceb057'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:17.562608 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eb0e52f46ff47e7ab6c715357db8685', 'request_id': 'req-3e8d9baa-8639-432c-951c-3eb24dceb057'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:17.574726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] The token cache is being invalidate because project 0eb0e52f46ff47e7ab6c715357db8685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:17.575132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:17.576467 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:17.578405 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1233/2460] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:17 2022] DELETE /identity/v3/projects/0eb0e52f46ff47e7ab6c715357db8685 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:17.582738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304319f-fb4d-4563-a8e0-a70318b1dae4 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:17.594164 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8304319f-fb4d-4563-a8e0-a70318b1dae4 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:17.647885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:17.660294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:17.661189 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:17.661576 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:17.662106 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] PATH_INFO: `/v3/users/8deca180baf84af38a8180b48c686977` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:17.663596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] RBAC: Authorizing `identity:delete_user(user_id=8deca180baf84af38a8180b48c686977)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:17.665857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:17.723183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8deca180baf84af38a8180b48c686977'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:17.733694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8deca180baf84af38a8180b48c686977'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:17.734347 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8deca180baf84af38a8180b48c686977'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:17.738071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:17.740079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:17.741627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8deca180baf84af38a8180b48c686977'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:17.755762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8deca180baf84af38a8180b48c686977'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:17.789887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1228/2461] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:17 2022] DELETE /identity/v3/users/8deca180baf84af38a8180b48c686977 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:17.833529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8d9baa-8639-432c-951c-3eb24dceb057 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:17.948177 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16f3a49-132d-41a1-bedc-8726f28c8f60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:17.948828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f3a49-132d-41a1-bedc-8726f28c8f60 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:17.949095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f3a49-132d-41a1-bedc-8726f28c8f60 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:17.949353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16f3a49-132d-41a1-bedc-8726f28c8f60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:17.958081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a16f3a49-132d-41a1-bedc-8726f28c8f60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:17.977197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f3a49-132d-41a1-bedc-8726f28c8f60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:17.980041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16f3a49-132d-41a1-bedc-8726f28c8f60 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:18.006622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1234/2462] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 269 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:24:18.162748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:18.164382 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:18.253659 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102b318e-070e-4ac1-b977-afd08e9d6e7f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:18.259368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:18.260030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:18.260481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:18.260762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8 admin admin] PATH_INFO: `/v3/projects/82c8b0ca229547be8741c2ca28ba6da7` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:18.262537 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82c8b0ca229547be8741c2ca28ba6da7)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:18.265020 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:18.338054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82c8b0ca229547be8741c2ca28ba6da7', 'request_id': 'req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:18.349578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82c8b0ca229547be8741c2ca28ba6da7', 'request_id': 'req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:18.359334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82c8b0ca229547be8741c2ca28ba6da7', 'request_id': 'req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:18.367773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:18.372045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8 admin admin] The token cache is being invalidate because project 82c8b0ca229547be8741c2ca28ba6da7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:18.372477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:18.373148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-32e30c4f-7bb2-411a-acee-fdc5bcbe65b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:18.375205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1229/2463] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:18 2022] DELETE /identity/v3/projects/82c8b0ca229547be8741c2ca28ba6da7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:18.380332 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cb74c-5361-4aec-9e4c-f899c60ab42a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:18.380620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cb74c-5361-4aec-9e4c-f899c60ab42a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:18.380940 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468cb74c-5361-4aec-9e4c-f899c60ab42a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:18.404151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-468cb74c-5361-4aec-9e4c-f899c60ab42a None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:18.405376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-468cb74c-5361-4aec-9e4c-f899c60ab42a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:18.447092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:18.512061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1235/2464] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:18.523411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934578-cc5b-4f2b-8072-0084ecaa3951 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:18.523699 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934578-cc5b-4f2b-8072-0084ecaa3951 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:18.523986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a934578-cc5b-4f2b-8072-0084ecaa3951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:18.550004 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9a934578-cc5b-4f2b-8072-0084ecaa3951 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:18.551607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9a934578-cc5b-4f2b-8072-0084ecaa3951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:18.561905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1230/2465] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:18.566267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cb74c-5361-4aec-9e4c-f899c60ab42a None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:18.576593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468cb74c-5361-4aec-9e4c-f899c60ab42a None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:18.582416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304f177-3720-46d4-924f-3640c1c03160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:18.583055 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f177-3720-46d4-924f-3640c1c03160 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:18.583542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f177-3720-46d4-924f-3640c1c03160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:18.583674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4304f177-3720-46d4-924f-3640c1c03160 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:18.585356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304f177-3720-46d4-924f-3640c1c03160 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:24:18.585356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304f177-3720-46d4-924f-3640c1c03160 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:18.588008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4304f177-3720-46d4-924f-3640c1c03160 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:18.602617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1236/2466] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:24:18.603871 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a934578-cc5b-4f2b-8072-0084ecaa3951 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:18.613989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a934578-cc5b-4f2b-8072-0084ecaa3951 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:18.620550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab016b8-783a-48c5-b0bb-43b6f61d6541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:18.621299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab016b8-783a-48c5-b0bb-43b6f61d6541 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:18.621641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab016b8-783a-48c5-b0bb-43b6f61d6541 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:18.622056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab016b8-783a-48c5-b0bb-43b6f61d6541 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:18.622768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab016b8-783a-48c5-b0bb-43b6f61d6541 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:18.624842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab016b8-783a-48c5-b0bb-43b6f61d6541 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:18.666750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1231/2467] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:18 2022] POST /identity/v3/projects => generated 369 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:18.667988 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304f177-3720-46d4-924f-3640c1c03160 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:18.678687 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4304f177-3720-46d4-924f-3640c1c03160 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:18.770871 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb269ce4-03a9-48c1-af62-589ec07c6420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:18.771489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb269ce4-03a9-48c1-af62-589ec07c6420 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:18.771768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb269ce4-03a9-48c1-af62-589ec07c6420 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:18.772040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb269ce4-03a9-48c1-af62-589ec07c6420 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:18.772712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb269ce4-03a9-48c1-af62-589ec07c6420 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:18.774703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb269ce4-03a9-48c1-af62-589ec07c6420 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:18.802837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1237/2468] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:18 2022] POST /identity/v3/users => generated 285 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:18.804385 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab016b8-783a-48c5-b0bb-43b6f61d6541 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:18.820638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab016b8-783a-48c5-b0bb-43b6f61d6541 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:18.827456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc3966-84be-4e5a-b3b6-cc9c15e701c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:18.828000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc3966-84be-4e5a-b3b6-cc9c15e701c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:18.828370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc3966-84be-4e5a-b3b6-cc9c15e701c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:18.828554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcc3966-84be-4e5a-b3b6-cc9c15e701c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:18.829212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc3966-84be-4e5a-b3b6-cc9c15e701c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:18.830866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcc3966-84be-4e5a-b3b6-cc9c15e701c4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:18.842635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1232/2469] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:18.847468 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb269ce4-03a9-48c1-af62-589ec07c6420 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:18.860757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb269ce4-03a9-48c1-af62-589ec07c6420 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:18.869049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65b69cd-2cdd-4a0c-ac9b-0b015758e8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:18.869692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b69cd-2cdd-4a0c-ac9b-0b015758e8df admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:18.870004 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b69cd-2cdd-4a0c-ac9b-0b015758e8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:18.870378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65b69cd-2cdd-4a0c-ac9b-0b015758e8df admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:18.871031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b69cd-2cdd-4a0c-ac9b-0b015758e8df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:18.873372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65b69cd-2cdd-4a0c-ac9b-0b015758e8df admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:18.896712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1238/2470] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:18 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:18.898625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc3966-84be-4e5a-b3b6-cc9c15e701c4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:18.910517 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcc3966-84be-4e5a-b3b6-cc9c15e701c4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:18.916041 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd21a99-50f0-4e7a-824b-3653ebff5a9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:18.916728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd21a99-50f0-4e7a-824b-3653ebff5a9f admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:18.917230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd21a99-50f0-4e7a-824b-3653ebff5a9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:18.917508 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd21a99-50f0-4e7a-824b-3653ebff5a9f admin admin] PATH_INFO: `/v3/projects/785ad4b5570f48a8a068b47bafd16fd9/users/4189824c9ac64e20bfa13bb44578956d/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:18.935702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd21a99-50f0-4e7a-824b-3653ebff5a9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=785ad4b5570f48a8a068b47bafd16fd9, user_id=4189824c9ac64e20bfa13bb44578956d, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:18.940236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd21a99-50f0-4e7a-824b-3653ebff5a9f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:18.975638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1233/2471] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:18 2022] PUT /identity/v3/projects/785ad4b5570f48a8a068b47bafd16fd9/users/4189824c9ac64e20bfa13bb44578956d/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:18.981592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8108b-30d4-4947-8255-9368e9b922e1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:18.982195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8108b-30d4-4947-8255-9368e9b922e1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:18.982298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8108b-30d4-4947-8255-9368e9b922e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:19.003477 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-07a8108b-30d4-4947-8255-9368e9b922e1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:19.004658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-07a8108b-30d4-4947-8255-9368e9b922e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:19.074498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1239/2472] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:19.086526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd21a99-50f0-4e7a-824b-3653ebff5a9f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:19.088625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0fd21a99-50f0-4e7a-824b-3653ebff5a9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:19.183387 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd21a99-50f0-4e7a-824b-3653ebff5a9f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:19.191934 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8108b-30d4-4947-8255-9368e9b922e1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:19.193724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-07a8108b-30d4-4947-8255-9368e9b922e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:19.207265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92d3f38-fada-43cf-bf2d-c15b1d76225e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:19.207990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d3f38-fada-43cf-bf2d-c15b1d76225e service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:19.208262 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d3f38-fada-43cf-bf2d-c15b1d76225e service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:19.208536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92d3f38-fada-43cf-bf2d-c15b1d76225e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:19.231486 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d3f38-fada-43cf-bf2d-c15b1d76225e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:19.232955 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92d3f38-fada-43cf-bf2d-c15b1d76225e service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:19.246627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1234/2473] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:24:19.256020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:19.310773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8108b-30d4-4947-8255-9368e9b922e1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:19.318111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c6bb8-3697-46e0-bd93-30749e63807c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:19.318568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6bb8-3697-46e0-bd93-30749e63807c service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:19.318939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6bb8-3697-46e0-bd93-30749e63807c service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:19.319305 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c6bb8-3697-46e0-bd93-30749e63807c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:19.321689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e42c6bb8-3697-46e0-bd93-30749e63807c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:19.338563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c6bb8-3697-46e0-bd93-30749e63807c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:19.341085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42c6bb8-3697-46e0-bd93-30749e63807c service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:19.356548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1240/2474] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:19.989146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea44c1-7373-4710-921c-73736c33da0d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:19.989647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea44c1-7373-4710-921c-73736c33da0d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:19.989748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cea44c1-7373-4710-921c-73736c33da0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:20.025152 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-3cea44c1-7373-4710-921c-73736c33da0d None None] MFA Rules not processed for user `4189824c9ac64e20bfa13bb44578956d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:20.026599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3cea44c1-7373-4710-921c-73736c33da0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:20.112417 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1235/2475] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:19 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:20.124133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c6bb8-3697-46e0-bd93-30749e63807c service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:20.126120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e42c6bb8-3697-46e0-bd93-30749e63807c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:20.197247 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42c6bb8-3697-46e0-bd93-30749e63807c service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:20.200994 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675206cc-84c6-4394-b4b3-83de2edf07f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:20.201615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675206cc-84c6-4394-b4b3-83de2edf07f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:20.201959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675206cc-84c6-4394-b4b3-83de2edf07f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:20.202225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675206cc-84c6-4394-b4b3-83de2edf07f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:20.212229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675206cc-84c6-4394-b4b3-83de2edf07f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:20.213657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675206cc-84c6-4394-b4b3-83de2edf07f6 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:20.222822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1241/2476] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:20.549157 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc9137-bd9f-4ddf-a89b-df2b937b3634 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:20.549461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc9137-bd9f-4ddf-a89b-df2b937b3634 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:20.549730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcc9137-bd9f-4ddf-a89b-df2b937b3634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:20.579315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ebcc9137-bd9f-4ddf-a89b-df2b937b3634 None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:20.579932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ebcc9137-bd9f-4ddf-a89b-df2b937b3634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:20.613462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:20.657775 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1236/2477] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 15 19:24:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:20.679757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675206cc-84c6-4394-b4b3-83de2edf07f6 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:20.682231 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-675206cc-84c6-4394-b4b3-83de2edf07f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:20.782918 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675206cc-84c6-4394-b4b3-83de2edf07f6 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:20.788620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7a36b-9ece-4106-8ab3-800bd5d33712 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:20.789256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7a36b-9ece-4106-8ab3-800bd5d33712 service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:20.789555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7a36b-9ece-4106-8ab3-800bd5d33712 service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:20.789854 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad7a36b-9ece-4106-8ab3-800bd5d33712 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:20.804737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7a36b-9ece-4106-8ab3-800bd5d33712 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:20.807064 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad7a36b-9ece-4106-8ab3-800bd5d33712 service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:20.818318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1242/2478] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:24:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 19:24:21.696829 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c26f31-bab3-403a-b41c-62823309d22c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:21.697440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c26f31-bab3-403a-b41c-62823309d22c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:21.697541 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c26f31-bab3-403a-b41c-62823309d22c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:21.718806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-95c26f31-bab3-403a-b41c-62823309d22c None None] MFA Rules not processed for user `4189824c9ac64e20bfa13bb44578956d`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:21.720315 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-95c26f31-bab3-403a-b41c-62823309d22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:21.727747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1237/2479] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:21 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:22.391274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7a36b-9ece-4106-8ab3-800bd5d33712 service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:22.392878 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7ad7a36b-9ece-4106-8ab3-800bd5d33712 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:22.406629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad7a36b-9ece-4106-8ab3-800bd5d33712 service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:22.410802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7d43b-4293-4b9f-b002-3f9b83ac7c90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:22.412034 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7d43b-4293-4b9f-b002-3f9b83ac7c90 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:22.412314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7d43b-4293-4b9f-b002-3f9b83ac7c90 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:22.412586 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a7d43b-4293-4b9f-b002-3f9b83ac7c90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:22.414633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-93a7d43b-4293-4b9f-b002-3f9b83ac7c90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:22.427625 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7d43b-4293-4b9f-b002-3f9b83ac7c90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:22.429064 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a7d43b-4293-4b9f-b002-3f9b83ac7c90 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:22.446881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1243/2480] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:22 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:27.021844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c26f31-bab3-403a-b41c-62823309d22c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:27.037671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c26f31-bab3-403a-b41c-62823309d22c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:27.042487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e2b4b-d92b-49c7-ab27-67f037983f59 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:27.042959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2b4b-d92b-49c7-ab27-67f037983f59 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:27.043275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2b4b-d92b-49c7-ab27-67f037983f59 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:27.043497 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049e2b4b-d92b-49c7-ab27-67f037983f59 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:27.045392 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-049e2b4b-d92b-49c7-ab27-67f037983f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:27.059310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e2b4b-d92b-49c7-ab27-67f037983f59 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:27.061053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049e2b4b-d92b-49c7-ab27-67f037983f59 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:27.072572 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1238/2481] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:24:28.306019 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7d43b-4293-4b9f-b002-3f9b83ac7c90 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:28.315153 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a7d43b-4293-4b9f-b002-3f9b83ac7c90 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:28.319622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81d247-2365-4ba0-b7bd-ddc3bffc2484 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:28.320242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81d247-2365-4ba0-b7bd-ddc3bffc2484 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:28.320523 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81d247-2365-4ba0-b7bd-ddc3bffc2484 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:28.320794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c81d247-2365-4ba0-b7bd-ddc3bffc2484 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:28.323786 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3c81d247-2365-4ba0-b7bd-ddc3bffc2484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:28.337411 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81d247-2365-4ba0-b7bd-ddc3bffc2484 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:28.339078 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c81d247-2365-4ba0-b7bd-ddc3bffc2484 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:28.352265 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1244/2482] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:32.448062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e2b4b-d92b-49c7-ab27-67f037983f59 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:32.449992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-049e2b4b-d92b-49c7-ab27-67f037983f59 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:32.471444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049e2b4b-d92b-49c7-ab27-67f037983f59 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:32.476649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:32.477402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:32.477964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:32.478308 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] PATH_INFO: `/v3/users/4e5cb514da72438ab36c05399083f109` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:32.479583 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e5cb514da72438ab36c05399083f109)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:32.481815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:32.497570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81d247-2365-4ba0-b7bd-ddc3bffc2484 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:32.499184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3c81d247-2365-4ba0-b7bd-ddc3bffc2484 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:32.514762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c81d247-2365-4ba0-b7bd-ddc3bffc2484 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:32.520719 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:32.521371 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:32.521651 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:32.521959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] PATH_INFO: `/v3/users/a5a8b4618308488dabdef27763f291e9` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:32.523288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a8b4618308488dabdef27763f291e9)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:32.525653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:32.544665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:32.552077 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e5cb514da72438ab36c05399083f109'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:32.562183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e5cb514da72438ab36c05399083f109'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:32.562879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e5cb514da72438ab36c05399083f109'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:32.563474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e5cb514da72438ab36c05399083f109'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:32.573548 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e5cb514da72438ab36c05399083f109'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:32.590790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a8b4618308488dabdef27763f291e9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:32.603904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a8b4618308488dabdef27763f291e9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:32.604541 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a8b4618308488dabdef27763f291e9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:32.605146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a8b4618308488dabdef27763f291e9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:32.611880 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1239/2483] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:32 2022] DELETE /identity/v3/users/4e5cb514da72438ab36c05399083f109 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:32.614751 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a8b4618308488dabdef27763f291e9'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:32.638804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1245/2484] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:32 2022] DELETE /identity/v3/users/a5a8b4618308488dabdef27763f291e9 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:32.806704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:32.808582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:32.847111 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:32.849020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:32.902507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3404500e-0ad0-496e-b2bd-d1f9efec8d2c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:32.926608 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470a789b-4691-4901-a872-6baf979e6c5f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:32.931243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f56dea-f076-4f8f-bd97-0c3088c83865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:32.931880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f56dea-f076-4f8f-bd97-0c3088c83865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:32.932162 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f56dea-f076-4f8f-bd97-0c3088c83865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:32.932432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f56dea-f076-4f8f-bd97-0c3088c83865 admin admin] PATH_INFO: `/v3/projects/0c06f7617b8a4254a752d8652ab91e48` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:32.933387 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:32.933544 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f56dea-f076-4f8f-bd97-0c3088c83865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0c06f7617b8a4254a752d8652ab91e48)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:32.935828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f56dea-f076-4f8f-bd97-0c3088c83865 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:32.964210 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567b36e9-7fe3-4e84-8857-27ddab28b87f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:32.964866 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b36e9-7fe3-4e84-8857-27ddab28b87f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:32.965151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b36e9-7fe3-4e84-8857-27ddab28b87f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:32.965425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567b36e9-7fe3-4e84-8857-27ddab28b87f admin admin] PATH_INFO: `/v3/projects/45a89c6c4dbc489fa8fd54290c97c88e` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:32.966878 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b36e9-7fe3-4e84-8857-27ddab28b87f admin admin] RBAC: Authorizing `identity:delete_project(project_id=45a89c6c4dbc489fa8fd54290c97c88e)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:32.968862 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567b36e9-7fe3-4e84-8857-27ddab28b87f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:32.988876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d2f56dea-f076-4f8f-bd97-0c3088c83865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0c06f7617b8a4254a752d8652ab91e48', 'request_id': 'req-d2f56dea-f076-4f8f-bd97-0c3088c83865'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:32.995546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d2f56dea-f076-4f8f-bd97-0c3088c83865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0c06f7617b8a4254a752d8652ab91e48', 'request_id': 'req-d2f56dea-f076-4f8f-bd97-0c3088c83865'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:33.004652 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d2f56dea-f076-4f8f-bd97-0c3088c83865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0c06f7617b8a4254a752d8652ab91e48', 'request_id': 'req-d2f56dea-f076-4f8f-bd97-0c3088c83865'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:33.016501 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d2f56dea-f076-4f8f-bd97-0c3088c83865 admin admin] The token cache is being invalidate because project 0c06f7617b8a4254a752d8652ab91e48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:33.016786 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d2f56dea-f076-4f8f-bd97-0c3088c83865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:33.017435 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-d2f56dea-f076-4f8f-bd97-0c3088c83865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:33.018981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1246/2485] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:32 2022] DELETE /identity/v3/projects/0c06f7617b8a4254a752d8652ab91e48 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:33.023837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc289cd7-ddef-40e9-879e-0e236d857e6f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.023984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-567b36e9-7fe3-4e84-8857-27ddab28b87f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45a89c6c4dbc489fa8fd54290c97c88e', 'request_id': 'req-567b36e9-7fe3-4e84-8857-27ddab28b87f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:33.024270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc289cd7-ddef-40e9-879e-0e236d857e6f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.024545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc289cd7-ddef-40e9-879e-0e236d857e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.030994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-567b36e9-7fe3-4e84-8857-27ddab28b87f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45a89c6c4dbc489fa8fd54290c97c88e', 'request_id': 'req-567b36e9-7fe3-4e84-8857-27ddab28b87f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:33.040637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-567b36e9-7fe3-4e84-8857-27ddab28b87f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45a89c6c4dbc489fa8fd54290c97c88e', 'request_id': 'req-567b36e9-7fe3-4e84-8857-27ddab28b87f'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:33.046924 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fc289cd7-ddef-40e9-879e-0e236d857e6f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:33.048207 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fc289cd7-ddef-40e9-879e-0e236d857e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:33.053960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-567b36e9-7fe3-4e84-8857-27ddab28b87f admin admin] The token cache is being invalidate because project 45a89c6c4dbc489fa8fd54290c97c88e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:33.054332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-567b36e9-7fe3-4e84-8857-27ddab28b87f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:33.055045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-567b36e9-7fe3-4e84-8857-27ddab28b87f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:33.057015 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1240/2486] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:32 2022] DELETE /identity/v3/projects/45a89c6c4dbc489fa8fd54290c97c88e => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:33.063362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e85efa-a863-4a5a-adfc-df90712b9c4c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.063850 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e85efa-a863-4a5a-adfc-df90712b9c4c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.064329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e85efa-a863-4a5a-adfc-df90712b9c4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.086239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:33.089922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-c5e85efa-a863-4a5a-adfc-df90712b9c4c None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:33.091182 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c5e85efa-a863-4a5a-adfc-df90712b9c4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:33.150166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1247/2487] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:33.158020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c70c18-80f5-4081-bac8-ab0efd306fbe None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.158297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c70c18-80f5-4081-bac8-ab0efd306fbe None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.158503 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c70c18-80f5-4081-bac8-ab0efd306fbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.167698 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1241/2488] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:33.176041 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b163-a417-41d8-b06a-7aed301b14d2 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.176404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b163-a417-41d8-b06a-7aed301b14d2 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.176778 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6668b163-a417-41d8-b06a-7aed301b14d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.185900 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f2c70c18-80f5-4081-bac8-ab0efd306fbe None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:33.187127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f2c70c18-80f5-4081-bac8-ab0efd306fbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:33.196623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1248/2489] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:24:33.198155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6668b163-a417-41d8-b06a-7aed301b14d2 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:33.199432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6668b163-a417-41d8-b06a-7aed301b14d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:33.202284 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c70c18-80f5-4081-bac8-ab0efd306fbe None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.209364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1242/2490] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:33.213845 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668b163-a417-41d8-b06a-7aed301b14d2 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.216718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c70c18-80f5-4081-bac8-ab0efd306fbe None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.221485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88fa85-5b0a-4b41-b731-d70470e3d5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.222151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88fa85-5b0a-4b41-b731-d70470e3d5ae admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.222434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88fa85-5b0a-4b41-b731-d70470e3d5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.222745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d88fa85-5b0a-4b41-b731-d70470e3d5ae admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.223412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88fa85-5b0a-4b41-b731-d70470e3d5ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:24:33.223717 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88fa85-5b0a-4b41-b731-d70470e3d5ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.225347 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d88fa85-5b0a-4b41-b731-d70470e3d5ae admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.225465 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6668b163-a417-41d8-b06a-7aed301b14d2 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.231956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdba28f-1ed1-479e-b8b4-aa67b3c12fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.232585 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdba28f-1ed1-479e-b8b4-aa67b3c12fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.232859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdba28f-1ed1-479e-b8b4-aa67b3c12fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.234241 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdba28f-1ed1-479e-b8b4-aa67b3c12fd1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.234241 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdba28f-1ed1-479e-b8b4-aa67b3c12fd1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:24:33.234426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdba28f-1ed1-479e-b8b4-aa67b3c12fd1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.236114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdba28f-1ed1-479e-b8b4-aa67b3c12fd1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.243379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1249/2491] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:24:33.244992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88fa85-5b0a-4b41-b731-d70470e3d5ae admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.249103 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1243/2492] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:24:33.253644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdba28f-1ed1-479e-b8b4-aa67b3c12fd1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.258307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d88fa85-5b0a-4b41-b731-d70470e3d5ae admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.265928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cfbe6-4c7e-470e-81d1-3369da885d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.266758 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cfbe6-4c7e-470e-81d1-3369da885d12 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.267408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cfbe6-4c7e-470e-81d1-3369da885d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.267408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cfbe6-4c7e-470e-81d1-3369da885d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.268219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cfbe6-4c7e-470e-81d1-3369da885d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.270575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cfbe6-4c7e-470e-81d1-3369da885d12 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.271128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdba28f-1ed1-479e-b8b4-aa67b3c12fd1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.289885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f746a1-725a-400b-b7b0-d122f5e89b13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.290638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f746a1-725a-400b-b7b0-d122f5e89b13 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.290958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f746a1-725a-400b-b7b0-d122f5e89b13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.291221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f746a1-725a-400b-b7b0-d122f5e89b13 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.291885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f746a1-725a-400b-b7b0-d122f5e89b13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.294577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f746a1-725a-400b-b7b0-d122f5e89b13 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.313821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1250/2493] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:33 2022] POST /identity/v3/projects => generated 369 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:33.316894 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cfbe6-4c7e-470e-81d1-3369da885d12 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.330869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1244/2494] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:33 2022] POST /identity/v3/projects => generated 373 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:33.335702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f746a1-725a-400b-b7b0-d122f5e89b13 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.369429 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:33.386193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cfbe6-4c7e-470e-81d1-3369da885d12 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.417447 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f746a1-725a-400b-b7b0-d122f5e89b13 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.422687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef889c1-ef3f-42c8-90db-fef502188e65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.423411 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef889c1-ef3f-42c8-90db-fef502188e65 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.423768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef889c1-ef3f-42c8-90db-fef502188e65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.424056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ef889c1-ef3f-42c8-90db-fef502188e65 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.424850 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef889c1-ef3f-42c8-90db-fef502188e65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.427037 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ef889c1-ef3f-42c8-90db-fef502188e65 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.452625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1245/2495] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:33 2022] POST /identity/v3/users => generated 287 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:33.455090 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0dc72-007b-4fc4-a7de-23f4025435c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.455710 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0dc72-007b-4fc4-a7de-23f4025435c0 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.456000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0dc72-007b-4fc4-a7de-23f4025435c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.456266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be0dc72-007b-4fc4-a7de-23f4025435c0 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.457227 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef889c1-ef3f-42c8-90db-fef502188e65 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.457624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0dc72-007b-4fc4-a7de-23f4025435c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.459889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be0dc72-007b-4fc4-a7de-23f4025435c0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.468752 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ef889c1-ef3f-42c8-90db-fef502188e65 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.474575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc96d6-903d-4a99-a3b9-11e9d5d68391 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.475205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc96d6-903d-4a99-a3b9-11e9d5d68391 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.475483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc96d6-903d-4a99-a3b9-11e9d5d68391 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.475882 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc96d6-903d-4a99-a3b9-11e9d5d68391 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.476481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc96d6-903d-4a99-a3b9-11e9d5d68391 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.478114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32fc96d6-903d-4a99-a3b9-11e9d5d68391 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.487809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1251/2496] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:33 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:33.489027 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1246/2497] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:33.489401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0dc72-007b-4fc4-a7de-23f4025435c0 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.493009 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc96d6-903d-4a99-a3b9-11e9d5d68391 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.499598 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be0dc72-007b-4fc4-a7de-23f4025435c0 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.502806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc96d6-903d-4a99-a3b9-11e9d5d68391 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.504813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66226457-0412-4f52-a0d8-9fe9c28ec464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.505365 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226457-0412-4f52-a0d8-9fe9c28ec464 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.505645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226457-0412-4f52-a0d8-9fe9c28ec464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.505971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66226457-0412-4f52-a0d8-9fe9c28ec464 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.506615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66226457-0412-4f52-a0d8-9fe9c28ec464 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.507688 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c3e4b-be3b-4d13-8c93-072108c7d07a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.508209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66226457-0412-4f52-a0d8-9fe9c28ec464 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.508327 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c3e4b-be3b-4d13-8c93-072108c7d07a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.508528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c3e4b-be3b-4d13-8c93-072108c7d07a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.508796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329c3e4b-be3b-4d13-8c93-072108c7d07a admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.509425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c3e4b-be3b-4d13-8c93-072108c7d07a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.511031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-329c3e4b-be3b-4d13-8c93-072108c7d07a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.518658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1252/2498] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:33.522163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1247/2499] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:33.525711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66226457-0412-4f52-a0d8-9fe9c28ec464 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.525889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c3e4b-be3b-4d13-8c93-072108c7d07a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.535988 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329c3e4b-be3b-4d13-8c93-072108c7d07a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.536157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66226457-0412-4f52-a0d8-9fe9c28ec464 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.540913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebeb7a-f9df-4ddd-9dcd-c0f07a3c6055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.541150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3a248-78db-475d-9c24-db7494d751f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.541574 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebeb7a-f9df-4ddd-9dcd-c0f07a3c6055 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.541750 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3a248-78db-475d-9c24-db7494d751f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.541894 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebeb7a-f9df-4ddd-9dcd-c0f07a3c6055 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.542075 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3a248-78db-475d-9c24-db7494d751f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.542189 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebeb7a-f9df-4ddd-9dcd-c0f07a3c6055 admin admin] PATH_INFO: `/v3/projects/d3fd7640254e41908fa93efc45427861/users/8410f3c9ea5a4cbeb57d4b103411e929/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.542347 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d3a248-78db-475d-9c24-db7494d751f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.542970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3a248-78db-475d-9c24-db7494d751f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.544604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d3a248-78db-475d-9c24-db7494d751f0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.546990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:33.561812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1253/2500] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:33 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:33.562011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebeb7a-f9df-4ddd-9dcd-c0f07a3c6055 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3fd7640254e41908fa93efc45427861, user_id=8410f3c9ea5a4cbeb57d4b103411e929, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.562853 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ebeb7a-f9df-4ddd-9dcd-c0f07a3c6055 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.562998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3a248-78db-475d-9c24-db7494d751f0 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.575281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d3a248-78db-475d-9c24-db7494d751f0 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.578259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1248/2501] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:33 2022] PUT /identity/v3/projects/d3fd7640254e41908fa93efc45427861/users/8410f3c9ea5a4cbeb57d4b103411e929/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:33.591371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5adc9d-d4c4-4118-a63b-ab07465f044a None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.591650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5adc9d-d4c4-4118-a63b-ab07465f044a None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.591919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5adc9d-d4c4-4118-a63b-ab07465f044a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.623970 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ab5adc9d-d4c4-4118-a63b-ab07465f044a None None] MFA Rules not processed for user `8410f3c9ea5a4cbeb57d4b103411e929`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:33.625203 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ab5adc9d-d4c4-4118-a63b-ab07465f044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:33.637341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7502305-9838-40e7-805e-b893c2779109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.638208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7502305-9838-40e7-805e-b893c2779109 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.638456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7502305-9838-40e7-805e-b893c2779109 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.638728 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7502305-9838-40e7-805e-b893c2779109 admin admin] PATH_INFO: `/v3/projects/86d6f943234343a9a76d2c51cebe8b8c/users/1903b47b542841228a5fa922b14a178c/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.655532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7502305-9838-40e7-805e-b893c2779109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86d6f943234343a9a76d2c51cebe8b8c, user_id=1903b47b542841228a5fa922b14a178c, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.658499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7502305-9838-40e7-805e-b893c2779109 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.672997 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1254/2502] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:33 2022] PUT /identity/v3/projects/86d6f943234343a9a76d2c51cebe8b8c/users/1903b47b542841228a5fa922b14a178c/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:33.683415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d1fc7-c372-408f-aa54-26a2bfa1dfad None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.683685 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d1fc7-c372-408f-aa54-26a2bfa1dfad None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.683947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4d1fc7-c372-408f-aa54-26a2bfa1dfad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.697147 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1249/2503] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:33.709051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5adc9d-d4c4-4118-a63b-ab07465f044a None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.710513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ab5adc9d-d4c4-4118-a63b-ab07465f044a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:33.713458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7c4d1fc7-c372-408f-aa54-26a2bfa1dfad None None] MFA Rules not processed for user `1903b47b542841228a5fa922b14a178c`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:33.714697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7c4d1fc7-c372-408f-aa54-26a2bfa1dfad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:33.766329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:33.785979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1255/2504] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:33 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:24:33.788262 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5adc9d-d4c4-4118-a63b-ab07465f044a None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.790536 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d1fc7-c372-408f-aa54-26a2bfa1dfad None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.852434 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773b4fc-e6fc-479a-92c8-e82b745e3757 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.853103 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773b4fc-e6fc-479a-92c8-e82b745e3757 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.853375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773b4fc-e6fc-479a-92c8-e82b745e3757 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.853641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a773b4fc-e6fc-479a-92c8-e82b745e3757 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.854883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4d1fc7-c372-408f-aa54-26a2bfa1dfad None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.859777 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9e8ad-e116-4b9b-88c1-10d998653101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.860386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9e8ad-e116-4b9b-88c1-10d998653101 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.860661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9e8ad-e116-4b9b-88c1-10d998653101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.860928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa9e8ad-e116-4b9b-88c1-10d998653101 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.861566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9e8ad-e116-4b9b-88c1-10d998653101 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.864047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa9e8ad-e116-4b9b-88c1-10d998653101 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.882905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:33.902726 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1256/2505] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:33 2022] POST /identity/v3/projects => generated 369 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:33.906762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9e8ad-e116-4b9b-88c1-10d998653101 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:33.919393 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773b4fc-e6fc-479a-92c8-e82b745e3757 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.921026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a773b4fc-e6fc-479a-92c8-e82b745e3757 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:33.931269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1250/2506] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:24:33.974518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa9e8ad-e116-4b9b-88c1-10d998653101 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:33.979928 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b141e-1d2a-48e4-b857-fb8d76ec965c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:33.980136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b141e-1d2a-48e4-b857-fb8d76ec965c admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:33.980521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b141e-1d2a-48e4-b857-fb8d76ec965c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:33.980904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4b141e-1d2a-48e4-b857-fb8d76ec965c admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:33.981658 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b141e-1d2a-48e4-b857-fb8d76ec965c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:33.984062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4b141e-1d2a-48e4-b857-fb8d76ec965c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:34.013990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1257/2507] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:33 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:34.017052 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773b4fc-e6fc-479a-92c8-e82b745e3757 service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:34.030358 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a773b4fc-e6fc-479a-92c8-e82b745e3757 service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:34.036081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c3dab-39fa-4ccc-91bf-2cb933750d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:34.036815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c3dab-39fa-4ccc-91bf-2cb933750d80 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:34.037093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c3dab-39fa-4ccc-91bf-2cb933750d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:34.037367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6c3dab-39fa-4ccc-91bf-2cb933750d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:34.038066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c3dab-39fa-4ccc-91bf-2cb933750d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:34.039682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6c3dab-39fa-4ccc-91bf-2cb933750d80 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:34.050140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1251/2508] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:34.054831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b141e-1d2a-48e4-b857-fb8d76ec965c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:34.066916 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4b141e-1d2a-48e4-b857-fb8d76ec965c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:34.072251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50ea88-865c-4801-815b-5ea41b7fc629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:34.072923 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50ea88-865c-4801-815b-5ea41b7fc629 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:34.073202 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50ea88-865c-4801-815b-5ea41b7fc629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:34.073477 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d50ea88-865c-4801-815b-5ea41b7fc629 admin admin] PATH_INFO: `/v3/projects/c42f989f756546bf896a0006dc7a25b3/users/350224ac9abc4e59a3ad5dc9bea3081a/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:34.090769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50ea88-865c-4801-815b-5ea41b7fc629 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42f989f756546bf896a0006dc7a25b3, user_id=350224ac9abc4e59a3ad5dc9bea3081a, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:34.093680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d50ea88-865c-4801-815b-5ea41b7fc629 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:34.110702 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1258/2509] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:34 2022] PUT /identity/v3/projects/c42f989f756546bf896a0006dc7a25b3/users/350224ac9abc4e59a3ad5dc9bea3081a/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:34.115352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c3dab-39fa-4ccc-91bf-2cb933750d80 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:34.126902 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6c3dab-39fa-4ccc-91bf-2cb933750d80 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:34.194927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53e1a0d-1bf1-4bb1-8efe-f710667dfa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:34.197770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e1a0d-1bf1-4bb1-8efe-f710667dfa28 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:34.198320 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e1a0d-1bf1-4bb1-8efe-f710667dfa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:34.198837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53e1a0d-1bf1-4bb1-8efe-f710667dfa28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:34.199801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e1a0d-1bf1-4bb1-8efe-f710667dfa28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:34.201732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53e1a0d-1bf1-4bb1-8efe-f710667dfa28 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:34.221168 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1252/2510] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:34 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:34.226660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50ea88-865c-4801-815b-5ea41b7fc629 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:34.238775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d50ea88-865c-4801-815b-5ea41b7fc629 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:34.247779 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafef17c-5f0c-4057-966f-a06c8ad8fb7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:34.248659 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafef17c-5f0c-4057-966f-a06c8ad8fb7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:34.249134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafef17c-5f0c-4057-966f-a06c8ad8fb7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:34.249601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafef17c-5f0c-4057-966f-a06c8ad8fb7e admin admin] PATH_INFO: `/v3/projects/c42f989f756546bf896a0006dc7a25b3/users/350224ac9abc4e59a3ad5dc9bea3081a/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:34.252233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafef17c-5f0c-4057-966f-a06c8ad8fb7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c42f989f756546bf896a0006dc7a25b3, user_id=350224ac9abc4e59a3ad5dc9bea3081a, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:34.255279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafef17c-5f0c-4057-966f-a06c8ad8fb7e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:34.269314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1259/2511] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:34 2022] PUT /identity/v3/projects/c42f989f756546bf896a0006dc7a25b3/users/350224ac9abc4e59a3ad5dc9bea3081a/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:34.283414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb5393-8fdb-4d7b-8533-827a4d6859b4 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:34.283414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb5393-8fdb-4d7b-8533-827a4d6859b4 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:34.283610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccb5393-8fdb-4d7b-8533-827a4d6859b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:34.366445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2ccb5393-8fdb-4d7b-8533-827a4d6859b4 None None] MFA Rules not processed for user `350224ac9abc4e59a3ad5dc9bea3081a`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:34.367710 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2ccb5393-8fdb-4d7b-8533-827a4d6859b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:34.373701 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:34.503457 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1253/2512] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:34 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:34.514064 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafef17c-5f0c-4057-966f-a06c8ad8fb7e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:34.517891 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fafef17c-5f0c-4057-966f-a06c8ad8fb7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:34.600914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafef17c-5f0c-4057-966f-a06c8ad8fb7e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:34.604724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb17313-3b45-4f68-824b-bad35116e087 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:34.605419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb17313-3b45-4f68-824b-bad35116e087 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:34.605936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb17313-3b45-4f68-824b-bad35116e087 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:34.606318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb17313-3b45-4f68-824b-bad35116e087 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:34.617340 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb17313-3b45-4f68-824b-bad35116e087 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:34.618949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb17313-3b45-4f68-824b-bad35116e087 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:34.629221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1260/2513] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:34 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:34.688138 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb5393-8fdb-4d7b-8533-827a4d6859b4 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:34.689828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2ccb5393-8fdb-4d7b-8533-827a4d6859b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:34.702027 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccb5393-8fdb-4d7b-8533-827a4d6859b4 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:34.707409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16cd67-e184-4788-9c1d-4b46c82a76a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:34.708141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cd67-e184-4788-9c1d-4b46c82a76a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:34.708420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cd67-e184-4788-9c1d-4b46c82a76a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:34.708694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16cd67-e184-4788-9c1d-4b46c82a76a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:34.783534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16cd67-e184-4788-9c1d-4b46c82a76a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:34.784997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16cd67-e184-4788-9c1d-4b46c82a76a7 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:34.794337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1254/2514] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:36.757693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb17313-3b45-4f68-824b-bad35116e087 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:36.814528 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:36.837413 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb17313-3b45-4f68-824b-bad35116e087 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:36.843084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:36.843731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:36.844039 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:36.844321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] PATH_INFO: `/v3/users/8410f3c9ea5a4cbeb57d4b103411e929` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:36.845723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8410f3c9ea5a4cbeb57d4b103411e929)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:36.847699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:36.902426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8410f3c9ea5a4cbeb57d4b103411e929'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:36.911931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8410f3c9ea5a4cbeb57d4b103411e929'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:36.912603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8410f3c9ea5a4cbeb57d4b103411e929'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:36.914168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8410f3c9ea5a4cbeb57d4b103411e929'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:36.921600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8410f3c9ea5a4cbeb57d4b103411e929'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:36.940355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1261/2515] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:36 2022] DELETE /identity/v3/users/8410f3c9ea5a4cbeb57d4b103411e929 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:36.945160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2098f7e-96a8-42c6-84c2-283082311007 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:36.945694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2098f7e-96a8-42c6-84c2-283082311007 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:36.945694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2098f7e-96a8-42c6-84c2-283082311007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:36.966018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a2098f7e-96a8-42c6-84c2-283082311007 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:36.967282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a2098f7e-96a8-42c6-84c2-283082311007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:37.028540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1255/2516] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:37.042760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:37.044229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:37.109334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94879e0d-0db1-4907-93a4-2eb43a0d49f7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:37.114219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1116812-5e7f-488f-9a32-1ff102211fdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:37.115248 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116812-5e7f-488f-9a32-1ff102211fdc service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:37.115595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116812-5e7f-488f-9a32-1ff102211fdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:37.115919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1116812-5e7f-488f-9a32-1ff102211fdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:37.128692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1116812-5e7f-488f-9a32-1ff102211fdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:37.130458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1116812-5e7f-488f-9a32-1ff102211fdc service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:37.141041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1262/2517] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:24:37.502289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2098f7e-96a8-42c6-84c2-283082311007 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:37.503827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a2098f7e-96a8-42c6-84c2-283082311007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:37.516290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2098f7e-96a8-42c6-84c2-283082311007 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:37.521528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:37.522205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:37.522477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:37.522754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3 admin admin] PATH_INFO: `/v3/projects/d3fd7640254e41908fa93efc45427861` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:37.523911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3fd7640254e41908fa93efc45427861)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:37.525864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:37.566121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:37.576689 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3fd7640254e41908fa93efc45427861', 'request_id': 'req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:37.583453 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3fd7640254e41908fa93efc45427861', 'request_id': 'req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:37.592721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3fd7640254e41908fa93efc45427861', 'request_id': 'req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:37.610164 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3 admin admin] The token cache is being invalidate because project d3fd7640254e41908fa93efc45427861 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:37.610420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:37.611167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4baf56cc-a847-4f31-ae58-8cb86ce1fcd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:37.612711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1256/2518] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:37 2022] DELETE /identity/v3/projects/d3fd7640254e41908fa93efc45427861 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:37.618448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df14be-e9a7-4dbf-a47c-a6fc72c416c9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:37.618732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df14be-e9a7-4dbf-a47c-a6fc72c416c9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:37.619006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71df14be-e9a7-4dbf-a47c-a6fc72c416c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:37.639182 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-71df14be-e9a7-4dbf-a47c-a6fc72c416c9 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:37.640381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-71df14be-e9a7-4dbf-a47c-a6fc72c416c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:37.709809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1263/2519] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:37.717713 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f867f2-ea66-48f9-9f0e-76bd742bb4eb None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:37.718031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f867f2-ea66-48f9-9f0e-76bd742bb4eb None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:37.718300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f867f2-ea66-48f9-9f0e-76bd742bb4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:37.752198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-83f867f2-ea66-48f9-9f0e-76bd742bb4eb None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:37.756952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-83f867f2-ea66-48f9-9f0e-76bd742bb4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:37.763927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1257/2520] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:37.768209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df14be-e9a7-4dbf-a47c-a6fc72c416c9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:37.782863 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71df14be-e9a7-4dbf-a47c-a6fc72c416c9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:37.785654 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707c5c7-65ae-4963-9b29-c5733f5630e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:37.786737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707c5c7-65ae-4963-9b29-c5733f5630e6 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:37.787130 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707c5c7-65ae-4963-9b29-c5733f5630e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:37.787638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0707c5c7-65ae-4963-9b29-c5733f5630e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:37.788326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707c5c7-65ae-4963-9b29-c5733f5630e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:24:37.788748 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707c5c7-65ae-4963-9b29-c5733f5630e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:37.790856 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0707c5c7-65ae-4963-9b29-c5733f5630e6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:37.817373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:37.820001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1264/2521] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:24:37.825252 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f867f2-ea66-48f9-9f0e-76bd742bb4eb None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:37.837603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f867f2-ea66-48f9-9f0e-76bd742bb4eb None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:37.843602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c1d12-91aa-4217-bab7-e46a4287d389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:37.844293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c1d12-91aa-4217-bab7-e46a4287d389 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:37.844527 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c1d12-91aa-4217-bab7-e46a4287d389 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:37.844791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c1d12-91aa-4217-bab7-e46a4287d389 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:37.845649 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c1d12-91aa-4217-bab7-e46a4287d389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:37.847673 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304c1d12-91aa-4217-bab7-e46a4287d389 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:37.879891 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1258/2522] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:37 2022] POST /identity/v3/projects => generated 373 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:37.884542 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707c5c7-65ae-4963-9b29-c5733f5630e6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:37.895300 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0707c5c7-65ae-4963-9b29-c5733f5630e6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:37.962957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec10ef-5fb9-45a8-8d66-042866866bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:37.963584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec10ef-5fb9-45a8-8d66-042866866bfc admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:37.963916 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec10ef-5fb9-45a8-8d66-042866866bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:37.964208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ec10ef-5fb9-45a8-8d66-042866866bfc admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:37.965020 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec10ef-5fb9-45a8-8d66-042866866bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:37.967286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ec10ef-5fb9-45a8-8d66-042866866bfc admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:37.990456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1265/2523] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:37 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:37.994662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c1d12-91aa-4217-bab7-e46a4287d389 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:38.006423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c1d12-91aa-4217-bab7-e46a4287d389 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:38.011201 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9a0f1-83d6-40bd-bc6c-65df1ff9fb3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:38.011887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9a0f1-83d6-40bd-bc6c-65df1ff9fb3a admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:38.012169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9a0f1-83d6-40bd-bc6c-65df1ff9fb3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:38.013095 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb9a0f1-83d6-40bd-bc6c-65df1ff9fb3a admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:38.013753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9a0f1-83d6-40bd-bc6c-65df1ff9fb3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:38.015376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb9a0f1-83d6-40bd-bc6c-65df1ff9fb3a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:38.026139 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1259/2524] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:37 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:38.030354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec10ef-5fb9-45a8-8d66-042866866bfc admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:38.040895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ec10ef-5fb9-45a8-8d66-042866866bfc admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:38.046386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7ca70-353b-4860-96a0-cefe37121f2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:38.047031 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7ca70-353b-4860-96a0-cefe37121f2b admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:38.047307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7ca70-353b-4860-96a0-cefe37121f2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:38.047571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7ca70-353b-4860-96a0-cefe37121f2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:38.048285 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7ca70-353b-4860-96a0-cefe37121f2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:38.049949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7ca70-353b-4860-96a0-cefe37121f2b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:38.066011 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1266/2525] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:38 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:38.067694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9a0f1-83d6-40bd-bc6c-65df1ff9fb3a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:38.077869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb9a0f1-83d6-40bd-bc6c-65df1ff9fb3a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:38.083972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c19ac1-2799-4e7e-85ed-0bf4ae762181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:38.084640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c19ac1-2799-4e7e-85ed-0bf4ae762181 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:38.084927 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c19ac1-2799-4e7e-85ed-0bf4ae762181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:38.085201 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c19ac1-2799-4e7e-85ed-0bf4ae762181 admin admin] PATH_INFO: `/v3/projects/3dfc6b99c57941e384bb8704a81ba6d5/users/b1c2d728083d4e8ea2a2e872b2acb548/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:38.101398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c19ac1-2799-4e7e-85ed-0bf4ae762181 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dfc6b99c57941e384bb8704a81ba6d5, user_id=b1c2d728083d4e8ea2a2e872b2acb548, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:38.104084 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c19ac1-2799-4e7e-85ed-0bf4ae762181 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:38.120046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1260/2526] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:38 2022] PUT /identity/v3/projects/3dfc6b99c57941e384bb8704a81ba6d5/users/b1c2d728083d4e8ea2a2e872b2acb548/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:38.131102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa48bfd-93e1-43d5-9247-5d60aebaeb25 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:38.132033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa48bfd-93e1-43d5-9247-5d60aebaeb25 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:38.132315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa48bfd-93e1-43d5-9247-5d60aebaeb25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:38.163200 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0aa48bfd-93e1-43d5-9247-5d60aebaeb25 None None] MFA Rules not processed for user `b1c2d728083d4e8ea2a2e872b2acb548`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:38.164603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0aa48bfd-93e1-43d5-9247-5d60aebaeb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:38.241032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1267/2527] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:38.253889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c19ac1-2799-4e7e-85ed-0bf4ae762181 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:38.256029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-30c19ac1-2799-4e7e-85ed-0bf4ae762181 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:38.297040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa48bfd-93e1-43d5-9247-5d60aebaeb25 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:38.298549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0aa48bfd-93e1-43d5-9247-5d60aebaeb25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:38.344551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c19ac1-2799-4e7e-85ed-0bf4ae762181 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:38.350544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a711ac4-1c65-42bb-9b94-9cc8cdbd04c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:38.351310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a711ac4-1c65-42bb-9b94-9cc8cdbd04c2 service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:38.351621 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a711ac4-1c65-42bb-9b94-9cc8cdbd04c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:38.351841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a711ac4-1c65-42bb-9b94-9cc8cdbd04c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:38.360578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a711ac4-1c65-42bb-9b94-9cc8cdbd04c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:38.362213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a711ac4-1c65-42bb-9b94-9cc8cdbd04c2 service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:38.369312 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa48bfd-93e1-43d5-9247-5d60aebaeb25 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:38.372332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1261/2528] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:38.374126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:38.374768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:38.375049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:38.375324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] PATH_INFO: `/v3/users/1903b47b542841228a5fa922b14a178c` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:38.376482 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1903b47b542841228a5fa922b14a178c)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:38.378604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:38.389526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:38.442003 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1903b47b542841228a5fa922b14a178c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:38.451827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1903b47b542841228a5fa922b14a178c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:38.452619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1903b47b542841228a5fa922b14a178c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:38.453250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1903b47b542841228a5fa922b14a178c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:38.461255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1903b47b542841228a5fa922b14a178c'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:38.483013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1268/2529] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:38 2022] DELETE /identity/v3/users/1903b47b542841228a5fa922b14a178c => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:38.487362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5021553-9f70-492e-bbc9-05af9b39ac33 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:38.487671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5021553-9f70-492e-bbc9-05af9b39ac33 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:38.487943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5021553-9f70-492e-bbc9-05af9b39ac33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:38.507890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-d5021553-9f70-492e-bbc9-05af9b39ac33 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:38.509145 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d5021553-9f70-492e-bbc9-05af9b39ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:38.554775 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:38.578502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1262/2530] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:38.589077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:38.592705 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:38.601693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5021553-9f70-492e-bbc9-05af9b39ac33 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:38.603155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d5021553-9f70-492e-bbc9-05af9b39ac33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:38.615625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5021553-9f70-492e-bbc9-05af9b39ac33 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:38.620736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:38.621373 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:38.621651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:38.621958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] PATH_INFO: `/v3/users/b1c2d728083d4e8ea2a2e872b2acb548` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:38.623156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1c2d728083d4e8ea2a2e872b2acb548)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:38.625085 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:38.658362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82df136-0cd0-48ee-9956-aad53731cf7d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:38.662958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da690c-8b55-48c5-a07f-d33d83dbe0ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:38.663463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da690c-8b55-48c5-a07f-d33d83dbe0ca service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:38.663750 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da690c-8b55-48c5-a07f-d33d83dbe0ca service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:38.664027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da690c-8b55-48c5-a07f-d33d83dbe0ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:38.675234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da690c-8b55-48c5-a07f-d33d83dbe0ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:38.676789 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da690c-8b55-48c5-a07f-d33d83dbe0ca service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:38.681601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1c2d728083d4e8ea2a2e872b2acb548'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:38.688320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1269/2531] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:38.690868 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1c2d728083d4e8ea2a2e872b2acb548'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:38.691533 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1c2d728083d4e8ea2a2e872b2acb548'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:38.692405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1c2d728083d4e8ea2a2e872b2acb548'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:38.700663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1c2d728083d4e8ea2a2e872b2acb548'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:38.719888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1263/2532] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:38 2022] DELETE /identity/v3/users/b1c2d728083d4e8ea2a2e872b2acb548 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:38.724545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef190ff2-b032-4af9-a688-15ba89232215 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:38.724913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef190ff2-b032-4af9-a688-15ba89232215 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:38.725509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef190ff2-b032-4af9-a688-15ba89232215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:38.746255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-ef190ff2-b032-4af9-a688-15ba89232215 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:38.747666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ef190ff2-b032-4af9-a688-15ba89232215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:38.812513 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1270/2533] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:38.823464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:38.825067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:38.889527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c4c6a-8c32-4e96-8547-f86a671be307 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:38.889834 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c4c6a-8c32-4e96-8547-f86a671be307 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:38.890101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572c4c6a-8c32-4e96-8547-f86a671be307 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:38.907318 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55137ee9-246c-4e16-8091-95a9cdae0256 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:38.909561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-572c4c6a-8c32-4e96-8547-f86a671be307 None None] MFA Rules not processed for user `4189824c9ac64e20bfa13bb44578956d`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:38.910970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-572c4c6a-8c32-4e96-8547-f86a671be307 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:38.912080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cb9fa-9bdb-4b8a-bd05-8f8416501418 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:38.912712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cb9fa-9bdb-4b8a-bd05-8f8416501418 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:38.912990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cb9fa-9bdb-4b8a-bd05-8f8416501418 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:38.913260 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0cb9fa-9bdb-4b8a-bd05-8f8416501418 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:38.923023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cb9fa-9bdb-4b8a-bd05-8f8416501418 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:38.924751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0cb9fa-9bdb-4b8a-bd05-8f8416501418 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:38.935631 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1264/2534] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:38.942621 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:38.978712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1271/2535] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:38 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:24:38.996793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cb9fa-9bdb-4b8a-bd05-8f8416501418 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:38.998594 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9d0cb9fa-9bdb-4b8a-bd05-8f8416501418 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:39.037953 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0cb9fa-9bdb-4b8a-bd05-8f8416501418 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:39.044467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:39.045380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:39.045661 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:39.046099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] PATH_INFO: `/v3/projects/86d6f943234343a9a76d2c51cebe8b8c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:39.047509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86d6f943234343a9a76d2c51cebe8b8c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:39.049833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:39.108505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86d6f943234343a9a76d2c51cebe8b8c', 'request_id': 'req-52fda42b-36ed-4010-8445-f4adbb32b3d8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.117359 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86d6f943234343a9a76d2c51cebe8b8c', 'request_id': 'req-52fda42b-36ed-4010-8445-f4adbb32b3d8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.119380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:39.136531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86d6f943234343a9a76d2c51cebe8b8c', 'request_id': 'req-52fda42b-36ed-4010-8445-f4adbb32b3d8'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.153582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] The token cache is being invalidate because project 86d6f943234343a9a76d2c51cebe8b8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:39.154179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.155048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.156582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1265/2536] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:38 2022] DELETE /identity/v3/projects/86d6f943234343a9a76d2c51cebe8b8c => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:39.161196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c4c6a-8c32-4e96-8547-f86a671be307 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:39.172988 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572c4c6a-8c32-4e96-8547-f86a671be307 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:39.241053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be8caf71-b6ee-40cb-9f8b-481e8f1681ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:39.242249 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8caf71-b6ee-40cb-9f8b-481e8f1681ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:39.242524 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8caf71-b6ee-40cb-9f8b-481e8f1681ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:39.242801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be8caf71-b6ee-40cb-9f8b-481e8f1681ea admin admin] PATH_INFO: `/v3/users/350224ac9abc4e59a3ad5dc9bea3081a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:39.244024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8caf71-b6ee-40cb-9f8b-481e8f1681ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=350224ac9abc4e59a3ad5dc9bea3081a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:39.246375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be8caf71-b6ee-40cb-9f8b-481e8f1681ea admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:39.270579 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:39.272056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:39.292065 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fda42b-36ed-4010-8445-f4adbb32b3d8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:39.307813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be8a392-ea06-4852-8005-0a25012b85f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:39.310902 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8a392-ea06-4852-8005-0a25012b85f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:39.311205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8a392-ea06-4852-8005-0a25012b85f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:39.311479 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be8a392-ea06-4852-8005-0a25012b85f7 admin admin] PATH_INFO: `/v3/projects/3dfc6b99c57941e384bb8704a81ba6d5` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:39.314721 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8a392-ea06-4852-8005-0a25012b85f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dfc6b99c57941e384bb8704a81ba6d5)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:39.317263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be8a392-ea06-4852-8005-0a25012b85f7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:39.334954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-be8caf71-b6ee-40cb-9f8b-481e8f1681ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '350224ac9abc4e59a3ad5dc9bea3081a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.344757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-be8caf71-b6ee-40cb-9f8b-481e8f1681ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '350224ac9abc4e59a3ad5dc9bea3081a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.346585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-be8caf71-b6ee-40cb-9f8b-481e8f1681ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '350224ac9abc4e59a3ad5dc9bea3081a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.347584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-be8caf71-b6ee-40cb-9f8b-481e8f1681ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '350224ac9abc4e59a3ad5dc9bea3081a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.357666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-be8caf71-b6ee-40cb-9f8b-481e8f1681ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '350224ac9abc4e59a3ad5dc9bea3081a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.379842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1272/2537] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:39 2022] DELETE /identity/v3/users/350224ac9abc4e59a3ad5dc9bea3081a => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:39.384184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6be8a392-ea06-4852-8005-0a25012b85f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dfc6b99c57941e384bb8704a81ba6d5', 'request_id': 'req-6be8a392-ea06-4852-8005-0a25012b85f7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.390831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6be8a392-ea06-4852-8005-0a25012b85f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dfc6b99c57941e384bb8704a81ba6d5', 'request_id': 'req-6be8a392-ea06-4852-8005-0a25012b85f7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.400128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6be8a392-ea06-4852-8005-0a25012b85f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dfc6b99c57941e384bb8704a81ba6d5', 'request_id': 'req-6be8a392-ea06-4852-8005-0a25012b85f7'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.411972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6be8a392-ea06-4852-8005-0a25012b85f7 admin admin] The token cache is being invalidate because project 3dfc6b99c57941e384bb8704a81ba6d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:39.412345 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6be8a392-ea06-4852-8005-0a25012b85f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.413071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6be8a392-ea06-4852-8005-0a25012b85f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.414727 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1266/2538] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:39 2022] DELETE /identity/v3/projects/3dfc6b99c57941e384bb8704a81ba6d5 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:39.419882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad5bfc-d3ce-468c-8fa0-e89c5c2c7ff9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:39.420172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad5bfc-d3ce-468c-8fa0-e89c5c2c7ff9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:39.420471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ad5bfc-d3ce-468c-8fa0-e89c5c2c7ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:39.441241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-16ad5bfc-d3ce-468c-8fa0-e89c5c2c7ff9 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:39.442669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-16ad5bfc-d3ce-468c-8fa0-e89c5c2c7ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:39.495666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:39.511872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1273/2539] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:39.522173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bfe7d-89a6-414a-ba94-6d22328d005b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:39.523179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bfe7d-89a6-414a-ba94-6d22328d005b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:39.523781 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1bfe7d-89a6-414a-ba94-6d22328d005b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:39.547582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-5b1bfe7d-89a6-414a-ba94-6d22328d005b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:39.548440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5b1bfe7d-89a6-414a-ba94-6d22328d005b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:39.562446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1267/2540] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:24:39.567196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad5bfc-d3ce-468c-8fa0-e89c5c2c7ff9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:39.579160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ad5bfc-d3ce-468c-8fa0-e89c5c2c7ff9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:39.586469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef27593-679b-439b-97bf-64751ef6054d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:39.587364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef27593-679b-439b-97bf-64751ef6054d admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:39.587883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef27593-679b-439b-97bf-64751ef6054d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:39.588399 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef27593-679b-439b-97bf-64751ef6054d admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:39.590143 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef27593-679b-439b-97bf-64751ef6054d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:24:39.591092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef27593-679b-439b-97bf-64751ef6054d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:39.593615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef27593-679b-439b-97bf-64751ef6054d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:39.615741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1274/2541] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:24:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:24:39.623757 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bfe7d-89a6-414a-ba94-6d22328d005b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:39.654856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1bfe7d-89a6-414a-ba94-6d22328d005b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:39.667909 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e1a6c-16ad-4c47-9fe6-e899a3375807 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:39.668700 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e1a6c-16ad-4c47-9fe6-e899a3375807 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:39.668807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e1a6c-16ad-4c47-9fe6-e899a3375807 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:39.669139 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12e1a6c-16ad-4c47-9fe6-e899a3375807 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:39.669692 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e1a6c-16ad-4c47-9fe6-e899a3375807 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:39.671784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12e1a6c-16ad-4c47-9fe6-e899a3375807 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:39.712695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1268/2542] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:39 2022] POST /identity/v3/projects => generated 365 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:39.715104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef27593-679b-439b-97bf-64751ef6054d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:39.728060 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef27593-679b-439b-97bf-64751ef6054d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:39.802530 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d9c44-a063-47eb-b53c-aa19276d4714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:39.805136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d9c44-a063-47eb-b53c-aa19276d4714 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:39.805136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d9c44-a063-47eb-b53c-aa19276d4714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:39.805136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d9c44-a063-47eb-b53c-aa19276d4714 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:39.805136 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d9c44-a063-47eb-b53c-aa19276d4714 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:39.807072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d9c44-a063-47eb-b53c-aa19276d4714 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:39.832213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e1a6c-16ad-4c47-9fe6-e899a3375807 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:39.832839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1275/2543] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:39 2022] POST /identity/v3/users => generated 283 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:39.834154 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e12e1a6c-16ad-4c47-9fe6-e899a3375807 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:39.836683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d9c44-a063-47eb-b53c-aa19276d4714 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:39.852268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12e1a6c-16ad-4c47-9fe6-e899a3375807 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:39.854856 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d9c44-a063-47eb-b53c-aa19276d4714 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:39.857266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f6db8a-e55c-427a-99db-2de8e38735c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:39.858033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6db8a-e55c-427a-99db-2de8e38735c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:39.858316 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6db8a-e55c-427a-99db-2de8e38735c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:39.858791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f6db8a-e55c-427a-99db-2de8e38735c9 admin admin] PATH_INFO: `/v3/projects/c42f989f756546bf896a0006dc7a25b3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:39.859947 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6db8a-e55c-427a-99db-2de8e38735c9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c42f989f756546bf896a0006dc7a25b3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:39.860967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359c11c-8ed1-4416-b253-e8e8f4e51f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:39.861962 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359c11c-8ed1-4416-b253-e8e8f4e51f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:39.862124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f6db8a-e55c-427a-99db-2de8e38735c9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:39.862255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359c11c-8ed1-4416-b253-e8e8f4e51f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:39.862507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359c11c-8ed1-4416-b253-e8e8f4e51f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:39.863157 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359c11c-8ed1-4416-b253-e8e8f4e51f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:39.865241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359c11c-8ed1-4416-b253-e8e8f4e51f92 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:39.881500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1276/2544] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:39.883043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359c11c-8ed1-4416-b253-e8e8f4e51f92 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:39.894848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359c11c-8ed1-4416-b253-e8e8f4e51f92 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:39.900581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8b5b4-9721-4c6b-a4e8-349f4a5373b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:39.901286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8b5b4-9721-4c6b-a4e8-349f4a5373b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:39.901634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8b5b4-9721-4c6b-a4e8-349f4a5373b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:39.902093 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f8b5b4-9721-4c6b-a4e8-349f4a5373b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:39.902749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8b5b4-9721-4c6b-a4e8-349f4a5373b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:39.904355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f8b5b4-9721-4c6b-a4e8-349f4a5373b8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:39.917771 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1277/2545] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:39.921388 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63f6db8a-e55c-427a-99db-2de8e38735c9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c42f989f756546bf896a0006dc7a25b3', 'request_id': 'req-63f6db8a-e55c-427a-99db-2de8e38735c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.922713 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8b5b4-9721-4c6b-a4e8-349f4a5373b8 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:39.931362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63f6db8a-e55c-427a-99db-2de8e38735c9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c42f989f756546bf896a0006dc7a25b3', 'request_id': 'req-63f6db8a-e55c-427a-99db-2de8e38735c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.937747 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f8b5b4-9721-4c6b-a4e8-349f4a5373b8 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:39.941936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63f6db8a-e55c-427a-99db-2de8e38735c9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c42f989f756546bf896a0006dc7a25b3', 'request_id': 'req-63f6db8a-e55c-427a-99db-2de8e38735c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.954986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63f6db8a-e55c-427a-99db-2de8e38735c9 admin admin] The token cache is being invalidate because project c42f989f756546bf896a0006dc7a25b3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:39.955276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63f6db8a-e55c-427a-99db-2de8e38735c9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.955963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63f6db8a-e55c-427a-99db-2de8e38735c9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:39.958077 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1269/2546] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:39 2022] DELETE /identity/v3/projects/c42f989f756546bf896a0006dc7a25b3 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:39.962922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561e9e-faae-4863-9be6-e88209da0c7e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:39.963319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561e9e-faae-4863-9be6-e88209da0c7e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:39.963677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28561e9e-faae-4863-9be6-e88209da0c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:39.985061 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-28561e9e-faae-4863-9be6-e88209da0c7e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:39.986442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-28561e9e-faae-4863-9be6-e88209da0c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:40.004657 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:INSERT=4,keystone:DELETE=17,keystone:SELECT=79 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:40.014885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554faa82-0412-479c-a11b-720a03e5bcc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.015644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554faa82-0412-479c-a11b-720a03e5bcc4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.015959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554faa82-0412-479c-a11b-720a03e5bcc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.016240 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554faa82-0412-479c-a11b-720a03e5bcc4 admin admin] PATH_INFO: `/v3/projects/1055d2863c874341bdefcf51d1f50510/users/001336cfeb8443d6bda647b15ea88ba7/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.034383 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554faa82-0412-479c-a11b-720a03e5bcc4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1055d2863c874341bdefcf51d1f50510, user_id=001336cfeb8443d6bda647b15ea88ba7, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.037076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554faa82-0412-479c-a11b-720a03e5bcc4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.064454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1278/2547] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:39 2022] PUT /identity/v3/projects/1055d2863c874341bdefcf51d1f50510/users/001336cfeb8443d6bda647b15ea88ba7/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:40.067178 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db468d-9d2d-474f-851c-964d5bd301da None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.067510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db468d-9d2d-474f-851c-964d5bd301da None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.068179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2db468d-9d2d-474f-851c-964d5bd301da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.075347 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1270/2548] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:24:40.076528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e694b-d7dc-406c-9131-d75d694ae310 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.076830 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e694b-d7dc-406c-9131-d75d694ae310 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.077167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05e694b-d7dc-406c-9131-d75d694ae310 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.098914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b05e694b-d7dc-406c-9131-d75d694ae310 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:40.100132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b05e694b-d7dc-406c-9131-d75d694ae310 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:40.106237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c2db468d-9d2d-474f-851c-964d5bd301da None None] MFA Rules not processed for user `001336cfeb8443d6bda647b15ea88ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:40.107552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c2db468d-9d2d-474f-851c-964d5bd301da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:40.130620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:40.174466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1271/2549] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:24:40.178923 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e694b-d7dc-406c-9131-d75d694ae310 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.189075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05e694b-d7dc-406c-9131-d75d694ae310 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.190304 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1279/2550] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:40 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:40.192681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db468d-9d2d-474f-851c-964d5bd301da None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.194059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c2db468d-9d2d-474f-851c-964d5bd301da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:40.195055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51285a-578e-475a-93d9-a58b96f7bc67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.195784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51285a-578e-475a-93d9-a58b96f7bc67 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.196070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51285a-578e-475a-93d9-a58b96f7bc67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.196342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a51285a-578e-475a-93d9-a58b96f7bc67 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.196999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51285a-578e-475a-93d9-a58b96f7bc67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:24:40.197297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51285a-578e-475a-93d9-a58b96f7bc67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.198925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a51285a-578e-475a-93d9-a58b96f7bc67 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.210842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2db468d-9d2d-474f-851c-964d5bd301da None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.214209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1272/2551] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:24:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:24:40.218627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51285a-578e-475a-93d9-a58b96f7bc67 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.219286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da77129-fad3-4b00-9409-b3a05487cca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.219968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da77129-fad3-4b00-9409-b3a05487cca2 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.220245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da77129-fad3-4b00-9409-b3a05487cca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.220515 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da77129-fad3-4b00-9409-b3a05487cca2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.221191 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da77129-fad3-4b00-9409-b3a05487cca2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.223456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da77129-fad3-4b00-9409-b3a05487cca2 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.230385 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a51285a-578e-475a-93d9-a58b96f7bc67 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.239482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1aad0-a8b6-4782-9040-3213b1a72123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.239482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1aad0-a8b6-4782-9040-3213b1a72123 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.239794 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1aad0-a8b6-4782-9040-3213b1a72123 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.239991 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d1aad0-a8b6-4782-9040-3213b1a72123 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.240639 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1aad0-a8b6-4782-9040-3213b1a72123 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.242808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d1aad0-a8b6-4782-9040-3213b1a72123 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.257734 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1280/2552] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:40 2022] POST /identity/v3/projects => generated 365 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:40.261650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da77129-fad3-4b00-9409-b3a05487cca2 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.277184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1273/2553] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:40 2022] POST /identity/v3/projects => generated 385 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:40.282963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1aad0-a8b6-4782-9040-3213b1a72123 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.345551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da77129-fad3-4b00-9409-b3a05487cca2 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.351309 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f07cd9-e497-43c8-9eef-c52d16e85785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.352053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f07cd9-e497-43c8-9eef-c52d16e85785 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.352333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f07cd9-e497-43c8-9eef-c52d16e85785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.352601 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f07cd9-e497-43c8-9eef-c52d16e85785 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.352898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d1aad0-a8b6-4782-9040-3213b1a72123 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.353241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f07cd9-e497-43c8-9eef-c52d16e85785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.355420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f07cd9-e497-43c8-9eef-c52d16e85785 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.357817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8826c15-3962-4361-aa62-842436a19507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.358607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8826c15-3962-4361-aa62-842436a19507 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.358940 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8826c15-3962-4361-aa62-842436a19507 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.359292 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8826c15-3962-4361-aa62-842436a19507 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.359863 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8826c15-3962-4361-aa62-842436a19507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.361817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8826c15-3962-4361-aa62-842436a19507 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.381389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1281/2554] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:40 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:40.386127 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f07cd9-e497-43c8-9eef-c52d16e85785 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.393804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1274/2555] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:40 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:40.398626 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8826c15-3962-4361-aa62-842436a19507 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.401325 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f07cd9-e497-43c8-9eef-c52d16e85785 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.406916 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8332b-73a7-49e0-b24a-5f71fa3251d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.407606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8332b-73a7-49e0-b24a-5f71fa3251d5 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.407962 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8332b-73a7-49e0-b24a-5f71fa3251d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.408243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb8332b-73a7-49e0-b24a-5f71fa3251d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.409044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8332b-73a7-49e0-b24a-5f71fa3251d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.410051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8826c15-3962-4361-aa62-842436a19507 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.410832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb8332b-73a7-49e0-b24a-5f71fa3251d5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.415691 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36487589-f4cd-433d-9590-b2830587924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.416338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36487589-f4cd-433d-9590-b2830587924d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.416610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36487589-f4cd-433d-9590-b2830587924d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.416875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36487589-f4cd-433d-9590-b2830587924d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.417549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36487589-f4cd-433d-9590-b2830587924d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.419203 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36487589-f4cd-433d-9590-b2830587924d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.422972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1282/2556] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:40.428469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8332b-73a7-49e0-b24a-5f71fa3251d5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.431386 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1275/2557] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:40.435051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36487589-f4cd-433d-9590-b2830587924d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.439292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb8332b-73a7-49e0-b24a-5f71fa3251d5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.443968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:40.445526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6f3fc-b364-4576-b772-e656dde56e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.446287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6f3fc-b364-4576-b772-e656dde56e26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.446650 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6f3fc-b364-4576-b772-e656dde56e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.446919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d6f3fc-b364-4576-b772-e656dde56e26 admin admin] PATH_INFO: `/v3/projects/3f4ca2c135e4496a9774029fe5203c09/users/e32958cc1bb94766b34442813b2fa3bf/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.448765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36487589-f4cd-433d-9590-b2830587924d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.456114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c5b2-615c-40e4-bc7d-19b5dda6b62d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.457736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c5b2-615c-40e4-bc7d-19b5dda6b62d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.457736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c5b2-615c-40e4-bc7d-19b5dda6b62d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.458056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3098c5b2-615c-40e4-bc7d-19b5dda6b62d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.459322 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098c5b2-615c-40e4-bc7d-19b5dda6b62d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.461159 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3098c5b2-615c-40e4-bc7d-19b5dda6b62d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.465927 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6f3fc-b364-4576-b772-e656dde56e26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4ca2c135e4496a9774029fe5203c09, user_id=e32958cc1bb94766b34442813b2fa3bf, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.468850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d6f3fc-b364-4576-b772-e656dde56e26 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.474842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1276/2558] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:40.479899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c5b2-615c-40e4-bc7d-19b5dda6b62d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.484693 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1283/2559] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:40 2022] PUT /identity/v3/projects/3f4ca2c135e4496a9774029fe5203c09/users/e32958cc1bb94766b34442813b2fa3bf/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:40.489104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6f3fc-b364-4576-b772-e656dde56e26 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.491715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3098c5b2-615c-40e4-bc7d-19b5dda6b62d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.556496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10f4cba-e7ec-4915-b9e2-bba2f5082d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.557310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f4cba-e7ec-4915-b9e2-bba2f5082d34 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.557527 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f4cba-e7ec-4915-b9e2-bba2f5082d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.557917 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f4cba-e7ec-4915-b9e2-bba2f5082d34 admin admin] PATH_INFO: `/v3/projects/d40e47bc5e3f45e39f2ed735b7144d3e/users/60a6825803ff438ab0e33899fc9028c9/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.561957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:40.568802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d6f3fc-b364-4576-b772-e656dde56e26 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.574053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56a284-8214-41e2-98ef-d1c5818d6476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.574868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56a284-8214-41e2-98ef-d1c5818d6476 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.575048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f4cba-e7ec-4915-b9e2-bba2f5082d34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d40e47bc5e3f45e39f2ed735b7144d3e, user_id=60a6825803ff438ab0e33899fc9028c9, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.575216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56a284-8214-41e2-98ef-d1c5818d6476 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.575395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f56a284-8214-41e2-98ef-d1c5818d6476 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.576037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56a284-8214-41e2-98ef-d1c5818d6476 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.577613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b10f4cba-e7ec-4915-b9e2-bba2f5082d34 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.577749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f56a284-8214-41e2-98ef-d1c5818d6476 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.592507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1284/2560] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:40.593706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56a284-8214-41e2-98ef-d1c5818d6476 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.594207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1277/2561] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:40 2022] PUT /identity/v3/projects/d40e47bc5e3f45e39f2ed735b7144d3e/users/60a6825803ff438ab0e33899fc9028c9/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:40.605662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056c5b0-fdc4-43e8-a0d6-373ac461cdd6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.606020 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056c5b0-fdc4-43e8-a0d6-373ac461cdd6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.606295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2056c5b0-fdc4-43e8-a0d6-373ac461cdd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.608453 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f56a284-8214-41e2-98ef-d1c5818d6476 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.636769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-2056c5b0-fdc4-43e8-a0d6-373ac461cdd6 None None] MFA Rules not processed for user `60a6825803ff438ab0e33899fc9028c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:40.638066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2056c5b0-fdc4-43e8-a0d6-373ac461cdd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:40.671555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436f105a-cf4b-4baf-a025-284009b4c3af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.672223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f105a-cf4b-4baf-a025-284009b4c3af admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.672497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f105a-cf4b-4baf-a025-284009b4c3af admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.672769 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436f105a-cf4b-4baf-a025-284009b4c3af admin admin] PATH_INFO: `/v3/projects/3f4ca2c135e4496a9774029fe5203c09/users/e32958cc1bb94766b34442813b2fa3bf/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.675401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f105a-cf4b-4baf-a025-284009b4c3af admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4ca2c135e4496a9774029fe5203c09, user_id=e32958cc1bb94766b34442813b2fa3bf, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.678362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436f105a-cf4b-4baf-a025-284009b4c3af admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.689732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1285/2562] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:40 2022] PUT /identity/v3/projects/3f4ca2c135e4496a9774029fe5203c09/users/e32958cc1bb94766b34442813b2fa3bf/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:40.700266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a7d57-c657-4479-8803-6526f44810b7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.700590 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a7d57-c657-4479-8803-6526f44810b7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.700845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6a7d57-c657-4479-8803-6526f44810b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.712583 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1278/2563] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:40.717247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056c5b0-fdc4-43e8-a0d6-373ac461cdd6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.728275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2056c5b0-fdc4-43e8-a0d6-373ac461cdd6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.731610 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-bd6a7d57-c657-4479-8803-6526f44810b7 None None] MFA Rules not processed for user `e32958cc1bb94766b34442813b2fa3bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:40.732822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bd6a7d57-c657-4479-8803-6526f44810b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:40.790971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf85413-4d29-46f3-bac6-c2dc21e10aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.791857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf85413-4d29-46f3-bac6-c2dc21e10aef admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.792071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf85413-4d29-46f3-bac6-c2dc21e10aef admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.792338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf85413-4d29-46f3-bac6-c2dc21e10aef admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.793053 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf85413-4d29-46f3-bac6-c2dc21e10aef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.795010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf85413-4d29-46f3-bac6-c2dc21e10aef admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.809822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1286/2564] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:40 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:24:40.815512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:40.824140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a7d57-c657-4479-8803-6526f44810b7 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.826152 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bd6a7d57-c657-4479-8803-6526f44810b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:40.843862 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1279/2565] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:40 2022] POST /identity/v3/projects => generated 387 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:40.849838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf85413-4d29-46f3-bac6-c2dc21e10aef admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:40.935203 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6a7d57-c657-4479-8803-6526f44810b7 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.947188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf85413-4d29-46f3-bac6-c2dc21e10aef admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:40.955501 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00982a-682c-49e6-9936-6c6bb5573404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:40.957746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00982a-682c-49e6-9936-6c6bb5573404 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:40.958463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00982a-682c-49e6-9936-6c6bb5573404 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:40.959796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f00982a-682c-49e6-9936-6c6bb5573404 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:40.960798 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00982a-682c-49e6-9936-6c6bb5573404 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:40.964668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f00982a-682c-49e6-9936-6c6bb5573404 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:40.971181 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:40.996531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1280/2566] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:40 2022] POST /identity/v3/users => generated 300 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:41.000409 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00982a-682c-49e6-9936-6c6bb5573404 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:41.020972 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f00982a-682c-49e6-9936-6c6bb5573404 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:41.025248 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a61aa-950d-40c0-b83e-e40889a1a27a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:41.025931 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a61aa-950d-40c0-b83e-e40889a1a27a service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:41.026206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a61aa-950d-40c0-b83e-e40889a1a27a service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:41.026481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a61aa-950d-40c0-b83e-e40889a1a27a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:41.028030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40751a1-d380-4cae-b0dd-b1cb67822390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:41.028676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40751a1-d380-4cae-b0dd-b1cb67822390 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:41.029140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40751a1-d380-4cae-b0dd-b1cb67822390 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:41.029422 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40751a1-d380-4cae-b0dd-b1cb67822390 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:41.030122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40751a1-d380-4cae-b0dd-b1cb67822390 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:41.031808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40751a1-d380-4cae-b0dd-b1cb67822390 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:41.052251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1281/2567] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:40 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:41.057169 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40751a1-d380-4cae-b0dd-b1cb67822390 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:41.074636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40751a1-d380-4cae-b0dd-b1cb67822390 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:41.079928 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cdea1-5c0c-49a4-9dc9-edb4e3b34d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:41.080619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cdea1-5c0c-49a4-9dc9-edb4e3b34d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:41.080899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cdea1-5c0c-49a4-9dc9-edb4e3b34d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:41.081552 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482cdea1-5c0c-49a4-9dc9-edb4e3b34d2a admin admin] PATH_INFO: `/v3/projects/8c455a5d370d4c8681e73a324f780cd1/users/4b2a4d8ddc3e46fc8d51be348a66ed50/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:41.102760 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cdea1-5c0c-49a4-9dc9-edb4e3b34d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c455a5d370d4c8681e73a324f780cd1, user_id=4b2a4d8ddc3e46fc8d51be348a66ed50, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:41.105512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482cdea1-5c0c-49a4-9dc9-edb4e3b34d2a admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:41.126497 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1282/2568] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:41 2022] PUT /identity/v3/projects/8c455a5d370d4c8681e73a324f780cd1/users/4b2a4d8ddc3e46fc8d51be348a66ed50/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:41.131150 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cdea1-5c0c-49a4-9dc9-edb4e3b34d2a admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:41.133445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a61aa-950d-40c0-b83e-e40889a1a27a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:41.135097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a61aa-950d-40c0-b83e-e40889a1a27a service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:41.147266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1287/2569] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:40 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:41.219512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482cdea1-5c0c-49a4-9dc9-edb4e3b34d2a admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:41.227547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c44bb2-047a-4f50-a6f4-ed101b3710a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:41.228313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c44bb2-047a-4f50-a6f4-ed101b3710a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:41.228669 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c44bb2-047a-4f50-a6f4-ed101b3710a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:41.229144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c44bb2-047a-4f50-a6f4-ed101b3710a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:41.230104 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c44bb2-047a-4f50-a6f4-ed101b3710a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:41.231938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c44bb2-047a-4f50-a6f4-ed101b3710a3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:41.245970 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1283/2570] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:41 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:41.250228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a61aa-950d-40c0-b83e-e40889a1a27a service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:41.270443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a61aa-950d-40c0-b83e-e40889a1a27a service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:41.276121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d43155-ea7f-4549-a131-45dbe5d8a506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:41.278845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d43155-ea7f-4549-a131-45dbe5d8a506 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:41.278845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d43155-ea7f-4549-a131-45dbe5d8a506 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:41.278845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d43155-ea7f-4549-a131-45dbe5d8a506 admin admin] PATH_INFO: `/v3/projects/8c455a5d370d4c8681e73a324f780cd1/users/4b2a4d8ddc3e46fc8d51be348a66ed50/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:41.284134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d43155-ea7f-4549-a131-45dbe5d8a506 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c455a5d370d4c8681e73a324f780cd1, user_id=4b2a4d8ddc3e46fc8d51be348a66ed50, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:41.287091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d43155-ea7f-4549-a131-45dbe5d8a506 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:41.316188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1288/2571] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:41 2022] PUT /identity/v3/projects/8c455a5d370d4c8681e73a324f780cd1/users/4b2a4d8ddc3e46fc8d51be348a66ed50/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:41.329835 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233daa53-ea97-4f29-b12e-4086faee48d0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:41.330156 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233daa53-ea97-4f29-b12e-4086faee48d0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:41.330491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233daa53-ea97-4f29-b12e-4086faee48d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:41.371567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-233daa53-ea97-4f29-b12e-4086faee48d0 None None] MFA Rules not processed for user `4b2a4d8ddc3e46fc8d51be348a66ed50`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:41.373352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-233daa53-ea97-4f29-b12e-4086faee48d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:41.421724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:41.478205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1284/2572] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:24:41.494507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d43155-ea7f-4549-a131-45dbe5d8a506 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:41.496497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-05d43155-ea7f-4549-a131-45dbe5d8a506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:41.587604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d43155-ea7f-4549-a131-45dbe5d8a506 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:41.592274 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477ee70-7b36-4ed1-9365-dfb19d7be5a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:41.593019 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ee70-7b36-4ed1-9365-dfb19d7be5a5 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:41.593307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ee70-7b36-4ed1-9365-dfb19d7be5a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:41.593582 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4477ee70-7b36-4ed1-9365-dfb19d7be5a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:41.605577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477ee70-7b36-4ed1-9365-dfb19d7be5a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:41.607172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4477ee70-7b36-4ed1-9365-dfb19d7be5a5 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:41.618533 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1289/2573] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:41.712032 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477ee70-7b36-4ed1-9365-dfb19d7be5a5 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:41.712172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233daa53-ea97-4f29-b12e-4086faee48d0 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:41.788814 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233daa53-ea97-4f29-b12e-4086faee48d0 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:41.789908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4477ee70-7b36-4ed1-9365-dfb19d7be5a5 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:41.794841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7842ef-4350-4054-84af-5fbe0bc1c62f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:41.795672 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7842ef-4350-4054-84af-5fbe0bc1c62f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:41.795835 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cf0bb65-3036-4483-b693-0e1b45737d6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:41.795953 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7842ef-4350-4054-84af-5fbe0bc1c62f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:41.796223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0bb65-3036-4483-b693-0e1b45737d6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:41.796467 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7842ef-4350-4054-84af-5fbe0bc1c62f admin admin] PATH_INFO: `/v3/users/60a6825803ff438ab0e33899fc9028c9` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:41.796567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0bb65-3036-4483-b693-0e1b45737d6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:41.796957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cf0bb65-3036-4483-b693-0e1b45737d6b admin admin] PATH_INFO: `/v3/users/001336cfeb8443d6bda647b15ea88ba7` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:41.797617 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7842ef-4350-4054-84af-5fbe0bc1c62f admin admin] RBAC: Authorizing `identity:delete_user(user_id=60a6825803ff438ab0e33899fc9028c9)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:41.798110 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0bb65-3036-4483-b693-0e1b45737d6b admin admin] RBAC: Authorizing `identity:delete_user(user_id=001336cfeb8443d6bda647b15ea88ba7)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:41.800186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cf0bb65-3036-4483-b693-0e1b45737d6b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:41.800680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7842ef-4350-4054-84af-5fbe0bc1c62f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:41.807525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:41.870255 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9b7842ef-4350-4054-84af-5fbe0bc1c62f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60a6825803ff438ab0e33899fc9028c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:41.875049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9cf0bb65-3036-4483-b693-0e1b45737d6b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '001336cfeb8443d6bda647b15ea88ba7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:41.882083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9b7842ef-4350-4054-84af-5fbe0bc1c62f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60a6825803ff438ab0e33899fc9028c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:41.882748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9b7842ef-4350-4054-84af-5fbe0bc1c62f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60a6825803ff438ab0e33899fc9028c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:41.883341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9b7842ef-4350-4054-84af-5fbe0bc1c62f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60a6825803ff438ab0e33899fc9028c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:41.891098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9cf0bb65-3036-4483-b693-0e1b45737d6b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '001336cfeb8443d6bda647b15ea88ba7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:41.892460 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9cf0bb65-3036-4483-b693-0e1b45737d6b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '001336cfeb8443d6bda647b15ea88ba7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:41.893181 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9cf0bb65-3036-4483-b693-0e1b45737d6b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '001336cfeb8443d6bda647b15ea88ba7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:41.893414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9b7842ef-4350-4054-84af-5fbe0bc1c62f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60a6825803ff438ab0e33899fc9028c9'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:41.903668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-9cf0bb65-3036-4483-b693-0e1b45737d6b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '001336cfeb8443d6bda647b15ea88ba7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:41.920907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1285/2574] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:41 2022] DELETE /identity/v3/users/60a6825803ff438ab0e33899fc9028c9 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:41.925099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96152d4-e07d-4f9a-ac4e-a0d1937908f9 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:41.926001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96152d4-e07d-4f9a-ac4e-a0d1937908f9 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:41.927114 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96152d4-e07d-4f9a-ac4e-a0d1937908f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:41.934833 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1290/2575] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:41 2022] DELETE /identity/v3/users/001336cfeb8443d6bda647b15ea88ba7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:41.939868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9882b-6bb0-43b7-894c-e22b6783cdf6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:41.940580 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9882b-6bb0-43b7-894c-e22b6783cdf6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:41.940580 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d9882b-6bb0-43b7-894c-e22b6783cdf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:41.958515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e96152d4-e07d-4f9a-ac4e-a0d1937908f9 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:41.960368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e96152d4-e07d-4f9a-ac4e-a0d1937908f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:41.964756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-14d9882b-6bb0-43b7-894c-e22b6783cdf6 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:41.967620 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-14d9882b-6bb0-43b7-894c-e22b6783cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:42.016986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:42.044490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1286/2576] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:42.047210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1291/2577] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:42.054079 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96152d4-e07d-4f9a-ac4e-a0d1937908f9 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:42.055811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e96152d4-e07d-4f9a-ac4e-a0d1937908f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:42.057907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9882b-6bb0-43b7-894c-e22b6783cdf6 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:42.059647 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-14d9882b-6bb0-43b7-894c-e22b6783cdf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:42.121041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d9882b-6bb0-43b7-894c-e22b6783cdf6 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:42.125593 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96152d4-e07d-4f9a-ac4e-a0d1937908f9 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:42.126495 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e48231-ebaf-4c48-8044-209f7b13a9e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:42.127410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e48231-ebaf-4c48-8044-209f7b13a9e4 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:42.127410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e48231-ebaf-4c48-8044-209f7b13a9e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:42.127653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e48231-ebaf-4c48-8044-209f7b13a9e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:42.131351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e631723-91f7-42ed-a8e4-6df10b449d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:42.132245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e631723-91f7-42ed-a8e4-6df10b449d7b service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:42.132623 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e631723-91f7-42ed-a8e4-6df10b449d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:42.132996 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e631723-91f7-42ed-a8e4-6df10b449d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:42.137697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e48231-ebaf-4c48-8044-209f7b13a9e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:42.139024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e48231-ebaf-4c48-8044-209f7b13a9e4 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:42.144043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e631723-91f7-42ed-a8e4-6df10b449d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:42.145893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e631723-91f7-42ed-a8e4-6df10b449d7b service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:42.150047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1292/2578] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:24:42.161990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1287/2579] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:42.564775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e48231-ebaf-4c48-8044-209f7b13a9e4 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:42.566559 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-99e48231-ebaf-4c48-8044-209f7b13a9e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:42.582305 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e48231-ebaf-4c48-8044-209f7b13a9e4 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:42.587697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:42.588437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:42.588625 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:42.588886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] PATH_INFO: `/v3/projects/1055d2863c874341bdefcf51d1f50510` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:42.590165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1055d2863c874341bdefcf51d1f50510)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:42.592086 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:42.624210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:42.646138 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e631723-91f7-42ed-a8e4-6df10b449d7b service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:42.648595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0e631723-91f7-42ed-a8e4-6df10b449d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:42.659146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1055d2863c874341bdefcf51d1f50510', 'request_id': 'req-3156ba68-c406-4a86-89de-6d2ad6a95362'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.668864 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1055d2863c874341bdefcf51d1f50510', 'request_id': 'req-3156ba68-c406-4a86-89de-6d2ad6a95362'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.671042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e631723-91f7-42ed-a8e4-6df10b449d7b service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:42.681809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1055d2863c874341bdefcf51d1f50510', 'request_id': 'req-3156ba68-c406-4a86-89de-6d2ad6a95362'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.713299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] The token cache is being invalidate because project 1055d2863c874341bdefcf51d1f50510 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:42.713727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.714518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.716623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1293/2580] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:42 2022] DELETE /identity/v3/projects/1055d2863c874341bdefcf51d1f50510 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:42.720704 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:42.722459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:42.763283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:42.763981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:42.764254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:42.764522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] PATH_INFO: `/v3/projects/d40e47bc5e3f45e39f2ed735b7144d3e` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:42.765677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d40e47bc5e3f45e39f2ed735b7144d3e)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:42.768228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:42.822965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156ba68-c406-4a86-89de-6d2ad6a95362 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:42.838350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd40e47bc5e3f45e39f2ed735b7144d3e', 'request_id': 'req-769fd6b7-9c12-496b-984f-79170792e967'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.849191 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd40e47bc5e3f45e39f2ed735b7144d3e', 'request_id': 'req-769fd6b7-9c12-496b-984f-79170792e967'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.867232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd40e47bc5e3f45e39f2ed735b7144d3e', 'request_id': 'req-769fd6b7-9c12-496b-984f-79170792e967'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.890046 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] The token cache is being invalidate because project d40e47bc5e3f45e39f2ed735b7144d3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:42.890513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.891338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.893018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1288/2581] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:42 2022] DELETE /identity/v3/projects/d40e47bc5e3f45e39f2ed735b7144d3e => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:42.896746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:42.897398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:42.897675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:42.898007 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] PATH_INFO: `/v3/users/e32958cc1bb94766b34442813b2fa3bf` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:42.898772 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:42.899144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32958cc1bb94766b34442813b2fa3bf)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:42.900244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:42.901277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:42.913296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769fd6b7-9c12-496b-984f-79170792e967 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:42.918590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8dc8f-8622-4280-9787-322d58792234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:42.919264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8dc8f-8622-4280-9787-322d58792234 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:42.919542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8dc8f-8622-4280-9787-322d58792234 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:42.919841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8dc8f-8622-4280-9787-322d58792234 admin admin] PATH_INFO: `/v3/users/4b2a4d8ddc3e46fc8d51be348a66ed50` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:42.921442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8dc8f-8622-4280-9787-322d58792234 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b2a4d8ddc3e46fc8d51be348a66ed50)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:42.923383 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8dc8f-8622-4280-9787-322d58792234 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:42.939942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:42.956054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32958cc1bb94766b34442813b2fa3bf'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.968438 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32958cc1bb94766b34442813b2fa3bf'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.969324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32958cc1bb94766b34442813b2fa3bf'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.969972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32958cc1bb94766b34442813b2fa3bf'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.977487 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:42.979384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32958cc1bb94766b34442813b2fa3bf'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.986817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a1e8dc8f-8622-4280-9787-322d58792234 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b2a4d8ddc3e46fc8d51be348a66ed50'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.998254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a1e8dc8f-8622-4280-9787-322d58792234 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b2a4d8ddc3e46fc8d51be348a66ed50'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.998982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a1e8dc8f-8622-4280-9787-322d58792234 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b2a4d8ddc3e46fc8d51be348a66ed50'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:42.999671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a1e8dc8f-8622-4280-9787-322d58792234 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b2a4d8ddc3e46fc8d51be348a66ed50'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:43.005259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1294/2582] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:42 2022] DELETE /identity/v3/users/e32958cc1bb94766b34442813b2fa3bf => generated 0 bytes in 285 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:43.009765 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a1e8dc8f-8622-4280-9787-322d58792234 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b2a4d8ddc3e46fc8d51be348a66ed50'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:43.033644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1289/2583] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:42 2022] DELETE /identity/v3/users/4b2a4d8ddc3e46fc8d51be348a66ed50 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:43.320493 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:43.322534 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:43.400244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd8a709-215d-4474-afa9-ee5525b4a377 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:43.466426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4885516-1c3b-467c-bb05-6013f87ffa01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:43.467132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4885516-1c3b-467c-bb05-6013f87ffa01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:43.467410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4885516-1c3b-467c-bb05-6013f87ffa01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:43.467677 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4885516-1c3b-467c-bb05-6013f87ffa01 admin admin] PATH_INFO: `/v3/projects/3f4ca2c135e4496a9774029fe5203c09` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:43.469007 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4885516-1c3b-467c-bb05-6013f87ffa01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4ca2c135e4496a9774029fe5203c09)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:43.471381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4885516-1c3b-467c-bb05-6013f87ffa01 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:43.525537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a4885516-1c3b-467c-bb05-6013f87ffa01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4ca2c135e4496a9774029fe5203c09', 'request_id': 'req-a4885516-1c3b-467c-bb05-6013f87ffa01'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:43.532412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a4885516-1c3b-467c-bb05-6013f87ffa01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4ca2c135e4496a9774029fe5203c09', 'request_id': 'req-a4885516-1c3b-467c-bb05-6013f87ffa01'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:43.541916 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a4885516-1c3b-467c-bb05-6013f87ffa01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4ca2c135e4496a9774029fe5203c09', 'request_id': 'req-a4885516-1c3b-467c-bb05-6013f87ffa01'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:43.554384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a4885516-1c3b-467c-bb05-6013f87ffa01 admin admin] The token cache is being invalidate because project 3f4ca2c135e4496a9774029fe5203c09 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:43.554713 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a4885516-1c3b-467c-bb05-6013f87ffa01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:43.555411 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a4885516-1c3b-467c-bb05-6013f87ffa01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:43.557160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1295/2584] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:43 2022] DELETE /identity/v3/projects/3f4ca2c135e4496a9774029fe5203c09 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:43.564507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1adb3-966c-41b3-a8cd-b7f30d3bae54 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:43.565124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1adb3-966c-41b3-a8cd-b7f30d3bae54 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:43.565251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a1adb3-966c-41b3-a8cd-b7f30d3bae54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:43.589417 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-52a1adb3-966c-41b3-a8cd-b7f30d3bae54 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:43.591029 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-52a1adb3-966c-41b3-a8cd-b7f30d3bae54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:43.670003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1290/2585] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:43.679245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057f02-3645-48a5-b407-3ab2fded8a67 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:43.679522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057f02-3645-48a5-b407-3ab2fded8a67 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:43.679850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3057f02-3645-48a5-b407-3ab2fded8a67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:43.701959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f3057f02-3645-48a5-b407-3ab2fded8a67 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:43.703191 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f3057f02-3645-48a5-b407-3ab2fded8a67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:43.712631 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1296/2586] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:43.716994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1adb3-966c-41b3-a8cd-b7f30d3bae54 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:43.727031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a1adb3-966c-41b3-a8cd-b7f30d3bae54 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:43.733979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e93dc-9041-41f1-8034-e674addc04a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:43.734612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e93dc-9041-41f1-8034-e674addc04a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:43.734906 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e93dc-9041-41f1-8034-e674addc04a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:43.735183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3e93dc-9041-41f1-8034-e674addc04a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:43.735865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e93dc-9041-41f1-8034-e674addc04a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:24:43.736163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e93dc-9041-41f1-8034-e674addc04a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:43.737831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba3e93dc-9041-41f1-8034-e674addc04a2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:43.751016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1291/2587] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:24:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:24:43.755848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057f02-3645-48a5-b407-3ab2fded8a67 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:43.766256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3057f02-3645-48a5-b407-3ab2fded8a67 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:43.771862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716968b-6c8c-40e0-9ab6-693394a1de17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:43.772491 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716968b-6c8c-40e0-9ab6-693394a1de17 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:43.772770 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716968b-6c8c-40e0-9ab6-693394a1de17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:43.773040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e716968b-6c8c-40e0-9ab6-693394a1de17 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:43.773669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716968b-6c8c-40e0-9ab6-693394a1de17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:43.775672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e716968b-6c8c-40e0-9ab6-693394a1de17 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:43.781243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:43.809827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1297/2588] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:43 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:43.813735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e93dc-9041-41f1-8034-e674addc04a2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:43.818333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716968b-6c8c-40e0-9ab6-693394a1de17 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:43.820139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e716968b-6c8c-40e0-9ab6-693394a1de17 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:43.826294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3e93dc-9041-41f1-8034-e674addc04a2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:43.896294 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e716968b-6c8c-40e0-9ab6-693394a1de17 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:43.901092 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:43.901741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:43.902066 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:43.902343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09 admin admin] PATH_INFO: `/v3/projects/8c455a5d370d4c8681e73a324f780cd1` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:43.903486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c455a5d370d4c8681e73a324f780cd1)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:43.904444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300b7f4-0cd8-47ac-a129-780fbf62fba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:43.905063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300b7f4-0cd8-47ac-a129-780fbf62fba1 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:43.905341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300b7f4-0cd8-47ac-a129-780fbf62fba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:43.905610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6300b7f4-0cd8-47ac-a129-780fbf62fba1 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:43.906045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:43.906287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300b7f4-0cd8-47ac-a129-780fbf62fba1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:43.908237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6300b7f4-0cd8-47ac-a129-780fbf62fba1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:43.931097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1292/2589] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:43 2022] POST /identity/v3/users => generated 292 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:43.935586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300b7f4-0cd8-47ac-a129-780fbf62fba1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:43.945974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6300b7f4-0cd8-47ac-a129-780fbf62fba1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:43.950905 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:43.958486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c455a5d370d4c8681e73a324f780cd1', 'request_id': 'req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:43.965880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c455a5d370d4c8681e73a324f780cd1', 'request_id': 'req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:43.976435 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c455a5d370d4c8681e73a324f780cd1', 'request_id': 'req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:43.990540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09 admin admin] The token cache is being invalidate because project 8c455a5d370d4c8681e73a324f780cd1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:43.990991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:43.991723 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-5895fe24-7bf5-4a9c-b0d1-6dfa15b20e09 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:43.993521 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1298/2590] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:43 2022] DELETE /identity/v3/projects/8c455a5d370d4c8681e73a324f780cd1 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:43.998193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be0c80-fc44-4d83-a215-1939a3650bcb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:43.998474 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be0c80-fc44-4d83-a215-1939a3650bcb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:43.998773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7be0c80-fc44-4d83-a215-1939a3650bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.015580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc67f82-46a1-4018-9f19-af6bbd65fe22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.016353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc67f82-46a1-4018-9f19-af6bbd65fe22 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.016632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc67f82-46a1-4018-9f19-af6bbd65fe22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.016904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc67f82-46a1-4018-9f19-af6bbd65fe22 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.017560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc67f82-46a1-4018-9f19-af6bbd65fe22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.019117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c7be0c80-fc44-4d83-a215-1939a3650bcb None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:44.019252 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc67f82-46a1-4018-9f19-af6bbd65fe22 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.020400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c7be0c80-fc44-4d83-a215-1939a3650bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:44.028293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1299/2591] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:24:44.032376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1293/2592] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:43 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:44.035646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be0c80-fc44-4d83-a215-1939a3650bcb None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.035901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0e17-fea0-474c-a1d0-77990e9624ce None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.036289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0e17-fea0-474c-a1d0-77990e9624ce None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.036578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b0e17-fea0-474c-a1d0-77990e9624ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.037013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c7be0c80-fc44-4d83-a215-1939a3650bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:44.049408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7be0c80-fc44-4d83-a215-1939a3650bcb None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.054766 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d080a-c55a-4c4c-917c-6a59a3794ad8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.055455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d080a-c55a-4c4c-917c-6a59a3794ad8 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.055732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d080a-c55a-4c4c-917c-6a59a3794ad8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.056002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26d080a-c55a-4c4c-917c-6a59a3794ad8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.056667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d080a-c55a-4c4c-917c-6a59a3794ad8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.057045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6d4b0e17-fea0-474c-a1d0-77990e9624ce None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:44.058412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26d080a-c55a-4c4c-917c-6a59a3794ad8 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.058527 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6d4b0e17-fea0-474c-a1d0-77990e9624ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:44.068413 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1294/2593] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:24:44.070334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1300/2594] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:44.072635 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0e17-fea0-474c-a1d0-77990e9624ce None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.074466 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d080a-c55a-4c4c-917c-6a59a3794ad8 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.083869 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4b0e17-fea0-474c-a1d0-77990e9624ce None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.086106 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26d080a-c55a-4c4c-917c-6a59a3794ad8 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.089490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce2350-f9ba-4727-987f-973b9791ed56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.090171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce2350-f9ba-4727-987f-973b9791ed56 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.090449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce2350-f9ba-4727-987f-973b9791ed56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.090718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ce2350-f9ba-4727-987f-973b9791ed56 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.091376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce2350-f9ba-4727-987f-973b9791ed56 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:24:44.091553 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a34280a-1108-4d2d-be0c-db2d70010739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.091664 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce2350-f9ba-4727-987f-973b9791ed56 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.092210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34280a-1108-4d2d-be0c-db2d70010739 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.092486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34280a-1108-4d2d-be0c-db2d70010739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.092750 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a34280a-1108-4d2d-be0c-db2d70010739 admin admin] PATH_INFO: `/v3/projects/6bd38eaabfa3455c944cccfd998b3199/users/a9277d7147284730a1674d8bff0dd33b/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.093280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ce2350-f9ba-4727-987f-973b9791ed56 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.106335 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1295/2595] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:24:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:24:44.110647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce2350-f9ba-4727-987f-973b9791ed56 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.111402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34280a-1108-4d2d-be0c-db2d70010739 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6bd38eaabfa3455c944cccfd998b3199, user_id=a9277d7147284730a1674d8bff0dd33b, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.114448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a34280a-1108-4d2d-be0c-db2d70010739 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.121883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ce2350-f9ba-4727-987f-973b9791ed56 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.127334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995fbc-7ab3-402c-8d98-a7bc82885aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.128097 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995fbc-7ab3-402c-8d98-a7bc82885aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.128375 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995fbc-7ab3-402c-8d98-a7bc82885aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.128645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25995fbc-7ab3-402c-8d98-a7bc82885aa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.129332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25995fbc-7ab3-402c-8d98-a7bc82885aa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.131254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25995fbc-7ab3-402c-8d98-a7bc82885aa7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.131476 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1301/2596] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:44 2022] PUT /identity/v3/projects/6bd38eaabfa3455c944cccfd998b3199/users/a9277d7147284730a1674d8bff0dd33b/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:44.141907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1353c4-f1e5-4394-8ec5-4a129275a2d3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.142189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1353c4-f1e5-4394-8ec5-4a129275a2d3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.142454 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1353c4-f1e5-4394-8ec5-4a129275a2d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.166123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1296/2597] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:44 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:44.167933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995fbc-7ab3-402c-8d98-a7bc82885aa7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.173245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7f1353c4-f1e5-4394-8ec5-4a129275a2d3 None None] MFA Rules not processed for user `a9277d7147284730a1674d8bff0dd33b`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:44.174525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7f1353c4-f1e5-4394-8ec5-4a129275a2d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:44.199245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:44.238502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25995fbc-7ab3-402c-8d98-a7bc82885aa7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.243807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceb2ce-d7a2-40c4-859c-64c3388b7844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.244428 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceb2ce-d7a2-40c4-859c-64c3388b7844 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.244707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceb2ce-d7a2-40c4-859c-64c3388b7844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.244979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ceb2ce-d7a2-40c4-859c-64c3388b7844 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.245625 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceb2ce-d7a2-40c4-859c-64c3388b7844 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.245747 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1302/2598] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:44 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:24:44.247618 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ceb2ce-d7a2-40c4-859c-64c3388b7844 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.250366 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1353c4-f1e5-4394-8ec5-4a129275a2d3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.262271 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1353c4-f1e5-4394-8ec5-4a129275a2d3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.267960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c4297-18cd-4ef2-a177-3764ccc5d7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.268583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c4297-18cd-4ef2-a177-3764ccc5d7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.268846 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c4297-18cd-4ef2-a177-3764ccc5d7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.269122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176c4297-18cd-4ef2-a177-3764ccc5d7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.270019 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c4297-18cd-4ef2-a177-3764ccc5d7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.271867 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176c4297-18cd-4ef2-a177-3764ccc5d7a7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.275680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1297/2599] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:44 2022] POST /identity/v3/users => generated 286 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:44.276922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceb2ce-d7a2-40c4-859c-64c3388b7844 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.287073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ceb2ce-d7a2-40c4-859c-64c3388b7844 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.292695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb36b-8b83-46c2-86e4-5386f7ca3da8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.293380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb36b-8b83-46c2-86e4-5386f7ca3da8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.293751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb36b-8b83-46c2-86e4-5386f7ca3da8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.293993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523cb36b-8b83-46c2-86e4-5386f7ca3da8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.294831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cb36b-8b83-46c2-86e4-5386f7ca3da8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.296507 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523cb36b-8b83-46c2-86e4-5386f7ca3da8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.307957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1298/2600] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:44.310446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1303/2601] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:44 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:44.312833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb36b-8b83-46c2-86e4-5386f7ca3da8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.317414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c4297-18cd-4ef2-a177-3764ccc5d7a7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.324540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523cb36b-8b83-46c2-86e4-5386f7ca3da8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.373281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:44.395840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf99fd4-8e10-422b-9a6e-0db27b9335db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.396486 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf99fd4-8e10-422b-9a6e-0db27b9335db admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.396612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176c4297-18cd-4ef2-a177-3764ccc5d7a7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.396800 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf99fd4-8e10-422b-9a6e-0db27b9335db admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.397032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf99fd4-8e10-422b-9a6e-0db27b9335db admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.397756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf99fd4-8e10-422b-9a6e-0db27b9335db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.399440 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf99fd4-8e10-422b-9a6e-0db27b9335db admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.403569 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf0a16-f24e-4ccb-bd87-04375fa9bb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.404199 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf0a16-f24e-4ccb-bd87-04375fa9bb7a admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.404478 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf0a16-f24e-4ccb-bd87-04375fa9bb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.404743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf0a16-f24e-4ccb-bd87-04375fa9bb7a admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.405923 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf0a16-f24e-4ccb-bd87-04375fa9bb7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.407896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf0a16-f24e-4ccb-bd87-04375fa9bb7a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.411907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1299/2602] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:44.416179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf99fd4-8e10-422b-9a6e-0db27b9335db admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.428407 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf99fd4-8e10-422b-9a6e-0db27b9335db admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.432780 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1304/2603] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:44 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:44.433536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc0e95c-e88e-451b-9b3c-3415a163568f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.434498 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0e95c-e88e-451b-9b3c-3415a163568f admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.434819 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0e95c-e88e-451b-9b3c-3415a163568f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.435293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc0e95c-e88e-451b-9b3c-3415a163568f admin admin] PATH_INFO: `/v3/projects/1762892944f74c6a95922126e454a62f/users/11a32ed239514b8fb6daf9f218603505/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.437219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf0a16-f24e-4ccb-bd87-04375fa9bb7a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.451080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf0a16-f24e-4ccb-bd87-04375fa9bb7a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.453588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0e95c-e88e-451b-9b3c-3415a163568f admin admin] RBAC: Authorizing `identity:create_grant(project_id=1762892944f74c6a95922126e454a62f, user_id=11a32ed239514b8fb6daf9f218603505, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.455777 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73939ca8-701e-407b-8b1a-f33d41105977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.456766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc0e95c-e88e-451b-9b3c-3415a163568f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.456968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73939ca8-701e-407b-8b1a-f33d41105977 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.457135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73939ca8-701e-407b-8b1a-f33d41105977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.457346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73939ca8-701e-407b-8b1a-f33d41105977 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.458049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73939ca8-701e-407b-8b1a-f33d41105977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.459649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73939ca8-701e-407b-8b1a-f33d41105977 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.472395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1305/2604] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:44.474719 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1300/2605] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:44 2022] PUT /identity/v3/projects/1762892944f74c6a95922126e454a62f/users/11a32ed239514b8fb6daf9f218603505/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:44.479214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73939ca8-701e-407b-8b1a-f33d41105977 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.481013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d0346-fc13-4075-8282-77ad09af379d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.481423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d0346-fc13-4075-8282-77ad09af379d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.481696 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44d0346-fc13-4075-8282-77ad09af379d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.492885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73939ca8-701e-407b-8b1a-f33d41105977 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.505459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f44d0346-fc13-4075-8282-77ad09af379d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:44.506989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f44d0346-fc13-4075-8282-77ad09af379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:44.564339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b342a-d4dd-4d19-9ab0-3f8a3b7c39c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.564965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b342a-d4dd-4d19-9ab0-3f8a3b7c39c1 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.565245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b342a-d4dd-4d19-9ab0-3f8a3b7c39c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.565529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b342a-d4dd-4d19-9ab0-3f8a3b7c39c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.566622 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b342a-d4dd-4d19-9ab0-3f8a3b7c39c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.568028 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b342a-d4dd-4d19-9ab0-3f8a3b7c39c1 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.578573 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1306/2606] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:44.586803 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b342a-d4dd-4d19-9ab0-3f8a3b7c39c1 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.589516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1301/2607] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:44.597740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b342a-d4dd-4d19-9ab0-3f8a3b7c39c1 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.601959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d0346-fc13-4075-8282-77ad09af379d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.603634 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f44d0346-fc13-4075-8282-77ad09af379d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:44.604015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e69490-c189-4ef0-a49d-97fe6af2a578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.604745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e69490-c189-4ef0-a49d-97fe6af2a578 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.605025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e69490-c189-4ef0-a49d-97fe6af2a578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.605287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e69490-c189-4ef0-a49d-97fe6af2a578 admin admin] PATH_INFO: `/v3/projects/4b2c38fa08cf4f9dbb7f2e17a1479727/users/e39ec431532641e090732dc8654f7ee5/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.625990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e69490-c189-4ef0-a49d-97fe6af2a578 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b2c38fa08cf4f9dbb7f2e17a1479727, user_id=e39ec431532641e090732dc8654f7ee5, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.629768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e69490-c189-4ef0-a49d-97fe6af2a578 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.633729 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:44.650655 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1307/2608] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:44 2022] PUT /identity/v3/projects/4b2c38fa08cf4f9dbb7f2e17a1479727/users/e39ec431532641e090732dc8654f7ee5/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:44.662996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb79f65-5236-4aeb-8299-5e3ca984a643 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.663498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb79f65-5236-4aeb-8299-5e3ca984a643 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.663617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb79f65-5236-4aeb-8299-5e3ca984a643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.690002 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44d0346-fc13-4075-8282-77ad09af379d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.695996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-dfb79f65-5236-4aeb-8299-5e3ca984a643 None None] MFA Rules not processed for user `e39ec431532641e090732dc8654f7ee5`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:44.697149 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dfb79f65-5236-4aeb-8299-5e3ca984a643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:44.750599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2b91e-4e83-41ef-a19a-57b4f8d2e174 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.751220 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2b91e-4e83-41ef-a19a-57b4f8d2e174 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.751495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2b91e-4e83-41ef-a19a-57b4f8d2e174 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.752500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b2b91e-4e83-41ef-a19a-57b4f8d2e174 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.776282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1308/2609] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:44 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:44.780391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb79f65-5236-4aeb-8299-5e3ca984a643 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.786034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:44.830661 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2b91e-4e83-41ef-a19a-57b4f8d2e174 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.833061 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b2b91e-4e83-41ef-a19a-57b4f8d2e174 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.845849 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1302/2610] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:44.858048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb79f65-5236-4aeb-8299-5e3ca984a643 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.862792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767daf5-5d74-4c05-b41e-9999c7f9c79f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.863756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767daf5-5d74-4c05-b41e-9999c7f9c79f admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.864281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767daf5-5d74-4c05-b41e-9999c7f9c79f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.864635 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0767daf5-5d74-4c05-b41e-9999c7f9c79f admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.865954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767daf5-5d74-4c05-b41e-9999c7f9c79f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.867289 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0767daf5-5d74-4c05-b41e-9999c7f9c79f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:44.898558 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1309/2611] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:44 2022] POST /identity/v3/projects => generated 383 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:44.902577 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2b91e-4e83-41ef-a19a-57b4f8d2e174 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:44.912846 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b2b91e-4e83-41ef-a19a-57b4f8d2e174 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:44.983747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495924e-7e67-49c4-8b2e-188d0dd3392c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:44.984376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495924e-7e67-49c4-8b2e-188d0dd3392c admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:44.984730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495924e-7e67-49c4-8b2e-188d0dd3392c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:44.985113 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3495924e-7e67-49c4-8b2e-188d0dd3392c admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:44.986009 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495924e-7e67-49c4-8b2e-188d0dd3392c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:44.988202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3495924e-7e67-49c4-8b2e-188d0dd3392c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:45.015704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1303/2612] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:44 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:45.019972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767daf5-5d74-4c05-b41e-9999c7f9c79f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:45.031155 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0767daf5-5d74-4c05-b41e-9999c7f9c79f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:45.036698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618b7f1-a4b1-4429-a630-2482bda2d239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:45.037324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618b7f1-a4b1-4429-a630-2482bda2d239 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:45.037595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618b7f1-a4b1-4429-a630-2482bda2d239 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:45.037896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0618b7f1-a4b1-4429-a630-2482bda2d239 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:45.038550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618b7f1-a4b1-4429-a630-2482bda2d239 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:45.040184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0618b7f1-a4b1-4429-a630-2482bda2d239 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:45.052256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1310/2613] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:45.057002 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495924e-7e67-49c4-8b2e-188d0dd3392c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:45.072179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3495924e-7e67-49c4-8b2e-188d0dd3392c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:45.078943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a112292-e826-417a-a141-e4ae80fddae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:45.079875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a112292-e826-417a-a141-e4ae80fddae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:45.080283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a112292-e826-417a-a141-e4ae80fddae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:45.080565 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a112292-e826-417a-a141-e4ae80fddae5 admin admin] PATH_INFO: `/v3/projects/607acfdcc82d4cb18528ec2cf4348f6a/users/5f49d01e85fb4c129ae5bee7f0574759/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:45.099365 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a112292-e826-417a-a141-e4ae80fddae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=607acfdcc82d4cb18528ec2cf4348f6a, user_id=5f49d01e85fb4c129ae5bee7f0574759, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:45.102140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a112292-e826-417a-a141-e4ae80fddae5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:45.117222 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1304/2614] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:45 2022] PUT /identity/v3/projects/607acfdcc82d4cb18528ec2cf4348f6a/users/5f49d01e85fb4c129ae5bee7f0574759/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:45.121525 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618b7f1-a4b1-4429-a630-2482bda2d239 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:45.132543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0618b7f1-a4b1-4429-a630-2482bda2d239 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:45.195981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:45.204471 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b562dec7-b96b-4cc9-94a4-14e66ae6ef60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:45.205566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562dec7-b96b-4cc9-94a4-14e66ae6ef60 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:45.205719 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562dec7-b96b-4cc9-94a4-14e66ae6ef60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:45.206568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b562dec7-b96b-4cc9-94a4-14e66ae6ef60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:45.207773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562dec7-b96b-4cc9-94a4-14e66ae6ef60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:45.209497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b562dec7-b96b-4cc9-94a4-14e66ae6ef60 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:45.223507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1311/2615] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:45 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:24:45.224608 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a112292-e826-417a-a141-e4ae80fddae5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:45.236278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a112292-e826-417a-a141-e4ae80fddae5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:45.241167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6052b-d982-4147-afdd-2044aa72ec8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:45.241890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6052b-d982-4147-afdd-2044aa72ec8e admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:45.242168 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6052b-d982-4147-afdd-2044aa72ec8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:45.243001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db6052b-d982-4147-afdd-2044aa72ec8e admin admin] PATH_INFO: `/v3/projects/607acfdcc82d4cb18528ec2cf4348f6a/users/5f49d01e85fb4c129ae5bee7f0574759/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:45.244380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6052b-d982-4147-afdd-2044aa72ec8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=607acfdcc82d4cb18528ec2cf4348f6a, user_id=5f49d01e85fb4c129ae5bee7f0574759, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:45.247040 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db6052b-d982-4147-afdd-2044aa72ec8e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:45.260483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1305/2616] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:45 2022] PUT /identity/v3/projects/607acfdcc82d4cb18528ec2cf4348f6a/users/5f49d01e85fb4c129ae5bee7f0574759/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:45.271381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba7036-ac9f-4fb0-ae5e-91da1034ecb8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:45.271656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba7036-ac9f-4fb0-ae5e-91da1034ecb8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:45.271926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ba7036-ac9f-4fb0-ae5e-91da1034ecb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:45.309420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e8ba7036-ac9f-4fb0-ae5e-91da1034ecb8 None None] MFA Rules not processed for user `5f49d01e85fb4c129ae5bee7f0574759`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:45.310700 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e8ba7036-ac9f-4fb0-ae5e-91da1034ecb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:45.398040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1312/2617] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:45 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:45.411353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6052b-d982-4147-afdd-2044aa72ec8e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:45.414294 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5db6052b-d982-4147-afdd-2044aa72ec8e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:45.480677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db6052b-d982-4147-afdd-2044aa72ec8e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:45.484575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f65c7-a1c3-4550-b52a-7ce02fb56947 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:45.485173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f65c7-a1c3-4550-b52a-7ce02fb56947 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:45.485448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f65c7-a1c3-4550-b52a-7ce02fb56947 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:45.485720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850f65c7-a1c3-4550-b52a-7ce02fb56947 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:45.516021 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:45.550977 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f65c7-a1c3-4550-b52a-7ce02fb56947 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:45.552817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850f65c7-a1c3-4550-b52a-7ce02fb56947 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:45.563311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1306/2618] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:45 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:45.674218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994c31-7106-48a7-8cf1-d5601525b35d None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:45.674469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994c31-7106-48a7-8cf1-d5601525b35d None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:45.674828 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28994c31-7106-48a7-8cf1-d5601525b35d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:45.710740 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-28994c31-7106-48a7-8cf1-d5601525b35d None None] MFA Rules not processed for user `11a32ed239514b8fb6daf9f218603505`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:45.711999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-28994c31-7106-48a7-8cf1-d5601525b35d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:45.803479 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1313/2619] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:45 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:45.809744 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f65c7-a1c3-4550-b52a-7ce02fb56947 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:45.888985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850f65c7-a1c3-4550-b52a-7ce02fb56947 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:45.894636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e181883-6ae8-4d62-9146-7b0091580929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:45.895293 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e181883-6ae8-4d62-9146-7b0091580929 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:45.895576 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e181883-6ae8-4d62-9146-7b0091580929 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:45.895830 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e181883-6ae8-4d62-9146-7b0091580929 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:45.896684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e181883-6ae8-4d62-9146-7b0091580929 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:45.898764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e181883-6ae8-4d62-9146-7b0091580929 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:45.941464 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1307/2620] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:45 2022] POST /identity/v3/projects => generated 373 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:45.943142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994c31-7106-48a7-8cf1-d5601525b35d None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:45.955874 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28994c31-7106-48a7-8cf1-d5601525b35d None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:46.026255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1603-798f-4604-a2de-6660389aa3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:46.026984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1603-798f-4604-a2de-6660389aa3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:46.027107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1603-798f-4604-a2de-6660389aa3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:46.027395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bf1603-798f-4604-a2de-6660389aa3f9 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:46.028079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf1603-798f-4604-a2de-6660389aa3f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:46.030040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bf1603-798f-4604-a2de-6660389aa3f9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:46.048872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:46.056925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1314/2621] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:45 2022] POST /identity/v3/users => generated 293 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:46.063317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e181883-6ae8-4d62-9146-7b0091580929 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:46.075573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e181883-6ae8-4d62-9146-7b0091580929 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:46.080971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687dd9a-a27d-416e-92a2-73a0f2bf480c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:46.082287 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687dd9a-a27d-416e-92a2-73a0f2bf480c admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:46.082605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687dd9a-a27d-416e-92a2-73a0f2bf480c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:46.082960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9687dd9a-a27d-416e-92a2-73a0f2bf480c admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:46.083618 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687dd9a-a27d-416e-92a2-73a0f2bf480c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:46.085232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9687dd9a-a27d-416e-92a2-73a0f2bf480c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:46.097907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1308/2622] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:46.102151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1603-798f-4604-a2de-6660389aa3f9 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:46.112369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bf1603-798f-4604-a2de-6660389aa3f9 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:46.117825 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47891a-cdb7-438a-9a3a-1e540f0c74f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:46.118518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47891a-cdb7-438a-9a3a-1e540f0c74f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:46.118796 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47891a-cdb7-438a-9a3a-1e540f0c74f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:46.119085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d47891a-cdb7-438a-9a3a-1e540f0c74f4 admin admin] PATH_INFO: `/v3/projects/f8381f3f6a974da891337e08685f8c61/users/acf8a475119d45c0b8511bed1352b3d3/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:46.138642 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47891a-cdb7-438a-9a3a-1e540f0c74f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8381f3f6a974da891337e08685f8c61, user_id=acf8a475119d45c0b8511bed1352b3d3, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:46.141554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d47891a-cdb7-438a-9a3a-1e540f0c74f4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:46.160621 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1315/2623] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:46 2022] PUT /identity/v3/projects/f8381f3f6a974da891337e08685f8c61/users/acf8a475119d45c0b8511bed1352b3d3/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:46.164784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687dd9a-a27d-416e-92a2-73a0f2bf480c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:46.175731 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9687dd9a-a27d-416e-92a2-73a0f2bf480c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:46.235367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4794d9b8-559d-4ee2-9f7b-12f2df67218c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:46.235994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794d9b8-559d-4ee2-9f7b-12f2df67218c admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:46.236297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794d9b8-559d-4ee2-9f7b-12f2df67218c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:46.236574 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4794d9b8-559d-4ee2-9f7b-12f2df67218c admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:46.237257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794d9b8-559d-4ee2-9f7b-12f2df67218c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:46.238931 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4794d9b8-559d-4ee2-9f7b-12f2df67218c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:46.249521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1309/2624] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:46 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:46.254160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47891a-cdb7-438a-9a3a-1e540f0c74f4 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:46.265251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d47891a-cdb7-438a-9a3a-1e540f0c74f4 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:46.270675 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2082ed-69cf-40cd-9f0e-2bcbc74dd2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:46.271342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2082ed-69cf-40cd-9f0e-2bcbc74dd2a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:46.271643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2082ed-69cf-40cd-9f0e-2bcbc74dd2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:46.271915 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2082ed-69cf-40cd-9f0e-2bcbc74dd2a0 admin admin] PATH_INFO: `/v3/projects/f8381f3f6a974da891337e08685f8c61/users/acf8a475119d45c0b8511bed1352b3d3/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:46.273905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2082ed-69cf-40cd-9f0e-2bcbc74dd2a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8381f3f6a974da891337e08685f8c61, user_id=acf8a475119d45c0b8511bed1352b3d3, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:46.276564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2082ed-69cf-40cd-9f0e-2bcbc74dd2a0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:46.288373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1316/2625] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:46 2022] PUT /identity/v3/projects/f8381f3f6a974da891337e08685f8c61/users/acf8a475119d45c0b8511bed1352b3d3/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:46.980707 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e0a5f-6bce-4f0b-a6fe-b1dde8efb833 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:46.981302 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e0a5f-6bce-4f0b-a6fe-b1dde8efb833 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:46.981415 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e0a5f-6bce-4f0b-a6fe-b1dde8efb833 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:47.020973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9f4e0a5f-6bce-4f0b-a6fe-b1dde8efb833 None None] MFA Rules not processed for user `acf8a475119d45c0b8511bed1352b3d3`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:47.022725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9f4e0a5f-6bce-4f0b-a6fe-b1dde8efb833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:47.052989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:47.121596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1310/2626] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:46 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:47.132773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4d842-ff44-4bde-8d71-b746d5d8f41e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:47.133228 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4d842-ff44-4bde-8d71-b746d5d8f41e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:47.133343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca4d842-ff44-4bde-8d71-b746d5d8f41e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:47.155266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-0ca4d842-ff44-4bde-8d71-b746d5d8f41e None None] MFA Rules not processed for user `11a32ed239514b8fb6daf9f218603505`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:47.156715 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0ca4d842-ff44-4bde-8d71-b746d5d8f41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:47.195221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e0a5f-6bce-4f0b-a6fe-b1dde8efb833 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:47.197125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9f4e0a5f-6bce-4f0b-a6fe-b1dde8efb833 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:47.256942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1317/2627] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:47 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:47.263533 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e0a5f-6bce-4f0b-a6fe-b1dde8efb833 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:47.268789 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf5ed9-223a-4d88-aca6-aebe0923e073 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:47.269104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4d842-ff44-4bde-8d71-b746d5d8f41e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:47.269773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf5ed9-223a-4d88-aca6-aebe0923e073 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:47.270933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf5ed9-223a-4d88-aca6-aebe0923e073 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:47.270933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf5ed9-223a-4d88-aca6-aebe0923e073 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:47.274656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0ca4d842-ff44-4bde-8d71-b746d5d8f41e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:47.342799 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf5ed9-223a-4d88-aca6-aebe0923e073 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:47.344350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf5ed9-223a-4d88-aca6-aebe0923e073 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:47.354687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1311/2628] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:24:47.366500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca4d842-ff44-4bde-8d71-b746d5d8f41e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:47.378494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892bfd3-a596-45d4-8410-301158e82c2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:47.379653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892bfd3-a596-45d4-8410-301158e82c2a service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:47.380219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892bfd3-a596-45d4-8410-301158e82c2a service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:47.380735 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8892bfd3-a596-45d4-8410-301158e82c2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:47.395708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892bfd3-a596-45d4-8410-301158e82c2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:47.398914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8892bfd3-a596-45d4-8410-301158e82c2a service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:47.416698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1318/2629] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:47.687983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf5ed9-223a-4d88-aca6-aebe0923e073 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:47.763205 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf5ed9-223a-4d88-aca6-aebe0923e073 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:47.768690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca65c87-630b-4f5d-8103-30cc2f22ebe3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:47.769503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca65c87-630b-4f5d-8103-30cc2f22ebe3 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:47.769890 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca65c87-630b-4f5d-8103-30cc2f22ebe3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:47.770219 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca65c87-630b-4f5d-8103-30cc2f22ebe3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:47.772296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fca65c87-630b-4f5d-8103-30cc2f22ebe3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:47.783660 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca65c87-630b-4f5d-8103-30cc2f22ebe3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:47.785386 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca65c87-630b-4f5d-8103-30cc2f22ebe3 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:47.795589 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1312/2630] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:48.007356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892bfd3-a596-45d4-8410-301158e82c2a service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:48.017246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8892bfd3-a596-45d4-8410-301158e82c2a service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:48.021045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121d49e6-767b-4fa6-b37f-e5faa1286bb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:48.021664 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d49e6-767b-4fa6-b37f-e5faa1286bb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:48.022086 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d49e6-767b-4fa6-b37f-e5faa1286bb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:48.022356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121d49e6-767b-4fa6-b37f-e5faa1286bb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:48.078762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:48.094351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d49e6-767b-4fa6-b37f-e5faa1286bb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:48.095930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121d49e6-767b-4fa6-b37f-e5faa1286bb4 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:48.106457 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1319/2631] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:48 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:52.226817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca65c87-630b-4f5d-8103-30cc2f22ebe3 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:52.269571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:52.331749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca65c87-630b-4f5d-8103-30cc2f22ebe3 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:52.338073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:52.338741 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:52.339014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:52.339282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] PATH_INFO: `/v3/users/a9277d7147284730a1674d8bff0dd33b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:52.340516 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9277d7147284730a1674d8bff0dd33b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:52.342519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:52.404328 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9277d7147284730a1674d8bff0dd33b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:52.416400 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9277d7147284730a1674d8bff0dd33b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:52.417265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9277d7147284730a1674d8bff0dd33b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:52.418082 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9277d7147284730a1674d8bff0dd33b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:52.428780 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9277d7147284730a1674d8bff0dd33b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:52.456249 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1313/2632] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:52 2022] DELETE /identity/v3/users/a9277d7147284730a1674d8bff0dd33b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:52.462472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97bf4e-c9bb-484f-bb5d-5320ee37cf48 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:52.463939 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97bf4e-c9bb-484f-bb5d-5320ee37cf48 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:52.464518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97bf4e-c9bb-484f-bb5d-5320ee37cf48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:52.495233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-7a97bf4e-c9bb-484f-bb5d-5320ee37cf48 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:52.496484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7a97bf4e-c9bb-484f-bb5d-5320ee37cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:52.578036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1320/2633] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:52.591373 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:52.593283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:52.658460 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a47874-63b7-49f8-a967-a407a0676639 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:52.666229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d75c4-e1d8-49b9-973b-83545d62c1d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:52.666868 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d75c4-e1d8-49b9-973b-83545d62c1d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:52.667146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d75c4-e1d8-49b9-973b-83545d62c1d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:52.667418 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101d75c4-e1d8-49b9-973b-83545d62c1d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:52.677586 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d75c4-e1d8-49b9-973b-83545d62c1d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:52.679070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101d75c4-e1d8-49b9-973b-83545d62c1d2 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:52.690827 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1314/2634] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:53.058731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97bf4e-c9bb-484f-bb5d-5320ee37cf48 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:53.060811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-7a97bf4e-c9bb-484f-bb5d-5320ee37cf48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:53.076280 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97bf4e-c9bb-484f-bb5d-5320ee37cf48 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:53.083731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:53.084444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:53.084776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:53.085054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] PATH_INFO: `/v3/projects/6bd38eaabfa3455c944cccfd998b3199` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:53.086583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6bd38eaabfa3455c944cccfd998b3199)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:53.088930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:53.161505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6bd38eaabfa3455c944cccfd998b3199', 'request_id': 'req-f977255e-53d7-41e3-882a-c26be9d31b15'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.168172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6bd38eaabfa3455c944cccfd998b3199', 'request_id': 'req-f977255e-53d7-41e3-882a-c26be9d31b15'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.180270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6bd38eaabfa3455c944cccfd998b3199', 'request_id': 'req-f977255e-53d7-41e3-882a-c26be9d31b15'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.193767 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] The token cache is being invalidate because project 6bd38eaabfa3455c944cccfd998b3199 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:53.194256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.195554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.198408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1321/2635] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:53 2022] DELETE /identity/v3/projects/6bd38eaabfa3455c944cccfd998b3199 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:53.202444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d75c4-e1d8-49b9-973b-83545d62c1d2 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:53.213816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101d75c4-e1d8-49b9-973b-83545d62c1d2 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:53.268406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:53.296686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:53.297638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:53.298158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:53.298441 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] PATH_INFO: `/v3/users/e39ec431532641e090732dc8654f7ee5` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:53.299738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] RBAC: Authorizing `identity:delete_user(user_id=e39ec431532641e090732dc8654f7ee5)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:53.302153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:53.358807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e39ec431532641e090732dc8654f7ee5'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.371999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e39ec431532641e090732dc8654f7ee5'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.372891 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e39ec431532641e090732dc8654f7ee5'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.373994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e39ec431532641e090732dc8654f7ee5'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.387883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e39ec431532641e090732dc8654f7ee5'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.426907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1315/2636] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:53 2022] DELETE /identity/v3/users/e39ec431532641e090732dc8654f7ee5 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:53.731245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:53.732953 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:53.750930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f977255e-53d7-41e3-882a-c26be9d31b15 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:53.818151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:53.818800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:53.819073 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:53.819419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] PATH_INFO: `/v3/projects/4b2c38fa08cf4f9dbb7f2e17a1479727` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:53.820494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b2c38fa08cf4f9dbb7f2e17a1479727)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:53.822443 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:53.835102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:53.880117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b2c38fa08cf4f9dbb7f2e17a1479727', 'request_id': 'req-0e279765-c04c-467f-b555-eb6904f5b255'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.887174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b2c38fa08cf4f9dbb7f2e17a1479727', 'request_id': 'req-0e279765-c04c-467f-b555-eb6904f5b255'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.897522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b2c38fa08cf4f9dbb7f2e17a1479727', 'request_id': 'req-0e279765-c04c-467f-b555-eb6904f5b255'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.910041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] The token cache is being invalidate because project 4b2c38fa08cf4f9dbb7f2e17a1479727 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:53.910605 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.911170 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:53.912850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1322/2637] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:53 2022] DELETE /identity/v3/projects/4b2c38fa08cf4f9dbb7f2e17a1479727 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:53.917901 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:53.919550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:53.933117 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c09f462-465b-4ded-bd55-8d329fe0575f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:54.011060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828fbd55-2dd3-42a4-8920-0b40a5853ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:54.011796 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fbd55-2dd3-42a4-8920-0b40a5853ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:54.012161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fbd55-2dd3-42a4-8920-0b40a5853ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:54.012551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828fbd55-2dd3-42a4-8920-0b40a5853ab2 admin admin] PATH_INFO: `/v3/users/5f49d01e85fb4c129ae5bee7f0574759` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:54.013994 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fbd55-2dd3-42a4-8920-0b40a5853ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f49d01e85fb4c129ae5bee7f0574759)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:54.015935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828fbd55-2dd3-42a4-8920-0b40a5853ab2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:54.074852 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-828fbd55-2dd3-42a4-8920-0b40a5853ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f49d01e85fb4c129ae5bee7f0574759'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:54.085565 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-828fbd55-2dd3-42a4-8920-0b40a5853ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f49d01e85fb4c129ae5bee7f0574759'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:54.086561 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-828fbd55-2dd3-42a4-8920-0b40a5853ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f49d01e85fb4c129ae5bee7f0574759'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:54.087359 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-828fbd55-2dd3-42a4-8920-0b40a5853ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f49d01e85fb4c129ae5bee7f0574759'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:54.096218 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-828fbd55-2dd3-42a4-8920-0b40a5853ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f49d01e85fb4c129ae5bee7f0574759'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:54.097638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:54.119583 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1316/2638] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:53 2022] DELETE /identity/v3/users/5f49d01e85fb4c129ae5bee7f0574759 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:54.458754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:54.460743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:54.478648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e279765-c04c-467f-b555-eb6904f5b255 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:54.572326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660ce910-fe4b-4158-bbe0-566ab23194ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:54.573398 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ce910-fe4b-4158-bbe0-566ab23194ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:54.573888 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ce910-fe4b-4158-bbe0-566ab23194ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:54.574378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660ce910-fe4b-4158-bbe0-566ab23194ff admin admin] PATH_INFO: `/v3/projects/607acfdcc82d4cb18528ec2cf4348f6a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:54.576268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ce910-fe4b-4158-bbe0-566ab23194ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=607acfdcc82d4cb18528ec2cf4348f6a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:54.579770 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660ce910-fe4b-4158-bbe0-566ab23194ff admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:54.658876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-660ce910-fe4b-4158-bbe0-566ab23194ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '607acfdcc82d4cb18528ec2cf4348f6a', 'request_id': 'req-660ce910-fe4b-4158-bbe0-566ab23194ff'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:54.668615 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-660ce910-fe4b-4158-bbe0-566ab23194ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '607acfdcc82d4cb18528ec2cf4348f6a', 'request_id': 'req-660ce910-fe4b-4158-bbe0-566ab23194ff'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:54.682209 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-660ce910-fe4b-4158-bbe0-566ab23194ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '607acfdcc82d4cb18528ec2cf4348f6a', 'request_id': 'req-660ce910-fe4b-4158-bbe0-566ab23194ff'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:54.697586 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-660ce910-fe4b-4158-bbe0-566ab23194ff admin admin] The token cache is being invalidate because project 607acfdcc82d4cb18528ec2cf4348f6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:54.698002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-660ce910-fe4b-4158-bbe0-566ab23194ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:54.700653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-660ce910-fe4b-4158-bbe0-566ab23194ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:54.701395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1323/2639] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:54 2022] DELETE /identity/v3/projects/607acfdcc82d4cb18528ec2cf4348f6a => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:54.708891 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c5a5f-096d-4cc9-95e6-2c7e6b60771f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:54.710247 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c5a5f-096d-4cc9-95e6-2c7e6b60771f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:54.710671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7c5a5f-096d-4cc9-95e6-2c7e6b60771f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:54.734810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-8b7c5a5f-096d-4cc9-95e6-2c7e6b60771f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:54.736054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-8b7c5a5f-096d-4cc9-95e6-2c7e6b60771f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:54.817448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1317/2640] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:54.826510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418214ef-b246-4a37-9454-806ca9115ef7 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:54.827529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418214ef-b246-4a37-9454-806ca9115ef7 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:54.827716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418214ef-b246-4a37-9454-806ca9115ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:54.860929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-418214ef-b246-4a37-9454-806ca9115ef7 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:54.863420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-418214ef-b246-4a37-9454-806ca9115ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:54.873921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1324/2641] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:54.878986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c5a5f-096d-4cc9-95e6-2c7e6b60771f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:54.890703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7c5a5f-096d-4cc9-95e6-2c7e6b60771f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:54.896831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93175904-db57-4e5f-950f-817995769feb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:54.897480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93175904-db57-4e5f-950f-817995769feb admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:54.897832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93175904-db57-4e5f-950f-817995769feb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:54.898110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93175904-db57-4e5f-950f-817995769feb admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:54.898805 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93175904-db57-4e5f-950f-817995769feb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:24:54.899108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93175904-db57-4e5f-950f-817995769feb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:54.903979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93175904-db57-4e5f-950f-817995769feb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:54.921387 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1318/2642] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:24:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:24:54.927432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418214ef-b246-4a37-9454-806ca9115ef7 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:54.945656 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418214ef-b246-4a37-9454-806ca9115ef7 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:54.955105 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d549ee2-bbf2-4745-8807-2ce015941c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:54.956921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d549ee2-bbf2-4745-8807-2ce015941c0f admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:54.957326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d549ee2-bbf2-4745-8807-2ce015941c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:54.957694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d549ee2-bbf2-4745-8807-2ce015941c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:54.958506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d549ee2-bbf2-4745-8807-2ce015941c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:54.960539 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d549ee2-bbf2-4745-8807-2ce015941c0f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:54.986663 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:54.996546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1325/2643] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:54 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:55.001106 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93175904-db57-4e5f-950f-817995769feb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:55.012518 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93175904-db57-4e5f-950f-817995769feb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:55.080238 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a808e22-b892-4aa7-9b91-ad96dc85fd52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:55.080777 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a808e22-b892-4aa7-9b91-ad96dc85fd52 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:55.081934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a808e22-b892-4aa7-9b91-ad96dc85fd52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:55.082217 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a808e22-b892-4aa7-9b91-ad96dc85fd52 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:55.082898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a808e22-b892-4aa7-9b91-ad96dc85fd52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:55.085103 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a808e22-b892-4aa7-9b91-ad96dc85fd52 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:55.112416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1319/2644] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:55 2022] POST /identity/v3/users => generated 286 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:24:55.117271 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d549ee2-bbf2-4745-8807-2ce015941c0f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:55.129279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d549ee2-bbf2-4745-8807-2ce015941c0f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:55.134158 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa4d3f-8d38-435c-89f9-300ed2376181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:55.134781 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4d3f-8d38-435c-89f9-300ed2376181 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:55.135055 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4d3f-8d38-435c-89f9-300ed2376181 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:55.135320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fa4d3f-8d38-435c-89f9-300ed2376181 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:55.135964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa4d3f-8d38-435c-89f9-300ed2376181 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:55.137554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fa4d3f-8d38-435c-89f9-300ed2376181 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:55.151721 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1326/2645] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:55.155975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a808e22-b892-4aa7-9b91-ad96dc85fd52 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:55.167172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a808e22-b892-4aa7-9b91-ad96dc85fd52 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:55.172347 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b04621-8041-455b-ad4b-e7a8ab78be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:55.172965 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04621-8041-455b-ad4b-e7a8ab78be67 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:55.173304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04621-8041-455b-ad4b-e7a8ab78be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:55.173519 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b04621-8041-455b-ad4b-e7a8ab78be67 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:55.174232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04621-8041-455b-ad4b-e7a8ab78be67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:55.175895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b04621-8041-455b-ad4b-e7a8ab78be67 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:55.187578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1320/2646] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:55.192840 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa4d3f-8d38-435c-89f9-300ed2376181 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:55.204416 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fa4d3f-8d38-435c-89f9-300ed2376181 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:55.210360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c34775-145f-475c-8e0b-eb4956d934bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:55.211054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c34775-145f-475c-8e0b-eb4956d934bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:55.211327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c34775-145f-475c-8e0b-eb4956d934bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:55.211579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c34775-145f-475c-8e0b-eb4956d934bf admin admin] PATH_INFO: `/v3/projects/096c2ce99f1c437ab522743ca726c6aa/users/9583f812bab142bf86e16544e5308045/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:55.229504 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c34775-145f-475c-8e0b-eb4956d934bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=096c2ce99f1c437ab522743ca726c6aa, user_id=9583f812bab142bf86e16544e5308045, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:55.232224 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c34775-145f-475c-8e0b-eb4956d934bf admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:55.248383 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1327/2647] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:55 2022] PUT /identity/v3/projects/096c2ce99f1c437ab522743ca726c6aa/users/9583f812bab142bf86e16544e5308045/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:55.260195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff831593-faa3-48b2-8f8d-b5e4fc10633c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:55.260492 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff831593-faa3-48b2-8f8d-b5e4fc10633c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:55.260737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff831593-faa3-48b2-8f8d-b5e4fc10633c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:55.291334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ff831593-faa3-48b2-8f8d-b5e4fc10633c None None] MFA Rules not processed for user `9583f812bab142bf86e16544e5308045`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:55.292572 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ff831593-faa3-48b2-8f8d-b5e4fc10633c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:55.355717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:55.403433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1321/2648] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:55.420369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c34775-145f-475c-8e0b-eb4956d934bf admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:55.422567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f8c34775-145f-475c-8e0b-eb4956d934bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:55.492418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c34775-145f-475c-8e0b-eb4956d934bf admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:55.496489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d35a3fa-eadb-4d67-8053-55e3121c277d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:55.497204 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35a3fa-eadb-4d67-8053-55e3121c277d service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:55.497483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35a3fa-eadb-4d67-8053-55e3121c277d service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:55.497755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d35a3fa-eadb-4d67-8053-55e3121c277d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:55.508226 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35a3fa-eadb-4d67-8053-55e3121c277d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:55.509877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d35a3fa-eadb-4d67-8053-55e3121c277d service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:55.528049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1328/2649] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:55 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:24:55.559304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff831593-faa3-48b2-8f8d-b5e4fc10633c None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:55.637513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff831593-faa3-48b2-8f8d-b5e4fc10633c None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:55.644920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:55.646083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:55.646582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:55.647083 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] PATH_INFO: `/v3/users/9583f812bab142bf86e16544e5308045` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:55.649129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9583f812bab142bf86e16544e5308045)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:55.652824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:55.735882 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9583f812bab142bf86e16544e5308045'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:55.751521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9583f812bab142bf86e16544e5308045'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:55.752833 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9583f812bab142bf86e16544e5308045'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:55.754451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9583f812bab142bf86e16544e5308045'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:55.764086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9583f812bab142bf86e16544e5308045'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:55.792774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1322/2650] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:24:55 2022] DELETE /identity/v3/users/9583f812bab142bf86e16544e5308045 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:24:55.798578 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c9aca-5ed7-4661-aed8-104ac43114e5 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:55.798856 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c9aca-5ed7-4661-aed8-104ac43114e5 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:55.799164 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c9aca-5ed7-4661-aed8-104ac43114e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:55.822640 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-b96c9aca-5ed7-4661-aed8-104ac43114e5 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:55.823947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b96c9aca-5ed7-4661-aed8-104ac43114e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:55.909208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1329/2651] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:55.924303 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:55.926588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:56.052218 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac1360f-f6ad-4937-a43f-78a98120f75c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:56.058596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c594d5c-55cb-44e6-a5f7-cac057b74afb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:56.059662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594d5c-55cb-44e6-a5f7-cac057b74afb service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:56.060226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594d5c-55cb-44e6-a5f7-cac057b74afb service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:56.060882 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c594d5c-55cb-44e6-a5f7-cac057b74afb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:56.081657 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c594d5c-55cb-44e6-a5f7-cac057b74afb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:56.084834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c594d5c-55cb-44e6-a5f7-cac057b74afb service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:56.093006 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:56.106851 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1323/2652] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:24:57.498853 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c9aca-5ed7-4661-aed8-104ac43114e5 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:57.500442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b96c9aca-5ed7-4661-aed8-104ac43114e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:57.516573 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c9aca-5ed7-4661-aed8-104ac43114e5 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:57.522845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26e65e-09e2-4851-9673-c13e7ceaa811 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:57.524069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26e65e-09e2-4851-9673-c13e7ceaa811 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:57.524345 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26e65e-09e2-4851-9673-c13e7ceaa811 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:57.524784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26e65e-09e2-4851-9673-c13e7ceaa811 admin admin] PATH_INFO: `/v3/projects/096c2ce99f1c437ab522743ca726c6aa` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:57.526142 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26e65e-09e2-4851-9673-c13e7ceaa811 admin admin] RBAC: Authorizing `identity:delete_project(project_id=096c2ce99f1c437ab522743ca726c6aa)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:57.528121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26e65e-09e2-4851-9673-c13e7ceaa811 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:57.580421 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bd26e65e-09e2-4851-9673-c13e7ceaa811 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096c2ce99f1c437ab522743ca726c6aa', 'request_id': 'req-bd26e65e-09e2-4851-9673-c13e7ceaa811'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:57.587862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bd26e65e-09e2-4851-9673-c13e7ceaa811 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096c2ce99f1c437ab522743ca726c6aa', 'request_id': 'req-bd26e65e-09e2-4851-9673-c13e7ceaa811'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:57.597678 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bd26e65e-09e2-4851-9673-c13e7ceaa811 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096c2ce99f1c437ab522743ca726c6aa', 'request_id': 'req-bd26e65e-09e2-4851-9673-c13e7ceaa811'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:57.600319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:57.616161 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bd26e65e-09e2-4851-9673-c13e7ceaa811 admin admin] The token cache is being invalidate because project 096c2ce99f1c437ab522743ca726c6aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:24:57.616456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bd26e65e-09e2-4851-9673-c13e7ceaa811 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:57.617140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bd26e65e-09e2-4851-9673-c13e7ceaa811 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:24:57.618930 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1330/2653] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:24:57 2022] DELETE /identity/v3/projects/096c2ce99f1c437ab522743ca726c6aa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:57.629420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca07afb-d10c-4437-a07b-59da13882160 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:57.630078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca07afb-d10c-4437-a07b-59da13882160 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:57.630078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca07afb-d10c-4437-a07b-59da13882160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:57.650116 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-7ca07afb-d10c-4437-a07b-59da13882160 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:57.651290 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7ca07afb-d10c-4437-a07b-59da13882160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:57.729281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1324/2654] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:57.737346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d019b7f-f446-4af6-814d-ed25277e9367 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:57.737925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d019b7f-f446-4af6-814d-ed25277e9367 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:57.738578 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d019b7f-f446-4af6-814d-ed25277e9367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:57.770140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-5d019b7f-f446-4af6-814d-ed25277e9367 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:57.771426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-5d019b7f-f446-4af6-814d-ed25277e9367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:57.781308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1331/2655] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:57.785542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca07afb-d10c-4437-a07b-59da13882160 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:57.799216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca07afb-d10c-4437-a07b-59da13882160 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:57.806536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f85d08-4230-49a1-8343-ff12de33e38f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:57.807710 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f85d08-4230-49a1-8343-ff12de33e38f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:57.808144 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f85d08-4230-49a1-8343-ff12de33e38f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:57.808597 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f85d08-4230-49a1-8343-ff12de33e38f admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:57.809468 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f85d08-4230-49a1-8343-ff12de33e38f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:24:57.809986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f85d08-4230-49a1-8343-ff12de33e38f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:57.812022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98f85d08-4230-49a1-8343-ff12de33e38f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:57.827737 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1325/2656] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:24:57.833164 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d019b7f-f446-4af6-814d-ed25277e9367 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:57.843573 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d019b7f-f446-4af6-814d-ed25277e9367 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:57.850619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911dac-c22b-44b3-9f04-a11cf21be613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:57.851500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911dac-c22b-44b3-9f04-a11cf21be613 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:57.851966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911dac-c22b-44b3-9f04-a11cf21be613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:57.852409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d911dac-c22b-44b3-9f04-a11cf21be613 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:57.853579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d911dac-c22b-44b3-9f04-a11cf21be613 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:57.855174 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d911dac-c22b-44b3-9f04-a11cf21be613 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:57.889420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1332/2657] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:24:57 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:57.893969 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f85d08-4230-49a1-8343-ff12de33e38f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:57.906572 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f85d08-4230-49a1-8343-ff12de33e38f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:58.020283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bc987-f975-4f9c-a1c5-e59a62bdceaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:58.021035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bc987-f975-4f9c-a1c5-e59a62bdceaf admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:58.021385 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bc987-f975-4f9c-a1c5-e59a62bdceaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:58.021877 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4bc987-f975-4f9c-a1c5-e59a62bdceaf admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:58.022756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bc987-f975-4f9c-a1c5-e59a62bdceaf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:58.024987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4bc987-f975-4f9c-a1c5-e59a62bdceaf admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:58.060910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1326/2658] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:24:57 2022] POST /identity/v3/users => generated 287 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:24:58.065397 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911dac-c22b-44b3-9f04-a11cf21be613 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:58.082823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d911dac-c22b-44b3-9f04-a11cf21be613 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:58.089299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a64a-5446-440a-a578-f8a47f298156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:58.090502 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a64a-5446-440a-a578-f8a47f298156 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:58.090502 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a64a-5446-440a-a578-f8a47f298156 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:58.090889 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af0a64a-5446-440a-a578-f8a47f298156 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:58.091992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0a64a-5446-440a-a578-f8a47f298156 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:58.094360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af0a64a-5446-440a-a578-f8a47f298156 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:58.129505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1333/2659] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:58.133632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bc987-f975-4f9c-a1c5-e59a62bdceaf admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:58.145054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4bc987-f975-4f9c-a1c5-e59a62bdceaf admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:58.151730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4958952-60b6-4690-bfe5-8d60fc853f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:58.152369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4958952-60b6-4690-bfe5-8d60fc853f2f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:58.152789 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4958952-60b6-4690-bfe5-8d60fc853f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:58.153071 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4958952-60b6-4690-bfe5-8d60fc853f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:58.153735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4958952-60b6-4690-bfe5-8d60fc853f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:58.155444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4958952-60b6-4690-bfe5-8d60fc853f2f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:58.170766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1327/2660] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:24:58.173576 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a64a-5446-440a-a578-f8a47f298156 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:58.184814 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af0a64a-5446-440a-a578-f8a47f298156 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:58.190196 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e6b81-7ad5-4fe9-827d-e68d88d938ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:58.191566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e6b81-7ad5-4fe9-827d-e68d88d938ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:58.191992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e6b81-7ad5-4fe9-827d-e68d88d938ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:58.192140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59e6b81-7ad5-4fe9-827d-e68d88d938ef admin admin] PATH_INFO: `/v3/projects/a2d015f41e7b441cb370a77dedebae48/users/d69e7dafa7f94625b72b15ae46f1eeef/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:58.209705 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e6b81-7ad5-4fe9-827d-e68d88d938ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2d015f41e7b441cb370a77dedebae48, user_id=d69e7dafa7f94625b72b15ae46f1eeef, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:58.212440 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59e6b81-7ad5-4fe9-827d-e68d88d938ef admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:58.229701 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1334/2661] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:24:58 2022] PUT /identity/v3/projects/a2d015f41e7b441cb370a77dedebae48/users/d69e7dafa7f94625b72b15ae46f1eeef/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:24:58.240857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58908-b6ff-4d99-bf72-6959068e1b5d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:58.241677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58908-b6ff-4d99-bf72-6959068e1b5d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:58.241677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae58908-b6ff-4d99-bf72-6959068e1b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:58.273163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-eae58908-b6ff-4d99-bf72-6959068e1b5d None None] MFA Rules not processed for user `d69e7dafa7f94625b72b15ae46f1eeef`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:24:58.274430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-eae58908-b6ff-4d99-bf72-6959068e1b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:58.354917 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:24:58.375027 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1328/2662] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:24:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:24:58.384101 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e6b81-7ad5-4fe9-827d-e68d88d938ef admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:24:58.386456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d59e6b81-7ad5-4fe9-827d-e68d88d938ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:24:58.519342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59e6b81-7ad5-4fe9-827d-e68d88d938ef admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:24:58.546676 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244977a-9f45-49c0-9f7d-9aab891e55eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:24:58.550189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244977a-9f45-49c0-9f7d-9aab891e55eb service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:24:58.551907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244977a-9f45-49c0-9f7d-9aab891e55eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:24:58.552681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3244977a-9f45-49c0-9f7d-9aab891e55eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:24:58.567952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244977a-9f45-49c0-9f7d-9aab891e55eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:24:58.569552 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3244977a-9f45-49c0-9f7d-9aab891e55eb service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:24:58.615917 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1335/2663] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:24:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:00.525426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a6dad-1057-46d8-9bab-354529617d22 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:00.525995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a6dad-1057-46d8-9bab-354529617d22 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:00.526424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028a6dad-1057-46d8-9bab-354529617d22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:00.562296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-028a6dad-1057-46d8-9bab-354529617d22 None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:00.563571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-028a6dad-1057-46d8-9bab-354529617d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:00.644456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1329/2664] 10.222.0.25 () {58 vars in 1009 bytes} [Thu Sep 15 19:25:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:25:00.669956 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244977a-9f45-49c0-9f7d-9aab891e55eb service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:00.671377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3244977a-9f45-49c0-9f7d-9aab891e55eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:00.781371 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3244977a-9f45-49c0-9f7d-9aab891e55eb service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:00.787645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225344bd-06a9-4e8d-baa0-0046508b4adb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:00.788435 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225344bd-06a9-4e8d-baa0-0046508b4adb service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:00.788826 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225344bd-06a9-4e8d-baa0-0046508b4adb service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:00.789192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225344bd-06a9-4e8d-baa0-0046508b4adb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:00.798756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225344bd-06a9-4e8d-baa0-0046508b4adb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:00.800742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225344bd-06a9-4e8d-baa0-0046508b4adb service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:00.810838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1336/2665] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:25:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 19:25:03.250923 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a6dad-1057-46d8-9bab-354529617d22 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:03.252500 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-028a6dad-1057-46d8-9bab-354529617d22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:03.363884 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028a6dad-1057-46d8-9bab-354529617d22 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:03.369285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76a072-ddc1-4987-83c2-41f071496935 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:03.370121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76a072-ddc1-4987-83c2-41f071496935 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:03.374143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76a072-ddc1-4987-83c2-41f071496935 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:03.374822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76a072-ddc1-4987-83c2-41f071496935 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:03.377935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5b76a072-ddc1-4987-83c2-41f071496935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:03.469810 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76a072-ddc1-4987-83c2-41f071496935 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:03.471297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76a072-ddc1-4987-83c2-41f071496935 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:03.504811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1330/2666] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:03.515354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225344bd-06a9-4e8d-baa0-0046508b4adb service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:03.517297 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-225344bd-06a9-4e8d-baa0-0046508b4adb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:03.530832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225344bd-06a9-4e8d-baa0-0046508b4adb service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:03.536305 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9c91b-ca7b-4b0a-8e38-d211e7bb0492 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:03.537344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c91b-ca7b-4b0a-8e38-d211e7bb0492 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:03.540922 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c91b-ca7b-4b0a-8e38-d211e7bb0492 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:03.541383 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b9c91b-ca7b-4b0a-8e38-d211e7bb0492 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:03.547360 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-50b9c91b-ca7b-4b0a-8e38-d211e7bb0492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:03.601060 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:DELETE=1,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:03.694400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9c91b-ca7b-4b0a-8e38-d211e7bb0492 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:03.696505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b9c91b-ca7b-4b0a-8e38-d211e7bb0492 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:03.713548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1337/2667] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:08.855427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76a072-ddc1-4987-83c2-41f071496935 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:08.859162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5b76a072-ddc1-4987-83c2-41f071496935 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:08.981885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:08.998095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9c91b-ca7b-4b0a-8e38-d211e7bb0492 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:09.002480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-50b9c91b-ca7b-4b0a-8e38-d211e7bb0492 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:09.035210 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76a072-ddc1-4987-83c2-41f071496935 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:09.042246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f7d0a-84bb-4744-84ca-0b803190b159 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d5f3ec00844cf28c01a14f8a071a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:09.043179 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f7d0a-84bb-4744-84ca-0b803190b159 service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:09.043452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f7d0a-84bb-4744-84ca-0b803190b159 service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:09.043723 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f7d0a-84bb-4744-84ca-0b803190b159 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:09.052712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-258f7d0a-84bb-4744-84ca-0b803190b159 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:09.065738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b9c91b-ca7b-4b0a-8e38-d211e7bb0492 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:09.072617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdb7a7b-34ce-48a4-8056-5be95ef34eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:09.073719 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb7a7b-34ce-48a4-8056-5be95ef34eba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:09.074259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb7a7b-34ce-48a4-8056-5be95ef34eba admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:09.074534 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdb7a7b-34ce-48a4-8056-5be95ef34eba admin admin] PATH_INFO: `/v3/users/45156089d449401abc9a163bf1e15d32` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:09.076588 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb7a7b-34ce-48a4-8056-5be95ef34eba admin admin] RBAC: Authorizing `identity:delete_user(user_id=45156089d449401abc9a163bf1e15d32)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:09.078424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f7d0a-84bb-4744-84ca-0b803190b159 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:09.079081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdb7a7b-34ce-48a4-8056-5be95ef34eba admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:09.080788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258f7d0a-84bb-4744-84ca-0b803190b159 service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:09.101808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1331/2668] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:08 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:09.177565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bbdb7a7b-34ce-48a4-8056-5be95ef34eba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45156089d449401abc9a163bf1e15d32'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:09.246550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bbdb7a7b-34ce-48a4-8056-5be95ef34eba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45156089d449401abc9a163bf1e15d32'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:09.247465 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bbdb7a7b-34ce-48a4-8056-5be95ef34eba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45156089d449401abc9a163bf1e15d32'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:09.248089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bbdb7a7b-34ce-48a4-8056-5be95ef34eba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45156089d449401abc9a163bf1e15d32'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:09.260119 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-bbdb7a7b-34ce-48a4-8056-5be95ef34eba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45156089d449401abc9a163bf1e15d32'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:09.285069 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1338/2669] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:08 2022] DELETE /identity/v3/users/45156089d449401abc9a163bf1e15d32 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:09.598515 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f7d0a-84bb-4744-84ca-0b803190b159 service placement] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:09.610834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258f7d0a-84bb-4744-84ca-0b803190b159 service placement] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:09.698510 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d05f91-7dbc-4766-aef5-b24366bec73b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:09.699568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d05f91-7dbc-4766-aef5-b24366bec73b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:09.700148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d05f91-7dbc-4766-aef5-b24366bec73b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:09.700590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d05f91-7dbc-4766-aef5-b24366bec73b admin admin] PATH_INFO: `/v3/projects/04b611fba1c44d49a99a341ad96f4581` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:09.701997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d05f91-7dbc-4766-aef5-b24366bec73b admin admin] RBAC: Authorizing `identity:delete_project(project_id=04b611fba1c44d49a99a341ad96f4581)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:09.703900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d05f91-7dbc-4766-aef5-b24366bec73b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:09.771310 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63d05f91-7dbc-4766-aef5-b24366bec73b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '04b611fba1c44d49a99a341ad96f4581', 'request_id': 'req-63d05f91-7dbc-4766-aef5-b24366bec73b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:09.781367 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63d05f91-7dbc-4766-aef5-b24366bec73b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '04b611fba1c44d49a99a341ad96f4581', 'request_id': 'req-63d05f91-7dbc-4766-aef5-b24366bec73b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:09.795446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63d05f91-7dbc-4766-aef5-b24366bec73b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '04b611fba1c44d49a99a341ad96f4581', 'request_id': 'req-63d05f91-7dbc-4766-aef5-b24366bec73b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:09.838455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63d05f91-7dbc-4766-aef5-b24366bec73b admin admin] The token cache is being invalidate because project 04b611fba1c44d49a99a341ad96f4581 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:09.839038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63d05f91-7dbc-4766-aef5-b24366bec73b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:09.840103 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-63d05f91-7dbc-4766-aef5-b24366bec73b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:09.847600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283316b-8df4-464e-bba0-0310e4d140cf None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:09.847962 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283316b-8df4-464e-bba0-0310e4d140cf None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:09.848308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f283316b-8df4-464e-bba0-0310e4d140cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:09.851320 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1332/2670] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:09 2022] DELETE /identity/v3/projects/04b611fba1c44d49a99a341ad96f4581 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:09.880091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f283316b-8df4-464e-bba0-0310e4d140cf None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:09.881964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f283316b-8df4-464e-bba0-0310e4d140cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:09.998441 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1339/2671] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:10.001105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3efe2-a3ed-4bcc-8fd5-bf49a2bfce1d None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:10.002002 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3efe2-a3ed-4bcc-8fd5-bf49a2bfce1d None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:10.002476 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b3efe2-a3ed-4bcc-8fd5-bf49a2bfce1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:10.028253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-96b3efe2-a3ed-4bcc-8fd5-bf49a2bfce1d None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:10.030127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-96b3efe2-a3ed-4bcc-8fd5-bf49a2bfce1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:10.042644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1333/2672] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:10.048747 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283316b-8df4-464e-bba0-0310e4d140cf None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:10.074750 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f283316b-8df4-464e-bba0-0310e4d140cf None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:10.089599 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80727a32-0a77-49db-9b91-3a2b2d3c796e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:10.090194 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80727a32-0a77-49db-9b91-3a2b2d3c796e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:10.090419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80727a32-0a77-49db-9b91-3a2b2d3c796e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:10.090809 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80727a32-0a77-49db-9b91-3a2b2d3c796e admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:10.093115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80727a32-0a77-49db-9b91-3a2b2d3c796e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:25:10.093643 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80727a32-0a77-49db-9b91-3a2b2d3c796e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:10.096900 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80727a32-0a77-49db-9b91-3a2b2d3c796e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:10.122233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1340/2673] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:25:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:25:10.128997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3efe2-a3ed-4bcc-8fd5-bf49a2bfce1d None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:10.142472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b3efe2-a3ed-4bcc-8fd5-bf49a2bfce1d None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:10.150381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbdccd-459c-4dbe-956a-75aaa2599f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:10.151106 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbdccd-459c-4dbe-956a-75aaa2599f56 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:10.151887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbdccd-459c-4dbe-956a-75aaa2599f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:10.152654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34cbdccd-459c-4dbe-956a-75aaa2599f56 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:10.153600 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbdccd-459c-4dbe-956a-75aaa2599f56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:10.156039 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34cbdccd-459c-4dbe-956a-75aaa2599f56 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:10.197770 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1334/2674] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:10 2022] POST /identity/v3/projects => generated 405 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:10.202856 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80727a32-0a77-49db-9b91-3a2b2d3c796e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:10.220104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80727a32-0a77-49db-9b91-3a2b2d3c796e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:10.234286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:10.321749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3cc5a-3713-4eda-88a3-1723f63351dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:10.322446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3cc5a-3713-4eda-88a3-1723f63351dc admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:10.322878 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3cc5a-3713-4eda-88a3-1723f63351dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:10.323193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b3cc5a-3713-4eda-88a3-1723f63351dc admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:10.324147 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3cc5a-3713-4eda-88a3-1723f63351dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:10.326595 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b3cc5a-3713-4eda-88a3-1723f63351dc admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:10.357961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1341/2675] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:10 2022] POST /identity/v3/users => generated 303 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:10.358676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbdccd-459c-4dbe-956a-75aaa2599f56 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:10.377372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34cbdccd-459c-4dbe-956a-75aaa2599f56 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:10.383964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d756a8-2a38-430c-81ce-52aad7dfafa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:10.384836 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d756a8-2a38-430c-81ce-52aad7dfafa0 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:10.385286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d756a8-2a38-430c-81ce-52aad7dfafa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:10.385560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d756a8-2a38-430c-81ce-52aad7dfafa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:10.387935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d756a8-2a38-430c-81ce-52aad7dfafa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:10.388513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d756a8-2a38-430c-81ce-52aad7dfafa0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:10.404067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1335/2676] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:25:10.405829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3cc5a-3713-4eda-88a3-1723f63351dc admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:10.421364 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b3cc5a-3713-4eda-88a3-1723f63351dc admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:10.427346 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad13b77-9c6a-4ca8-afbc-5c39ac17c35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:10.427981 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad13b77-9c6a-4ca8-afbc-5c39ac17c35f admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:10.428261 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad13b77-9c6a-4ca8-afbc-5c39ac17c35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:10.428535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad13b77-9c6a-4ca8-afbc-5c39ac17c35f admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:10.429192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad13b77-9c6a-4ca8-afbc-5c39ac17c35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:10.431310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad13b77-9c6a-4ca8-afbc-5c39ac17c35f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:10.446377 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1342/2677] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:10 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:10.447542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d756a8-2a38-430c-81ce-52aad7dfafa0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:10.463194 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d756a8-2a38-430c-81ce-52aad7dfafa0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:10.470836 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23adeb-b1b5-47e7-8d6a-af100eaa45c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:10.471848 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23adeb-b1b5-47e7-8d6a-af100eaa45c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:10.472254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23adeb-b1b5-47e7-8d6a-af100eaa45c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:10.472534 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a23adeb-b1b5-47e7-8d6a-af100eaa45c1 admin admin] PATH_INFO: `/v3/projects/ec8f115ca6a14b9199fee425dc33dcfc/users/d3a5c83b65704cc1b8468ae0482c2a2e/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:10.496256 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23adeb-b1b5-47e7-8d6a-af100eaa45c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec8f115ca6a14b9199fee425dc33dcfc, user_id=d3a5c83b65704cc1b8468ae0482c2a2e, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:10.502803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a23adeb-b1b5-47e7-8d6a-af100eaa45c1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:10.536667 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1336/2678] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:10 2022] PUT /identity/v3/projects/ec8f115ca6a14b9199fee425dc33dcfc/users/d3a5c83b65704cc1b8468ae0482c2a2e/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:10.538887 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861582f8-a20b-49f5-a278-336e29751670 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:10.539934 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861582f8-a20b-49f5-a278-336e29751670 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:10.541002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861582f8-a20b-49f5-a278-336e29751670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:10.579098 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-861582f8-a20b-49f5-a278-336e29751670 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:10.581139 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-861582f8-a20b-49f5-a278-336e29751670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:10.697905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1343/2679] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:10.707623 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23adeb-b1b5-47e7-8d6a-af100eaa45c1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:10.710302 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1a23adeb-b1b5-47e7-8d6a-af100eaa45c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:10.721725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:10.820670 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a23adeb-b1b5-47e7-8d6a-af100eaa45c1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:10.829514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc871f46-7fe0-47da-8b91-ab68a5059518 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:10.831756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc871f46-7fe0-47da-8b91-ab68a5059518 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:10.832496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc871f46-7fe0-47da-8b91-ab68a5059518 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:10.832834 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc871f46-7fe0-47da-8b91-ab68a5059518 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:10.847676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc871f46-7fe0-47da-8b91-ab68a5059518 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:10.850553 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc871f46-7fe0-47da-8b91-ab68a5059518 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:10.864351 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1337/2680] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:11.013681 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861582f8-a20b-49f5-a278-336e29751670 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:11.016222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-861582f8-a20b-49f5-a278-336e29751670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:11.033132 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861582f8-a20b-49f5-a278-336e29751670 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:11.038753 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:11.039502 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:11.039755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:11.040005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] PATH_INFO: `/v3/users/d69e7dafa7f94625b72b15ae46f1eeef` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:11.041338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69e7dafa7f94625b72b15ae46f1eeef)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:11.043322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:11.180153 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69e7dafa7f94625b72b15ae46f1eeef'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:11.190357 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69e7dafa7f94625b72b15ae46f1eeef'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:11.191447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69e7dafa7f94625b72b15ae46f1eeef'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:11.192539 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69e7dafa7f94625b72b15ae46f1eeef'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:11.205251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69e7dafa7f94625b72b15ae46f1eeef'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:11.230167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1344/2681] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:11 2022] DELETE /identity/v3/users/d69e7dafa7f94625b72b15ae46f1eeef => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:11.235488 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513da376-e1c2-4018-86df-92ab28176045 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:11.236419 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513da376-e1c2-4018-86df-92ab28176045 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:11.237207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513da376-e1c2-4018-86df-92ab28176045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:11.274194 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-513da376-e1c2-4018-86df-92ab28176045 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:11.275748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-513da376-e1c2-4018-86df-92ab28176045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:11.354064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1338/2682] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:25:11.363786 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:11.365250 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:11.373462 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:11.450350 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a17984-af4b-4bc1-84c0-5868848c9afe admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:11.454193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c5922-af3d-4808-b20f-2405cb8a59de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:11.454833 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c5922-af3d-4808-b20f-2405cb8a59de service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:11.455707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c5922-af3d-4808-b20f-2405cb8a59de service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:11.456118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c5922-af3d-4808-b20f-2405cb8a59de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:11.469872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c5922-af3d-4808-b20f-2405cb8a59de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:11.471585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c5922-af3d-4808-b20f-2405cb8a59de service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:11.483313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1345/2683] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:12.401424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934277-52bd-4d41-9c6d-ed07902d8585 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:12.402077 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934277-52bd-4d41-9c6d-ed07902d8585 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:12.402077 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c934277-52bd-4d41-9c6d-ed07902d8585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:12.467100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-0c934277-52bd-4d41-9c6d-ed07902d8585 None None] MFA Rules not processed for user `d3a5c83b65704cc1b8468ae0482c2a2e`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:12.468452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0c934277-52bd-4d41-9c6d-ed07902d8585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:12.624410 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1339/2684] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:12 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:12.628724 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c5922-af3d-4808-b20f-2405cb8a59de service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:12.630408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ba0c5922-af3d-4808-b20f-2405cb8a59de service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:12.639396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934277-52bd-4d41-9c6d-ed07902d8585 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:12.642334 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0c934277-52bd-4d41-9c6d-ed07902d8585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:12.654935 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c5922-af3d-4808-b20f-2405cb8a59de service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:12.668329 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c934277-52bd-4d41-9c6d-ed07902d8585 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:12.673381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fa963-913f-4776-8311-85aa679e9bf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:12.674245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fa963-913f-4776-8311-85aa679e9bf1 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:12.674547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fa963-913f-4776-8311-85aa679e9bf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:12.674908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:12.675062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959fa963-913f-4776-8311-85aa679e9bf1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:12.675672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fa963-913f-4776-8311-85aa679e9bf1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:12.676417 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:12.676892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:12.677430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] PATH_INFO: `/v3/projects/a2d015f41e7b441cb370a77dedebae48` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:12.677638 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959fa963-913f-4776-8311-85aa679e9bf1 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:12.679163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2d015f41e7b441cb370a77dedebae48)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:12.681283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:12.752490 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1346/2685] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:12 2022] POST /identity/v3/projects => generated 403 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:12.754750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:12.757996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fa963-913f-4776-8311-85aa679e9bf1 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:12.774948 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2d015f41e7b441cb370a77dedebae48', 'request_id': 'req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:12.786861 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2d015f41e7b441cb370a77dedebae48', 'request_id': 'req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:12.802228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2d015f41e7b441cb370a77dedebae48', 'request_id': 'req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:12.833684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] The token cache is being invalidate because project a2d015f41e7b441cb370a77dedebae48 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:12.833989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:12.834804 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:12.836858 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1340/2686] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:12 2022] DELETE /identity/v3/projects/a2d015f41e7b441cb370a77dedebae48 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:12.907456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959fa963-913f-4776-8311-85aa679e9bf1 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:12.928586 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b4ab4-f56b-419a-b32c-ea3aee60b89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:12.929363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b4ab4-f56b-419a-b32c-ea3aee60b89a admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:12.929649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b4ab4-f56b-419a-b32c-ea3aee60b89a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:12.929984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017b4ab4-f56b-419a-b32c-ea3aee60b89a admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:12.930732 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b4ab4-f56b-419a-b32c-ea3aee60b89a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:12.932999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017b4ab4-f56b-419a-b32c-ea3aee60b89a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:12.997290 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1347/2687] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:12 2022] POST /identity/v3/users => generated 308 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:12.999908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:13.005448 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:13.204793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0bcec7-9a3c-437c-bb91-99297aa3cdfb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:13.225286 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4feb5d-a841-4d49-af12-a71a41aed0a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:13.226176 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4feb5d-a841-4d49-af12-a71a41aed0a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:13.226556 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4feb5d-a841-4d49-af12-a71a41aed0a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:13.226933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4feb5d-a841-4d49-af12-a71a41aed0a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:13.227686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4feb5d-a841-4d49-af12-a71a41aed0a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:13.232356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4feb5d-a841-4d49-af12-a71a41aed0a1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:13.265913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1341/2688] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:12 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:13.272373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b4ab4-f56b-419a-b32c-ea3aee60b89a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:13.289441 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017b4ab4-f56b-419a-b32c-ea3aee60b89a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:13.306760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1614b5-d4dd-4743-8d50-cb9d49d3440e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:13.307993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1614b5-d4dd-4743-8d50-cb9d49d3440e admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:13.308526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1614b5-d4dd-4743-8d50-cb9d49d3440e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:13.308879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1614b5-d4dd-4743-8d50-cb9d49d3440e admin admin] PATH_INFO: `/v3/projects/b1022798584348b09e172155fd2f3976/users/02ebeb3d11f84ebc843af60fd5d83837/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:13.359217 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1614b5-d4dd-4743-8d50-cb9d49d3440e admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1022798584348b09e172155fd2f3976, user_id=02ebeb3d11f84ebc843af60fd5d83837, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:13.365081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1614b5-d4dd-4743-8d50-cb9d49d3440e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:13.406584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1348/2689] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:13 2022] PUT /identity/v3/projects/b1022798584348b09e172155fd2f3976/users/02ebeb3d11f84ebc843af60fd5d83837/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:13.407918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4feb5d-a841-4d49-af12-a71a41aed0a1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:13.450192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4feb5d-a841-4d49-af12-a71a41aed0a1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:13.632864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44222748-d7ac-4613-9a53-1145422b5bab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:13.634107 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44222748-d7ac-4613-9a53-1145422b5bab admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:13.634395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44222748-d7ac-4613-9a53-1145422b5bab admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:13.634672 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44222748-d7ac-4613-9a53-1145422b5bab admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:13.636123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44222748-d7ac-4613-9a53-1145422b5bab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:13.638148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44222748-d7ac-4613-9a53-1145422b5bab admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:13.660428 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1614b5-d4dd-4743-8d50-cb9d49d3440e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:13.666161 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1342/2690] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:13 2022] GET /identity/v3/roles => generated 1420 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:13.692896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1614b5-d4dd-4743-8d50-cb9d49d3440e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:13.714008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbeba4d0-11fd-4818-b1ad-f6cd22bd1b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:13.715054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba4d0-11fd-4818-b1ad-f6cd22bd1b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:13.715899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba4d0-11fd-4818-b1ad-f6cd22bd1b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:13.716351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbeba4d0-11fd-4818-b1ad-f6cd22bd1b0c admin admin] PATH_INFO: `/v3/projects/b1022798584348b09e172155fd2f3976/users/02ebeb3d11f84ebc843af60fd5d83837/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:13.721186 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba4d0-11fd-4818-b1ad-f6cd22bd1b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1022798584348b09e172155fd2f3976, user_id=02ebeb3d11f84ebc843af60fd5d83837, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:13.723839 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbeba4d0-11fd-4818-b1ad-f6cd22bd1b0c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:13.742187 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1349/2691] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:13 2022] PUT /identity/v3/projects/b1022798584348b09e172155fd2f3976/users/02ebeb3d11f84ebc843af60fd5d83837/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:14.936506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44222748-d7ac-4613-9a53-1145422b5bab admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:14.939065 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-44222748-d7ac-4613-9a53-1145422b5bab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:15.023328 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1e02b-f1cd-47ce-b9f5-75a90fdcff70 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:15.023922 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1e02b-f1cd-47ce-b9f5-75a90fdcff70 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:15.023922 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f1e02b-f1cd-47ce-b9f5-75a90fdcff70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:15.104455 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:15.141237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-02f1e02b-f1cd-47ce-b9f5-75a90fdcff70 None None] MFA Rules not processed for user `02ebeb3d11f84ebc843af60fd5d83837`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:15.146361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-02f1e02b-f1cd-47ce-b9f5-75a90fdcff70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:15.186668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44222748-d7ac-4613-9a53-1145422b5bab admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:15.266633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:15.430358 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86d146-e537-41f2-87ce-19fa7c148a8d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:15.430949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86d146-e537-41f2-87ce-19fa7c148a8d service nova] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:15.431224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86d146-e537-41f2-87ce-19fa7c148a8d service nova] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:15.431575 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df86d146-e537-41f2-87ce-19fa7c148a8d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:15.439536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-df86d146-e537-41f2-87ce-19fa7c148a8d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:15.482746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86d146-e537-41f2-87ce-19fa7c148a8d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:15.484395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df86d146-e537-41f2-87ce-19fa7c148a8d service nova] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:15.496619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1350/2692] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:15 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 475 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:15.519317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1343/2693] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 583 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:17.631512 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1e02b-f1cd-47ce-b9f5-75a90fdcff70 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:17.729933 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f1e02b-f1cd-47ce-b9f5-75a90fdcff70 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:17.738682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:17.739558 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:17.739842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:17.740109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] PATH_INFO: `/v3/users/d3a5c83b65704cc1b8468ae0482c2a2e` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:17.741312 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a5c83b65704cc1b8468ae0482c2a2e)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:17.743287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:17.813330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a5c83b65704cc1b8468ae0482c2a2e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:17.826901 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a5c83b65704cc1b8468ae0482c2a2e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:17.827956 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a5c83b65704cc1b8468ae0482c2a2e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:17.828866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a5c83b65704cc1b8468ae0482c2a2e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:17.838957 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a5c83b65704cc1b8468ae0482c2a2e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:17.872556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1351/2694] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:17 2022] DELETE /identity/v3/users/d3a5c83b65704cc1b8468ae0482c2a2e => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:18.121871 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86d146-e537-41f2-87ce-19fa7c148a8d service nova] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:18.172571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df86d146-e537-41f2-87ce-19fa7c148a8d service nova] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:18.399693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:18.400747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:18.401031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:18.401478 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] PATH_INFO: `/v3/projects/ec8f115ca6a14b9199fee425dc33dcfc` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:18.412395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec8f115ca6a14b9199fee425dc33dcfc)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:18.417499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:18.501654 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec8f115ca6a14b9199fee425dc33dcfc', 'request_id': 'req-078b5639-50f3-46ab-9e08-4fac4259572d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:18.510341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec8f115ca6a14b9199fee425dc33dcfc', 'request_id': 'req-078b5639-50f3-46ab-9e08-4fac4259572d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:18.523655 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec8f115ca6a14b9199fee425dc33dcfc', 'request_id': 'req-078b5639-50f3-46ab-9e08-4fac4259572d'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:18.544798 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] The token cache is being invalidate because project ec8f115ca6a14b9199fee425dc33dcfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:18.545094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:18.549343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:18.551884 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1344/2695] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:18 2022] DELETE /identity/v3/projects/ec8f115ca6a14b9199fee425dc33dcfc => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:18.555873 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:18.562002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:18.585526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3a5bfc-4e43-4288-883f-bc19f6c15f5f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:18.656793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:18.692968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ca1ce0-cb44-4da4-882b-1e822b7fb4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:18.694135 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca1ce0-cb44-4da4-882b-1e822b7fb4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:18.694678 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca1ce0-cb44-4da4-882b-1e822b7fb4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:18.695178 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ca1ce0-cb44-4da4-882b-1e822b7fb4c9 admin admin] PATH_INFO: `/v3/users/02ebeb3d11f84ebc843af60fd5d83837` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:18.697506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca1ce0-cb44-4da4-882b-1e822b7fb4c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02ebeb3d11f84ebc843af60fd5d83837)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:18.699758 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ca1ce0-cb44-4da4-882b-1e822b7fb4c9 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:18.788678 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1ca1ce0-cb44-4da4-882b-1e822b7fb4c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02ebeb3d11f84ebc843af60fd5d83837'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:18.801006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1ca1ce0-cb44-4da4-882b-1e822b7fb4c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02ebeb3d11f84ebc843af60fd5d83837'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:18.801711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1ca1ce0-cb44-4da4-882b-1e822b7fb4c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02ebeb3d11f84ebc843af60fd5d83837'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:18.802361 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1ca1ce0-cb44-4da4-882b-1e822b7fb4c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02ebeb3d11f84ebc843af60fd5d83837'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:18.815456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b1ca1ce0-cb44-4da4-882b-1e822b7fb4c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02ebeb3d11f84ebc843af60fd5d83837'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:18.845749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1352/2696] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:18 2022] DELETE /identity/v3/users/02ebeb3d11f84ebc843af60fd5d83837 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:19.078082 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:19.081562 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:19.114605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078b5639-50f3-46ab-9e08-4fac4259572d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:19.120376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:19.201953 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f11606-9305-474a-89c3-924ad2ed2bd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:19.204136 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f11606-9305-474a-89c3-924ad2ed2bd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:19.204840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f11606-9305-474a-89c3-924ad2ed2bd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:19.205949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f11606-9305-474a-89c3-924ad2ed2bd3 admin admin] PATH_INFO: `/v3/projects/b1022798584348b09e172155fd2f3976` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:19.207930 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f11606-9305-474a-89c3-924ad2ed2bd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1022798584348b09e172155fd2f3976)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:19.211263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f11606-9305-474a-89c3-924ad2ed2bd3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:19.277932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44f11606-9305-474a-89c3-924ad2ed2bd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1022798584348b09e172155fd2f3976', 'request_id': 'req-44f11606-9305-474a-89c3-924ad2ed2bd3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:19.285269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44f11606-9305-474a-89c3-924ad2ed2bd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1022798584348b09e172155fd2f3976', 'request_id': 'req-44f11606-9305-474a-89c3-924ad2ed2bd3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:19.298392 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44f11606-9305-474a-89c3-924ad2ed2bd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1022798584348b09e172155fd2f3976', 'request_id': 'req-44f11606-9305-474a-89c3-924ad2ed2bd3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:19.311951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44f11606-9305-474a-89c3-924ad2ed2bd3 admin admin] The token cache is being invalidate because project b1022798584348b09e172155fd2f3976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:19.312285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44f11606-9305-474a-89c3-924ad2ed2bd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:19.313048 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-44f11606-9305-474a-89c3-924ad2ed2bd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:19.318603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1345/2697] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:19 2022] DELETE /identity/v3/projects/b1022798584348b09e172155fd2f3976 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:19.320807 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295ad25-e140-4440-b184-5c4a19bbe3bf None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:19.321137 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295ad25-e140-4440-b184-5c4a19bbe3bf None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:19.321419 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3295ad25-e140-4440-b184-5c4a19bbe3bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:19.343985 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-3295ad25-e140-4440-b184-5c4a19bbe3bf None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:19.345252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3295ad25-e140-4440-b184-5c4a19bbe3bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:19.440653 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1353/2698] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:19.448398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee4dad-9b22-4ff6-8d68-582f6db0fded None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:19.448694 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee4dad-9b22-4ff6-8d68-582f6db0fded None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:19.448956 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddee4dad-9b22-4ff6-8d68-582f6db0fded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:19.474912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-ddee4dad-9b22-4ff6-8d68-582f6db0fded None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:19.474912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ddee4dad-9b22-4ff6-8d68-582f6db0fded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:19.485252 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1346/2699] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:19.489847 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295ad25-e140-4440-b184-5c4a19bbe3bf None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:19.500194 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3295ad25-e140-4440-b184-5c4a19bbe3bf None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:19.505426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06040c0c-32f2-4a2f-87a1-add93a08a839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:19.506124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06040c0c-32f2-4a2f-87a1-add93a08a839 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:19.506481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06040c0c-32f2-4a2f-87a1-add93a08a839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:19.506747 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06040c0c-32f2-4a2f-87a1-add93a08a839 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:19.507430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06040c0c-32f2-4a2f-87a1-add93a08a839 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:25:19.507733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06040c0c-32f2-4a2f-87a1-add93a08a839 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:19.509390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06040c0c-32f2-4a2f-87a1-add93a08a839 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:19.527547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1354/2700] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:25:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:25:19.529388 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee4dad-9b22-4ff6-8d68-582f6db0fded None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:19.539874 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddee4dad-9b22-4ff6-8d68-582f6db0fded None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:19.546032 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e28ea-f32e-486a-b9ea-6fced2101d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:19.547130 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e28ea-f32e-486a-b9ea-6fced2101d58 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:19.547651 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e28ea-f32e-486a-b9ea-6fced2101d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:19.548124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5e28ea-f32e-486a-b9ea-6fced2101d58 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:19.549403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e28ea-f32e-486a-b9ea-6fced2101d58 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:19.553204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c5e28ea-f32e-486a-b9ea-6fced2101d58 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:19.606423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1347/2701] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:19 2022] POST /identity/v3/projects => generated 377 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:19.610574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06040c0c-32f2-4a2f-87a1-add93a08a839 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:19.623919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06040c0c-32f2-4a2f-87a1-add93a08a839 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:19.684630 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:19.701418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74731e1-b5ed-4dc7-8697-b916cc2cdfc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:19.702198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74731e1-b5ed-4dc7-8697-b916cc2cdfc3 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:19.702548 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74731e1-b5ed-4dc7-8697-b916cc2cdfc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:19.702893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74731e1-b5ed-4dc7-8697-b916cc2cdfc3 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:19.703992 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74731e1-b5ed-4dc7-8697-b916cc2cdfc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:19.707333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74731e1-b5ed-4dc7-8697-b916cc2cdfc3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:19.742171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e28ea-f32e-486a-b9ea-6fced2101d58 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:19.753233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1355/2702] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:19 2022] POST /identity/v3/users => generated 289 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:25:19.760349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c5e28ea-f32e-486a-b9ea-6fced2101d58 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:19.773055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a55f8-dd9f-4278-ae63-8c0afc42c808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:19.774393 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a55f8-dd9f-4278-ae63-8c0afc42c808 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:19.775078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a55f8-dd9f-4278-ae63-8c0afc42c808 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:19.775566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a55f8-dd9f-4278-ae63-8c0afc42c808 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:19.776540 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a55f8-dd9f-4278-ae63-8c0afc42c808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:19.778629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49a55f8-dd9f-4278-ae63-8c0afc42c808 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:19.793727 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1348/2703] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:19.797570 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74731e1-b5ed-4dc7-8697-b916cc2cdfc3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:19.814168 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74731e1-b5ed-4dc7-8697-b916cc2cdfc3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:19.823067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1fc5b5-ccce-45ac-af3c-d95908d8e085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:19.823879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fc5b5-ccce-45ac-af3c-d95908d8e085 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:19.824259 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fc5b5-ccce-45ac-af3c-d95908d8e085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:19.824634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1fc5b5-ccce-45ac-af3c-d95908d8e085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:19.825670 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fc5b5-ccce-45ac-af3c-d95908d8e085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:19.827468 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1fc5b5-ccce-45ac-af3c-d95908d8e085 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:19.844964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1356/2704] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:19 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:25:19.849893 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a55f8-dd9f-4278-ae63-8c0afc42c808 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:19.861752 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a55f8-dd9f-4278-ae63-8c0afc42c808 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:19.869160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a7fc0-5df5-49b4-9d4b-04a918815bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:19.874191 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a7fc0-5df5-49b4-9d4b-04a918815bc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:19.875171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a7fc0-5df5-49b4-9d4b-04a918815bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:19.875648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1a7fc0-5df5-49b4-9d4b-04a918815bc3 admin admin] PATH_INFO: `/v3/projects/f2ae4ed47d264feb97b5cd5c123785a2/users/72b18bfe4f0b464da097eeda9304bb8c/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:19.897883 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a7fc0-5df5-49b4-9d4b-04a918815bc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2ae4ed47d264feb97b5cd5c123785a2, user_id=72b18bfe4f0b464da097eeda9304bb8c, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:19.901240 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1a7fc0-5df5-49b4-9d4b-04a918815bc3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:19.927269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1349/2705] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:19 2022] PUT /identity/v3/projects/f2ae4ed47d264feb97b5cd5c123785a2/users/72b18bfe4f0b464da097eeda9304bb8c/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:19.938644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bcc5b-3c29-4d08-92c5-20632d733e69 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:19.939089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bcc5b-3c29-4d08-92c5-20632d733e69 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:19.939592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1bcc5b-3c29-4d08-92c5-20632d733e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:20.014252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-cf1bcc5b-3c29-4d08-92c5-20632d733e69 None None] MFA Rules not processed for user `72b18bfe4f0b464da097eeda9304bb8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:20.016222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cf1bcc5b-3c29-4d08-92c5-20632d733e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:20.153819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1357/2706] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:20.159645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a7fc0-5df5-49b4-9d4b-04a918815bc3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:20.468381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:20.517190 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1a7fc0-5df5-49b4-9d4b-04a918815bc3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:20.523528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b581b02-c055-41ed-a69a-3932224a936b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:20.524167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b581b02-c055-41ed-a69a-3932224a936b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:20.524446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b581b02-c055-41ed-a69a-3932224a936b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:20.524935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b581b02-c055-41ed-a69a-3932224a936b admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:20.525619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b581b02-c055-41ed-a69a-3932224a936b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:20.527831 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b581b02-c055-41ed-a69a-3932224a936b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:20.573980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1350/2707] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:20 2022] POST /identity/v3/projects => generated 375 bytes in 412 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:20.575860 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bcc5b-3c29-4d08-92c5-20632d733e69 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:20.593591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1bcc5b-3c29-4d08-92c5-20632d733e69 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:20.681874 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c18b0c-c8bc-4d72-9903-e9037ff40f86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:20.682441 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c18b0c-c8bc-4d72-9903-e9037ff40f86 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:20.682720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c18b0c-c8bc-4d72-9903-e9037ff40f86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:20.682990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c18b0c-c8bc-4d72-9903-e9037ff40f86 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:20.683644 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c18b0c-c8bc-4d72-9903-e9037ff40f86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:20.685583 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c18b0c-c8bc-4d72-9903-e9037ff40f86 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:20.729561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1358/2708] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:20 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:20.731162 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b581b02-c055-41ed-a69a-3932224a936b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:20.744232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b581b02-c055-41ed-a69a-3932224a936b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:20.749722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81779899-c311-42bf-a848-2229c8caedf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:20.750372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81779899-c311-42bf-a848-2229c8caedf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:20.750747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81779899-c311-42bf-a848-2229c8caedf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:20.751027 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81779899-c311-42bf-a848-2229c8caedf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:20.751725 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81779899-c311-42bf-a848-2229c8caedf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:20.753546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81779899-c311-42bf-a848-2229c8caedf8 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:20.775936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1351/2709] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:20 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:20.779023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c18b0c-c8bc-4d72-9903-e9037ff40f86 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:20.799427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c18b0c-c8bc-4d72-9903-e9037ff40f86 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:20.809641 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960cec4-4fb0-469d-bf6f-8b634647887c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:20.810390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960cec4-4fb0-469d-bf6f-8b634647887c admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:20.810677 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960cec4-4fb0-469d-bf6f-8b634647887c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:20.810942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f960cec4-4fb0-469d-bf6f-8b634647887c admin admin] PATH_INFO: `/v3/projects/afabfb380b6c4028a672df57c94edbff/users/3321b2082b094b3284bbef5021df180c/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:20.990594 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960cec4-4fb0-469d-bf6f-8b634647887c admin admin] RBAC: Authorizing `identity:create_grant(project_id=afabfb380b6c4028a672df57c94edbff, user_id=3321b2082b094b3284bbef5021df180c, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:20.993488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f960cec4-4fb0-469d-bf6f-8b634647887c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:21.014540 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1359/2710] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:20 2022] PUT /identity/v3/projects/afabfb380b6c4028a672df57c94edbff/users/3321b2082b094b3284bbef5021df180c/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:21.018925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81779899-c311-42bf-a848-2229c8caedf8 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:21.037813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81779899-c311-42bf-a848-2229c8caedf8 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:21.166627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c5f862-6ea4-4aef-8741-e8356dd542f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:21.167708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5f862-6ea4-4aef-8741-e8356dd542f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:21.168231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5f862-6ea4-4aef-8741-e8356dd542f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:21.168739 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c5f862-6ea4-4aef-8741-e8356dd542f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:21.169921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5f862-6ea4-4aef-8741-e8356dd542f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:21.172687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c5f862-6ea4-4aef-8741-e8356dd542f4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:21.196573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1352/2711] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:21 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:21.198475 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960cec4-4fb0-469d-bf6f-8b634647887c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:21.222808 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f960cec4-4fb0-469d-bf6f-8b634647887c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:21.233038 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d4c4c-8e59-4efb-94bc-5d36ac1c0d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:21.234315 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d4c4c-8e59-4efb-94bc-5d36ac1c0d4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:21.234854 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d4c4c-8e59-4efb-94bc-5d36ac1c0d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:21.235362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297d4c4c-8e59-4efb-94bc-5d36ac1c0d4d admin admin] PATH_INFO: `/v3/projects/afabfb380b6c4028a672df57c94edbff/users/3321b2082b094b3284bbef5021df180c/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:21.238316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d4c4c-8e59-4efb-94bc-5d36ac1c0d4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=afabfb380b6c4028a672df57c94edbff, user_id=3321b2082b094b3284bbef5021df180c, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:21.241110 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297d4c4c-8e59-4efb-94bc-5d36ac1c0d4d admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:21.257441 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1360/2712] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:21 2022] PUT /identity/v3/projects/afabfb380b6c4028a672df57c94edbff/users/3321b2082b094b3284bbef5021df180c/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:21.271542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a907b2-934b-4683-9e68-0d80a3773a7c None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:21.271911 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a907b2-934b-4683-9e68-0d80a3773a7c None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:21.272099 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a907b2-934b-4683-9e68-0d80a3773a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:21.323992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-b8a907b2-934b-4683-9e68-0d80a3773a7c None None] MFA Rules not processed for user `3321b2082b094b3284bbef5021df180c`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:21.325495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b8a907b2-934b-4683-9e68-0d80a3773a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:21.463321 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1353/2713] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:21 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:25:21.471782 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d4c4c-8e59-4efb-94bc-5d36ac1c0d4d admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:21.475430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-297d4c4c-8e59-4efb-94bc-5d36ac1c0d4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:21.494446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:21.587908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297d4c4c-8e59-4efb-94bc-5d36ac1c0d4d admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:21.597654 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ef359-ba6d-483c-8f89-dc91eea5fee9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:21.601122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ef359-ba6d-483c-8f89-dc91eea5fee9 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:21.601442 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ef359-ba6d-483c-8f89-dc91eea5fee9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:21.601722 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56ef359-ba6d-483c-8f89-dc91eea5fee9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:21.696234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ef359-ba6d-483c-8f89-dc91eea5fee9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:21.698537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56ef359-ba6d-483c-8f89-dc91eea5fee9 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:21.714145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1361/2714] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:25:22.206958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892f1b-f331-4532-ab70-675ae8aca364 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:22.207967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892f1b-f331-4532-ab70-675ae8aca364 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:22.207967 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a892f1b-f331-4532-ab70-675ae8aca364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:22.251229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-9a892f1b-f331-4532-ab70-675ae8aca364 None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:22.254109 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-9a892f1b-f331-4532-ab70-675ae8aca364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:22.288137 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:22.357921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1354/2715] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 15 19:25:22 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:22.381496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ef359-ba6d-483c-8f89-dc91eea5fee9 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:22.383203 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d56ef359-ba6d-483c-8f89-dc91eea5fee9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:22.484738 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56ef359-ba6d-483c-8f89-dc91eea5fee9 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:22.495532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18884d-86d2-4641-b826-7b0fe6b8401c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:22.521222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18884d-86d2-4641-b826-7b0fe6b8401c service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:22.521222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18884d-86d2-4641-b826-7b0fe6b8401c service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:22.521222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c18884d-86d2-4641-b826-7b0fe6b8401c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:22.521222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18884d-86d2-4641-b826-7b0fe6b8401c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:22.521222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c18884d-86d2-4641-b826-7b0fe6b8401c service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:22.529482 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1362/2716] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:25:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 15 19:25:24.235909 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524adfcb-1d02-4102-8de6-16677fe49aec None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:24.236558 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524adfcb-1d02-4102-8de6-16677fe49aec None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:24.237337 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524adfcb-1d02-4102-8de6-16677fe49aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:24.259960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-524adfcb-1d02-4102-8de6-16677fe49aec None None] MFA Rules not processed for user `cd3b9f8c819d4ac1b6ded6ea1a91e68f`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:24.261236 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-524adfcb-1d02-4102-8de6-16677fe49aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:24.275369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1355/2717] 10.222.0.25 () {58 vars in 967 bytes} [Thu Sep 15 19:25:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:24.288293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18884d-86d2-4641-b826-7b0fe6b8401c service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:24.299946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c18884d-86d2-4641-b826-7b0fe6b8401c service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:24.306071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22f5d-75f6-4ec4-ae5f-d382d2a7934d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3940f3578cc44d4d8ebe074216a65f2e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:24.306711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22f5d-75f6-4ec4-ae5f-d382d2a7934d service swift] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:24.306990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22f5d-75f6-4ec4-ae5f-d382d2a7934d service swift] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:24.307263 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b22f5d-75f6-4ec4-ae5f-d382d2a7934d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:24.316691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b22f5d-75f6-4ec4-ae5f-d382d2a7934d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:24.318344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b22f5d-75f6-4ec4-ae5f-d382d2a7934d service swift] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:24.327774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1363/2718] 10.222.0.25 () {60 vars in 1384 bytes} [Thu Sep 15 19:25:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 15 19:25:24.574838 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524adfcb-1d02-4102-8de6-16677fe49aec None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:24.577381 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-524adfcb-1d02-4102-8de6-16677fe49aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:24.603224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524adfcb-1d02-4102-8de6-16677fe49aec None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:24.610023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5e80b-49a0-487a-a3bf-ccb99b742cb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:24.612527 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5e80b-49a0-487a-a3bf-ccb99b742cb7 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:24.613433 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5e80b-49a0-487a-a3bf-ccb99b742cb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:24.614297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c5e80b-49a0-487a-a3bf-ccb99b742cb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:24.637243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5e80b-49a0-487a-a3bf-ccb99b742cb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:24.638998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c5e80b-49a0-487a-a3bf-ccb99b742cb7 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:24.662446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1356/2719] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:24 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:27.280526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22f5d-75f6-4ec4-ae5f-d382d2a7934d service swift] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:27.283239 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a8b22f5d-75f6-4ec4-ae5f-d382d2a7934d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:27.357596 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:27.389154 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b22f5d-75f6-4ec4-ae5f-d382d2a7934d service swift] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:27.394718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:27.395430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:27.395710 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:27.397295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] PATH_INFO: `/v3/users/4189824c9ac64e20bfa13bb44578956d` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:27.398749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4189824c9ac64e20bfa13bb44578956d)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:27.400925 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:27.467682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4189824c9ac64e20bfa13bb44578956d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:27.482337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4189824c9ac64e20bfa13bb44578956d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:27.483065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4189824c9ac64e20bfa13bb44578956d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:27.483803 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4189824c9ac64e20bfa13bb44578956d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:27.504591 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4189824c9ac64e20bfa13bb44578956d'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:27.530555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1364/2720] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:27 2022] DELETE /identity/v3/users/4189824c9ac64e20bfa13bb44578956d => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:27.732736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5e80b-49a0-487a-a3bf-ccb99b742cb7 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:27.734948 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-77c5e80b-49a0-487a-a3bf-ccb99b742cb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:27.749093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c5e80b-49a0-487a-a3bf-ccb99b742cb7 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:27.822530 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:27.823239 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:27.823590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:27.823829 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] PATH_INFO: `/v3/users/11a32ed239514b8fb6daf9f218603505` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:27.826091 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=11a32ed239514b8fb6daf9f218603505)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:27.828690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:27.894573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11a32ed239514b8fb6daf9f218603505'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:27.907624 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11a32ed239514b8fb6daf9f218603505'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:27.914427 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11a32ed239514b8fb6daf9f218603505'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:27.916672 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11a32ed239514b8fb6daf9f218603505'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:27.930932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11a32ed239514b8fb6daf9f218603505'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:27.960998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1357/2721] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:27 2022] DELETE /identity/v3/users/11a32ed239514b8fb6daf9f218603505 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:27.995606 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:27.997690 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:28.020611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632d3b40-a340-4d26-a354-104f7008437f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:28.111470 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:28.113082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.113384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.113690 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7 admin admin] PATH_INFO: `/v3/projects/785ad4b5570f48a8a068b47bafd16fd9` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.115517 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=785ad4b5570f48a8a068b47bafd16fd9)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:28.119490 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:28.175910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:28.178267 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:28.187881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '785ad4b5570f48a8a068b47bafd16fd9', 'request_id': 'req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.205637 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a5a429-0e01-4b33-8a4c-9ec316b809e2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:28.208059 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '785ad4b5570f48a8a068b47bafd16fd9', 'request_id': 'req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.220672 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '785ad4b5570f48a8a068b47bafd16fd9', 'request_id': 'req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.222232 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:28.238627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7 admin admin] The token cache is being invalidate because project 785ad4b5570f48a8a068b47bafd16fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:28.238867 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.240198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-93af5f5a-8d28-4e4a-a2f0-9d7fd833b5f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.245868 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1365/2722] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:27 2022] DELETE /identity/v3/projects/785ad4b5570f48a8a068b47bafd16fd9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:28.246424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:28.249409 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f778ece-de46-49a2-a5a4-213a29df56a1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.250100 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f778ece-de46-49a2-a5a4-213a29df56a1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.250564 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f778ece-de46-49a2-a5a4-213a29df56a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.275313 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6f778ece-de46-49a2-a5a4-213a29df56a1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:28.276537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6f778ece-de46-49a2-a5a4-213a29df56a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:28.280022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:28.280762 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.281244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.281511 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] PATH_INFO: `/v3/projects/1762892944f74c6a95922126e454a62f` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.283338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1762892944f74c6a95922126e454a62f)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:28.285312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:28.286969 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1366/2723] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:28.296510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114141-4c1d-4198-8e85-e3bd7c32d66f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.296838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114141-4c1d-4198-8e85-e3bd7c32d66f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.297150 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25114141-4c1d-4198-8e85-e3bd7c32d66f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.332252 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-25114141-4c1d-4198-8e85-e3bd7c32d66f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:28.333469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-25114141-4c1d-4198-8e85-e3bd7c32d66f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:28.345539 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1762892944f74c6a95922126e454a62f', 'request_id': 'req-6989278b-48c5-48d7-8025-2c9dae5f94a2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.355862 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1762892944f74c6a95922126e454a62f', 'request_id': 'req-6989278b-48c5-48d7-8025-2c9dae5f94a2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.365304 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1762892944f74c6a95922126e454a62f', 'request_id': 'req-6989278b-48c5-48d7-8025-2c9dae5f94a2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.386792 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] The token cache is being invalidate because project 1762892944f74c6a95922126e454a62f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:28.388561 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.390035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.392544 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1358/2724] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:28 2022] DELETE /identity/v3/projects/1762892944f74c6a95922126e454a62f => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:28.396758 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:28.399125 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:28.409281 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1367/2725] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:25:28.415229 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25114141-4c1d-4198-8e85-e3bd7c32d66f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:28.421791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6989278b-48c5-48d7-8025-2c9dae5f94a2 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:28.427913 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3376dd1-ca90-4da9-a0a3-ab23fde5a3d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:28.428839 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3376dd1-ca90-4da9-a0a3-ab23fde5a3d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.429207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3376dd1-ca90-4da9-a0a3-ab23fde5a3d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.438434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25114141-4c1d-4198-8e85-e3bd7c32d66f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:28.438986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3376dd1-ca90-4da9-a0a3-ab23fde5a3d3 admin admin] PATH_INFO: `/v3/users/acf8a475119d45c0b8511bed1352b3d3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.440920 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3376dd1-ca90-4da9-a0a3-ab23fde5a3d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf8a475119d45c0b8511bed1352b3d3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:28.442908 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3376dd1-ca90-4da9-a0a3-ab23fde5a3d3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:28.445489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db17f5a-c926-40f3-98b1-eb30f9707e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:28.446279 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db17f5a-c926-40f3-98b1-eb30f9707e07 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.447012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db17f5a-c926-40f3-98b1-eb30f9707e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.447251 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db17f5a-c926-40f3-98b1-eb30f9707e07 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.448126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db17f5a-c926-40f3-98b1-eb30f9707e07 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:25:28.448391 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db17f5a-c926-40f3-98b1-eb30f9707e07 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:28.451412 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db17f5a-c926-40f3-98b1-eb30f9707e07 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:28.470063 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1368/2726] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:25:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:25:28.475120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db17f5a-c926-40f3-98b1-eb30f9707e07 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:28.488804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db17f5a-c926-40f3-98b1-eb30f9707e07 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:28.494267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4010b-263d-45fe-8935-3f4d40f4d211 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:28.494493 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4010b-263d-45fe-8935-3f4d40f4d211 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.494619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4010b-263d-45fe-8935-3f4d40f4d211 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.494866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a4010b-263d-45fe-8935-3f4d40f4d211 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.495673 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4010b-263d-45fe-8935-3f4d40f4d211 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:28.497932 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1a4010b-263d-45fe-8935-3f4d40f4d211 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:28.523872 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d3376dd1-ca90-4da9-a0a3-ab23fde5a3d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf8a475119d45c0b8511bed1352b3d3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.538975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d3376dd1-ca90-4da9-a0a3-ab23fde5a3d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf8a475119d45c0b8511bed1352b3d3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.539469 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1369/2727] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:28 2022] POST /identity/v3/projects => generated 373 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:25:28.540669 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d3376dd1-ca90-4da9-a0a3-ab23fde5a3d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf8a475119d45c0b8511bed1352b3d3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.541303 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d3376dd1-ca90-4da9-a0a3-ab23fde5a3d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf8a475119d45c0b8511bed1352b3d3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.543299 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4010b-263d-45fe-8935-3f4d40f4d211 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:28.545015 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a1a4010b-263d-45fe-8935-3f4d40f4d211 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:28.553368 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d3376dd1-ca90-4da9-a0a3-ab23fde5a3d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf8a475119d45c0b8511bed1352b3d3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.582241 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1359/2728] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:28 2022] DELETE /identity/v3/users/acf8a475119d45c0b8511bed1352b3d3 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:25:28.643025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a4010b-263d-45fe-8935-3f4d40f4d211 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:28.704199 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:28.714277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddfe4f-dfc7-4f5d-9388-c00028e3980b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:28.715106 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddfe4f-dfc7-4f5d-9388-c00028e3980b admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.715720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddfe4f-dfc7-4f5d-9388-c00028e3980b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.716600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fddfe4f-dfc7-4f5d-9388-c00028e3980b admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.717206 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fddfe4f-dfc7-4f5d-9388-c00028e3980b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:28.719952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fddfe4f-dfc7-4f5d-9388-c00028e3980b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:28.752862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1370/2729] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:28 2022] POST /identity/v3/users => generated 287 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:28.755309 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3376dd1-ca90-4da9-a0a3-ab23fde5a3d3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:28.770284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3376dd1-ca90-4da9-a0a3-ab23fde5a3d3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:28.776531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee69f99-99b6-4faf-be12-a6e452b96631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:28.777538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee69f99-99b6-4faf-be12-a6e452b96631 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.778010 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee69f99-99b6-4faf-be12-a6e452b96631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.778288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee69f99-99b6-4faf-be12-a6e452b96631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.779246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee69f99-99b6-4faf-be12-a6e452b96631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:28.781983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee69f99-99b6-4faf-be12-a6e452b96631 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:28.796459 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1360/2730] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:28.801451 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddfe4f-dfc7-4f5d-9388-c00028e3980b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:28.812618 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee69f99-99b6-4faf-be12-a6e452b96631 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:28.815808 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fee69f99-99b6-4faf-be12-a6e452b96631 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:28.834912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee69f99-99b6-4faf-be12-a6e452b96631 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:28.836554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fddfe4f-dfc7-4f5d-9388-c00028e3980b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:28.840276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0359ed01-81c7-41e8-b2ce-866232788422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:28.841001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359ed01-81c7-41e8-b2ce-866232788422 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.841342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359ed01-81c7-41e8-b2ce-866232788422 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.841680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0359ed01-81c7-41e8-b2ce-866232788422 admin admin] PATH_INFO: `/v3/projects/f8381f3f6a974da891337e08685f8c61` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.843096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359ed01-81c7-41e8-b2ce-866232788422 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8381f3f6a974da891337e08685f8c61)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:28.844444 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce1821-6b15-4b67-89dc-36af383d5eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:28.845237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0359ed01-81c7-41e8-b2ce-866232788422 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:28.845489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce1821-6b15-4b67-89dc-36af383d5eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.846481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce1821-6b15-4b67-89dc-36af383d5eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.846827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce1821-6b15-4b67-89dc-36af383d5eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.854810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce1821-6b15-4b67-89dc-36af383d5eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:28.856530 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce1821-6b15-4b67-89dc-36af383d5eb6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:28.870067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1371/2731] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:28 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:28.874384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce1821-6b15-4b67-89dc-36af383d5eb6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:28.874620 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:28.885462 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce1821-6b15-4b67-89dc-36af383d5eb6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:28.893704 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bd97ab-850c-4f6d-b688-99c1e7e9ae6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:28.895365 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd97ab-850c-4f6d-b688-99c1e7e9ae6c admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.895749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd97ab-850c-4f6d-b688-99c1e7e9ae6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.896149 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bd97ab-850c-4f6d-b688-99c1e7e9ae6c admin admin] PATH_INFO: `/v3/projects/260bf22894894975a89eaed3bf7dfd3c/users/1373e87c5152416081b7bc8591e49fe3/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.909238 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0359ed01-81c7-41e8-b2ce-866232788422 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8381f3f6a974da891337e08685f8c61', 'request_id': 'req-0359ed01-81c7-41e8-b2ce-866232788422'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.916982 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd97ab-850c-4f6d-b688-99c1e7e9ae6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=260bf22894894975a89eaed3bf7dfd3c, user_id=1373e87c5152416081b7bc8591e49fe3, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:28.917229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0359ed01-81c7-41e8-b2ce-866232788422 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8381f3f6a974da891337e08685f8c61', 'request_id': 'req-0359ed01-81c7-41e8-b2ce-866232788422'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.920621 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87bd97ab-850c-4f6d-b688-99c1e7e9ae6c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:28.927510 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0359ed01-81c7-41e8-b2ce-866232788422 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8381f3f6a974da891337e08685f8c61', 'request_id': 'req-0359ed01-81c7-41e8-b2ce-866232788422'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.938629 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1372/2732] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:28 2022] PUT /identity/v3/projects/260bf22894894975a89eaed3bf7dfd3c/users/1373e87c5152416081b7bc8591e49fe3/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:25:28.940019 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0359ed01-81c7-41e8-b2ce-866232788422 admin admin] The token cache is being invalidate because project f8381f3f6a974da891337e08685f8c61 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:28.940251 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0359ed01-81c7-41e8-b2ce-866232788422 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.940822 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0359ed01-81c7-41e8-b2ce-866232788422 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:28.945601 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1361/2733] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:28 2022] DELETE /identity/v3/projects/f8381f3f6a974da891337e08685f8c61 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:28.945926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79e152-784c-472b-b1f2-bd0d0fbb37aa None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.946167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79e152-784c-472b-b1f2-bd0d0fbb37aa None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.946500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe79e152-784c-472b-b1f2-bd0d0fbb37aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.948129 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfae81e-1e26-4791-9f2a-fe93988f0661 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:28.948481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfae81e-1e26-4791-9f2a-fe93988f0661 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:28.948817 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfae81e-1e26-4791-9f2a-fe93988f0661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:28.968589 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-fe79e152-784c-472b-b1f2-bd0d0fbb37aa None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:28.969965 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fe79e152-784c-472b-b1f2-bd0d0fbb37aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:28.982513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-fdfae81e-1e26-4791-9f2a-fe93988f0661 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:28.983461 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fdfae81e-1e26-4791-9f2a-fe93988f0661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:29.084573 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1362/2734] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:29.107885 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94891f5f-ed45-4fd1-b3c6-10664d61d8e6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:29.108876 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94891f5f-ed45-4fd1-b3c6-10664d61d8e6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:29.108876 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94891f5f-ed45-4fd1-b3c6-10664d61d8e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:29.116354 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1373/2735] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:29.128013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79e152-784c-472b-b1f2-bd0d0fbb37aa None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:29.132445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-fe79e152-784c-472b-b1f2-bd0d0fbb37aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:29.139405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-94891f5f-ed45-4fd1-b3c6-10664d61d8e6 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:29.140998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-94891f5f-ed45-4fd1-b3c6-10664d61d8e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:29.158342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1363/2736] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:29.161644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94891f5f-ed45-4fd1-b3c6-10664d61d8e6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:29.175497 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94891f5f-ed45-4fd1-b3c6-10664d61d8e6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:29.185527 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397ba1f-adfb-4176-93fa-34edff5032e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:29.186454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ba1f-adfb-4176-93fa-34edff5032e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:29.190023 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ba1f-adfb-4176-93fa-34edff5032e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:29.191282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2397ba1f-adfb-4176-93fa-34edff5032e7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:29.192265 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397ba1f-adfb-4176-93fa-34edff5032e7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:25:29.193748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397ba1f-adfb-4176-93fa-34edff5032e7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:29.196306 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2397ba1f-adfb-4176-93fa-34edff5032e7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:29.221845 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1364/2737] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:25:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:25:29.228110 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397ba1f-adfb-4176-93fa-34edff5032e7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:29.245704 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2397ba1f-adfb-4176-93fa-34edff5032e7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:29.252356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eef718-57c5-4fd4-95d5-13188c79391d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:29.253268 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eef718-57c5-4fd4-95d5-13188c79391d admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:29.253549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eef718-57c5-4fd4-95d5-13188c79391d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:29.253861 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65eef718-57c5-4fd4-95d5-13188c79391d admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:29.254508 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eef718-57c5-4fd4-95d5-13188c79391d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:29.257669 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65eef718-57c5-4fd4-95d5-13188c79391d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:29.269035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe79e152-784c-472b-b1f2-bd0d0fbb37aa None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:29.278488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664a847-74b1-43f0-90fa-f1a3799f13de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:29.281192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664a847-74b1-43f0-90fa-f1a3799f13de service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:29.281574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664a847-74b1-43f0-90fa-f1a3799f13de service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:29.282568 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1664a847-74b1-43f0-90fa-f1a3799f13de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:29.297529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664a847-74b1-43f0-90fa-f1a3799f13de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:29.299355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1664a847-74b1-43f0-90fa-f1a3799f13de service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:29.299945 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1365/2738] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:29 2022] POST /identity/v3/projects => generated 359 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:29.305773 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eef718-57c5-4fd4-95d5-13188c79391d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:29.319686 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1374/2739] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:29.424471 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65eef718-57c5-4fd4-95d5-13188c79391d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:29.433146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42bb2-bdae-4db3-94a6-d0aabcfffd9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:29.434204 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42bb2-bdae-4db3-94a6-d0aabcfffd9f admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:29.434607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42bb2-bdae-4db3-94a6-d0aabcfffd9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:29.435050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a42bb2-bdae-4db3-94a6-d0aabcfffd9f admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:29.435971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a42bb2-bdae-4db3-94a6-d0aabcfffd9f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:29.439604 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a42bb2-bdae-4db3-94a6-d0aabcfffd9f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:29.459616 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:29.484215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1366/2740] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:29 2022] POST /identity/v3/users => generated 280 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:29.484743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664a847-74b1-43f0-90fa-f1a3799f13de service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:29.501224 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1664a847-74b1-43f0-90fa-f1a3799f13de service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:29.513825 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af3978-934f-406d-8222-45f3df6786f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:29.515242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af3978-934f-406d-8222-45f3df6786f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:29.516006 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af3978-934f-406d-8222-45f3df6786f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:29.516543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48af3978-934f-406d-8222-45f3df6786f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:29.517824 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af3978-934f-406d-8222-45f3df6786f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:29.520619 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48af3978-934f-406d-8222-45f3df6786f7 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:29.535288 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1375/2741] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:25:29.540736 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42bb2-bdae-4db3-94a6-d0aabcfffd9f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:29.557944 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a42bb2-bdae-4db3-94a6-d0aabcfffd9f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:29.567088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a45984-a782-4770-b590-6c0c458c849b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:29.568403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a45984-a782-4770-b590-6c0c458c849b admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:29.570000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a45984-a782-4770-b590-6c0c458c849b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:29.570542 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a45984-a782-4770-b590-6c0c458c849b admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:29.571647 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a45984-a782-4770-b590-6c0c458c849b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:29.574388 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a45984-a782-4770-b590-6c0c458c849b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:29.596680 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1367/2742] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:29.598631 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af3978-934f-406d-8222-45f3df6786f7 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:29.611058 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48af3978-934f-406d-8222-45f3df6786f7 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:29.617245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c34ae-5774-435f-be14-a8feee5a86a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:29.619214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c34ae-5774-435f-be14-a8feee5a86a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:29.619849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c34ae-5774-435f-be14-a8feee5a86a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:29.620341 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444c34ae-5774-435f-be14-a8feee5a86a3 admin admin] PATH_INFO: `/v3/projects/0531db58188e4f0c80cc925d1fba1205/users/fb4a5a47bbcf4d43b01e5ad1fca68378/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:29.643823 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c34ae-5774-435f-be14-a8feee5a86a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0531db58188e4f0c80cc925d1fba1205, user_id=fb4a5a47bbcf4d43b01e5ad1fca68378, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:29.646780 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444c34ae-5774-435f-be14-a8feee5a86a3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:29.668558 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1376/2743] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:29 2022] PUT /identity/v3/projects/0531db58188e4f0c80cc925d1fba1205/users/fb4a5a47bbcf4d43b01e5ad1fca68378/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:29.681521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239f8b-c8f7-49d6-967e-35afb2d44df5 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:29.681521 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239f8b-c8f7-49d6-967e-35afb2d44df5 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:29.681933 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29239f8b-c8f7-49d6-967e-35afb2d44df5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:29.742158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-29239f8b-c8f7-49d6-967e-35afb2d44df5 None None] MFA Rules not processed for user `fb4a5a47bbcf4d43b01e5ad1fca68378`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:29.745325 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-29239f8b-c8f7-49d6-967e-35afb2d44df5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:29.838042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1368/2744] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:29 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:29.878290 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c34ae-5774-435f-be14-a8feee5a86a3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:29.882266 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-444c34ae-5774-435f-be14-a8feee5a86a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:29.920834 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:29.966140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444c34ae-5774-435f-be14-a8feee5a86a3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:29.970415 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b889e5-5b51-4bb2-b0f1-6090dcd0d810 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:29.971190 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b889e5-5b51-4bb2-b0f1-6090dcd0d810 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:29.971829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b889e5-5b51-4bb2-b0f1-6090dcd0d810 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:29.971829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b889e5-5b51-4bb2-b0f1-6090dcd0d810 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:29.983210 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b889e5-5b51-4bb2-b0f1-6090dcd0d810 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:29.985585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b889e5-5b51-4bb2-b0f1-6090dcd0d810 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:30.002796 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1377/2745] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:29 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:30.014880 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29239f8b-c8f7-49d6-967e-35afb2d44df5 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:30.089518 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29239f8b-c8f7-49d6-967e-35afb2d44df5 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:30.094878 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:30.096253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:30.096545 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:30.096989 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] PATH_INFO: `/v3/users/fb4a5a47bbcf4d43b01e5ad1fca68378` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:30.100108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb4a5a47bbcf4d43b01e5ad1fca68378)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:30.102062 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:30.199066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb4a5a47bbcf4d43b01e5ad1fca68378'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:30.219216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb4a5a47bbcf4d43b01e5ad1fca68378'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:30.221627 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb4a5a47bbcf4d43b01e5ad1fca68378'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:30.223655 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb4a5a47bbcf4d43b01e5ad1fca68378'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:30.240921 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb4a5a47bbcf4d43b01e5ad1fca68378'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:30.260837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:30.279380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1369/2746] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:30 2022] DELETE /identity/v3/users/fb4a5a47bbcf4d43b01e5ad1fca68378 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:30.281567 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a64de-60e8-4717-b0b0-7c37355b4737 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:30.282224 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a64de-60e8-4717-b0b0-7c37355b4737 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:30.282636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12a64de-60e8-4717-b0b0-7c37355b4737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:30.333827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f12a64de-60e8-4717-b0b0-7c37355b4737 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:30.338009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f12a64de-60e8-4717-b0b0-7c37355b4737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:30.437836 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1378/2747] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:30.489714 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:30.493100 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:30.591954 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e7cc2f-6b88-426b-a931-a4a76b115912 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:30.603692 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4732efe5-f888-4e74-bc80-fa39591f6687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:30.604580 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732efe5-f888-4e74-bc80-fa39591f6687 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:30.604941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732efe5-f888-4e74-bc80-fa39591f6687 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:30.605708 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4732efe5-f888-4e74-bc80-fa39591f6687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:30.630570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732efe5-f888-4e74-bc80-fa39591f6687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:30.633429 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4732efe5-f888-4e74-bc80-fa39591f6687 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:30.654300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1370/2748] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:25:31.008246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a64de-60e8-4717-b0b0-7c37355b4737 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:31.010604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f12a64de-60e8-4717-b0b0-7c37355b4737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:31.023051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12a64de-60e8-4717-b0b0-7c37355b4737 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:31.028646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:31.033585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:31.033585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:31.033585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba admin admin] PATH_INFO: `/v3/projects/0531db58188e4f0c80cc925d1fba1205` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:31.035306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=0531db58188e4f0c80cc925d1fba1205)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:31.037140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:31.124584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0531db58188e4f0c80cc925d1fba1205', 'request_id': 'req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:31.144499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0531db58188e4f0c80cc925d1fba1205', 'request_id': 'req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:31.159532 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0531db58188e4f0c80cc925d1fba1205', 'request_id': 'req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:31.183884 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba admin admin] The token cache is being invalidate because project 0531db58188e4f0c80cc925d1fba1205 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:31.184185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:31.185237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-903141ff-2d24-45c0-9f21-bb4cbe50a2ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:31.187420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1379/2749] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:31 2022] DELETE /identity/v3/projects/0531db58188e4f0c80cc925d1fba1205 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:31.192712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193f395-8f21-405c-bce9-fadec969f86e None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:31.193711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193f395-8f21-405c-bce9-fadec969f86e None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:31.194173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6193f395-8f21-405c-bce9-fadec969f86e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:31.241607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-6193f395-8f21-405c-bce9-fadec969f86e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:31.243532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6193f395-8f21-405c-bce9-fadec969f86e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:31.385615 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1371/2750] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:31.394337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83576763-b5fb-472d-8467-d66f8a29f92e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:31.395051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83576763-b5fb-472d-8467-d66f8a29f92e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:31.395051 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83576763-b5fb-472d-8467-d66f8a29f92e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:31.427776 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-83576763-b5fb-472d-8467-d66f8a29f92e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:31.430011 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-83576763-b5fb-472d-8467-d66f8a29f92e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:31.443431 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1380/2751] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:31.446497 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193f395-8f21-405c-bce9-fadec969f86e None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:31.488982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6193f395-8f21-405c-bce9-fadec969f86e None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:31.507567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989405-962f-4f07-8d67-7c2cba8756eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:31.509644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989405-962f-4f07-8d67-7c2cba8756eb admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:31.510285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989405-962f-4f07-8d67-7c2cba8756eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:31.510724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80989405-962f-4f07-8d67-7c2cba8756eb admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:31.511567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80989405-962f-4f07-8d67-7c2cba8756eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:25:31.512038 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80989405-962f-4f07-8d67-7c2cba8756eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:31.513876 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80989405-962f-4f07-8d67-7c2cba8756eb admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:31.531745 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1372/2752] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:25:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:25:31.536801 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83576763-b5fb-472d-8467-d66f8a29f92e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:31.561392 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83576763-b5fb-472d-8467-d66f8a29f92e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:31.567349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e63e3-2617-48be-af03-8555109d4829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:31.568166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e63e3-2617-48be-af03-8555109d4829 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:31.568942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e63e3-2617-48be-af03-8555109d4829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:31.569389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69e63e3-2617-48be-af03-8555109d4829 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:31.572183 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e63e3-2617-48be-af03-8555109d4829 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:31.579118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69e63e3-2617-48be-af03-8555109d4829 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:31.671857 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1381/2753] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:31 2022] POST /identity/v3/projects => generated 377 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:31.676753 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989405-962f-4f07-8d67-7c2cba8756eb admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:31.697875 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80989405-962f-4f07-8d67-7c2cba8756eb admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:31.806033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40410df5-0f9e-4329-bb52-87a5a980b771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:31.807033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40410df5-0f9e-4329-bb52-87a5a980b771 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:31.807546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40410df5-0f9e-4329-bb52-87a5a980b771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:31.808063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40410df5-0f9e-4329-bb52-87a5a980b771 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:31.808934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40410df5-0f9e-4329-bb52-87a5a980b771 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:31.811565 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40410df5-0f9e-4329-bb52-87a5a980b771 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:31.848678 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1373/2754] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:31 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:31.853680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e63e3-2617-48be-af03-8555109d4829 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:31.871895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69e63e3-2617-48be-af03-8555109d4829 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:31.878065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9048c61-94ef-4dc0-b898-d4d9093dbc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:31.878717 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9048c61-94ef-4dc0-b898-d4d9093dbc74 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:31.879461 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9048c61-94ef-4dc0-b898-d4d9093dbc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:31.879709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9048c61-94ef-4dc0-b898-d4d9093dbc74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:31.880372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9048c61-94ef-4dc0-b898-d4d9093dbc74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:31.882129 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9048c61-94ef-4dc0-b898-d4d9093dbc74 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:31.896012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1382/2755] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:25:31.900275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40410df5-0f9e-4329-bb52-87a5a980b771 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:31.922353 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40410df5-0f9e-4329-bb52-87a5a980b771 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:31.931285 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2901a711-2563-4e3f-a17f-59ed619b712b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:31.932050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a711-2563-4e3f-a17f-59ed619b712b admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:31.932458 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a711-2563-4e3f-a17f-59ed619b712b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:31.932809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2901a711-2563-4e3f-a17f-59ed619b712b admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:31.933560 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a711-2563-4e3f-a17f-59ed619b712b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:31.935841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2901a711-2563-4e3f-a17f-59ed619b712b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:31.952648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1374/2756] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:31 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:31.957394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9048c61-94ef-4dc0-b898-d4d9093dbc74 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:31.967777 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:31.976749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9048c61-94ef-4dc0-b898-d4d9093dbc74 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:31.988811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caee679-7821-4a65-9c72-685bf57fe9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:31.991403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caee679-7821-4a65-9c72-685bf57fe9f6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:31.991574 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caee679-7821-4a65-9c72-685bf57fe9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:31.992054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caee679-7821-4a65-9c72-685bf57fe9f6 admin admin] PATH_INFO: `/v3/projects/6e7e5f7cb52b4c6f95b4fc2769efb237/users/616f81265bf34214a67c15b6e02897d1/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:32.043322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caee679-7821-4a65-9c72-685bf57fe9f6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7e5f7cb52b4c6f95b4fc2769efb237, user_id=616f81265bf34214a67c15b6e02897d1, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:32.047368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caee679-7821-4a65-9c72-685bf57fe9f6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:32.073665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1383/2757] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:31 2022] PUT /identity/v3/projects/6e7e5f7cb52b4c6f95b4fc2769efb237/users/616f81265bf34214a67c15b6e02897d1/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:32.086888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594756d-edbf-466b-9cd4-a83eec874505 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:32.087968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594756d-edbf-466b-9cd4-a83eec874505 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:32.087968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a594756d-edbf-466b-9cd4-a83eec874505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:32.101386 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:32.132366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-a594756d-edbf-466b-9cd4-a83eec874505 None None] MFA Rules not processed for user `616f81265bf34214a67c15b6e02897d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:32.133614 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a594756d-edbf-466b-9cd4-a83eec874505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:32.241495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1375/2758] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:32.245669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caee679-7821-4a65-9c72-685bf57fe9f6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:32.307215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594756d-edbf-466b-9cd4-a83eec874505 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:32.308717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a594756d-edbf-466b-9cd4-a83eec874505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:32.365369 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caee679-7821-4a65-9c72-685bf57fe9f6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:32.372876 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1186d4f-2721-4b16-a58c-f5f2c161ce22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:32.373529 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1186d4f-2721-4b16-a58c-f5f2c161ce22 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:32.373837 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1186d4f-2721-4b16-a58c-f5f2c161ce22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:32.374118 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1186d4f-2721-4b16-a58c-f5f2c161ce22 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:32.375027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1186d4f-2721-4b16-a58c-f5f2c161ce22 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:32.376947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1186d4f-2721-4b16-a58c-f5f2c161ce22 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:32.406816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a594756d-edbf-466b-9cd4-a83eec874505 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:32.411866 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1384/2759] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:32 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:32.416432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1186d4f-2721-4b16-a58c-f5f2c161ce22 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:32.417394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:32.418163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:32.418451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:32.418769 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] PATH_INFO: `/v3/users/c411936d2ad447f1a58ecfd3d068607e` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:32.420016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c411936d2ad447f1a58ecfd3d068607e)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:32.422036 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:32.508259 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c411936d2ad447f1a58ecfd3d068607e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:32.520237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c411936d2ad447f1a58ecfd3d068607e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:32.520879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c411936d2ad447f1a58ecfd3d068607e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:32.521568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c411936d2ad447f1a58ecfd3d068607e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:32.535636 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c411936d2ad447f1a58ecfd3d068607e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:32.538907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1186d4f-2721-4b16-a58c-f5f2c161ce22 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:32.545691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ba0ca-25c5-4fa2-a26f-05ac372f3781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:32.547308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba0ca-25c5-4fa2-a26f-05ac372f3781 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:32.547645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba0ca-25c5-4fa2-a26f-05ac372f3781 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:32.548914 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101ba0ca-25c5-4fa2-a26f-05ac372f3781 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:32.549660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ba0ca-25c5-4fa2-a26f-05ac372f3781 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:32.551907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101ba0ca-25c5-4fa2-a26f-05ac372f3781 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:32.575478 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1376/2760] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:32 2022] DELETE /identity/v3/users/c411936d2ad447f1a58ecfd3d068607e => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:32.608083 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1385/2761] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:32 2022] POST /identity/v3/users => generated 289 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:25:32.612715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:32.615054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:32.660207 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:32.756789 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad841e2-9f7b-4b8d-94f6-a0747d084981 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:32.762612 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fba3f-9e80-4244-9464-b977e696a3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:32.763243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fba3f-9e80-4244-9464-b977e696a3e1 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:32.763531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fba3f-9e80-4244-9464-b977e696a3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:32.763809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91fba3f-9e80-4244-9464-b977e696a3e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:32.764444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fba3f-9e80-4244-9464-b977e696a3e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:32.766096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91fba3f-9e80-4244-9464-b977e696a3e1 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:32.780199 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1377/2762] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:32.784282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ba0ca-25c5-4fa2-a26f-05ac372f3781 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:32.796320 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101ba0ca-25c5-4fa2-a26f-05ac372f3781 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:32.804114 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af37dd-0bbf-4f16-a475-45096221c809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:32.804907 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af37dd-0bbf-4f16-a475-45096221c809 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:32.805503 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af37dd-0bbf-4f16-a475-45096221c809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:32.805634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3af37dd-0bbf-4f16-a475-45096221c809 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:32.807238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af37dd-0bbf-4f16-a475-45096221c809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:32.808944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3af37dd-0bbf-4f16-a475-45096221c809 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:32.825879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1386/2763] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:32 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:25:32.827277 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fba3f-9e80-4244-9464-b977e696a3e1 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:32.842059 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91fba3f-9e80-4244-9464-b977e696a3e1 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:32.857418 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1fa47bc-f90d-4c67-8a9d-3ac9b4ea646f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:32.858167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa47bc-f90d-4c67-8a9d-3ac9b4ea646f admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:32.858453 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa47bc-f90d-4c67-8a9d-3ac9b4ea646f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:32.858735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1fa47bc-f90d-4c67-8a9d-3ac9b4ea646f admin admin] PATH_INFO: `/v3/projects/edc76483061d4996ac14357b06840a17/users/344a7de7cae4406fb74b5d44e5b02ac2/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:32.878661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af37dd-0bbf-4f16-a475-45096221c809 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:32.881308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a3af37dd-0bbf-4f16-a475-45096221c809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:32.907369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa47bc-f90d-4c67-8a9d-3ac9b4ea646f admin admin] RBAC: Authorizing `identity:create_grant(project_id=edc76483061d4996ac14357b06840a17, user_id=344a7de7cae4406fb74b5d44e5b02ac2, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:32.909395 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3af37dd-0bbf-4f16-a475-45096221c809 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:32.910420 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1fa47bc-f90d-4c67-8a9d-3ac9b4ea646f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:32.915974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:32.917113 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:32.917531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:32.917972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] PATH_INFO: `/v3/projects/e7aba0d1093340eea44243dc385cc55b` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:32.919488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7aba0d1093340eea44243dc385cc55b)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:32.922036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:32.946120 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1378/2764] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:32 2022] PUT /identity/v3/projects/edc76483061d4996ac14357b06840a17/users/344a7de7cae4406fb74b5d44e5b02ac2/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:32.948675 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8078da-558b-487b-b9a9-688c6d416173 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:32.949583 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8078da-558b-487b-b9a9-688c6d416173 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:32.950058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8078da-558b-487b-b9a9-688c6d416173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:32.995717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4f8078da-558b-487b-b9a9-688c6d416173 None None] MFA Rules not processed for user `344a7de7cae4406fb74b5d44e5b02ac2`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:32.997473 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4f8078da-558b-487b-b9a9-688c6d416173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:33.004242 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:33.054418 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7aba0d1093340eea44243dc385cc55b', 'request_id': 'req-94ca258a-04ae-41f1-b810-a15c3875dcd3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.074244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7aba0d1093340eea44243dc385cc55b', 'request_id': 'req-94ca258a-04ae-41f1-b810-a15c3875dcd3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.104666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7aba0d1093340eea44243dc385cc55b', 'request_id': 'req-94ca258a-04ae-41f1-b810-a15c3875dcd3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.123083 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] The token cache is being invalidate because project e7aba0d1093340eea44243dc385cc55b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:33.123330 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.124115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.135812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1387/2765] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:32 2022] DELETE /identity/v3/projects/e7aba0d1093340eea44243dc385cc55b => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:25:33.137143 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:33.139123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:33.211311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1379/2766] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:33.213201 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8078da-558b-487b-b9a9-688c6d416173 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:33.215362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4f8078da-558b-487b-b9a9-688c6d416173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:33.301587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ca258a-04ae-41f1-b810-a15c3875dcd3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:33.326648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:33.327520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:33.327970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:33.329581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] PATH_INFO: `/v3/users/c63ad0527ddb446b97ecda738980cdeb` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:33.340891 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c63ad0527ddb446b97ecda738980cdeb)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:33.348337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:33.400078 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8078da-558b-487b-b9a9-688c6d416173 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:33.415165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56226c-7f32-48e5-996a-46239d4eb3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:33.416067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56226c-7f32-48e5-996a-46239d4eb3b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:33.416358 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56226c-7f32-48e5-996a-46239d4eb3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:33.416668 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56226c-7f32-48e5-996a-46239d4eb3b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:33.417246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56226c-7f32-48e5-996a-46239d4eb3b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:33.420283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc56226c-7f32-48e5-996a-46239d4eb3b9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:33.473420 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c63ad0527ddb446b97ecda738980cdeb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.479216 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:33.492783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1380/2767] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:33 2022] POST /identity/v3/projects => generated 375 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:33.496850 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56226c-7f32-48e5-996a-46239d4eb3b9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:33.499635 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c63ad0527ddb446b97ecda738980cdeb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.500439 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c63ad0527ddb446b97ecda738980cdeb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.501402 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c63ad0527ddb446b97ecda738980cdeb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.525318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c63ad0527ddb446b97ecda738980cdeb'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.571499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1388/2768] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:33 2022] DELETE /identity/v3/users/c63ad0527ddb446b97ecda738980cdeb => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:33.604550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56226c-7f32-48e5-996a-46239d4eb3b9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:33.685602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84f1e8-5ac8-4bb9-9ec9-421b6e9a91f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:33.686475 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84f1e8-5ac8-4bb9-9ec9-421b6e9a91f0 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:33.686844 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84f1e8-5ac8-4bb9-9ec9-421b6e9a91f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:33.687228 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab84f1e8-5ac8-4bb9-9ec9-421b6e9a91f0 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:33.687968 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84f1e8-5ac8-4bb9-9ec9-421b6e9a91f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:33.690462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab84f1e8-5ac8-4bb9-9ec9-421b6e9a91f0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:33.725450 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1381/2769] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:33 2022] POST /identity/v3/users => generated 294 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:33.729934 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:33.731329 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:33.749516 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2542cfc3-2607-4e0b-a08a-7c6dcd6c7238 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:33.759374 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b3a43-27f8-4ada-bd86-7a65bc043fd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:33.765774 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b3a43-27f8-4ada-bd86-7a65bc043fd1 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:33.766356 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b3a43-27f8-4ada-bd86-7a65bc043fd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:33.766777 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b3a43-27f8-4ada-bd86-7a65bc043fd1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:33.767824 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b3a43-27f8-4ada-bd86-7a65bc043fd1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:33.769862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b3a43-27f8-4ada-bd86-7a65bc043fd1 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:33.790343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84f1e8-5ac8-4bb9-9ec9-421b6e9a91f0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:33.790585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1389/2770] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:33.792225 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ab84f1e8-5ac8-4bb9-9ec9-421b6e9a91f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:33.792459 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b3a43-27f8-4ada-bd86-7a65bc043fd1 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:33.804545 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b3a43-27f8-4ada-bd86-7a65bc043fd1 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:33.806823 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab84f1e8-5ac8-4bb9-9ec9-421b6e9a91f0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:33.810579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0800902-63ef-493e-8327-454acd157c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:33.811790 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800902-63ef-493e-8327-454acd157c5c admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:33.812270 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800902-63ef-493e-8327-454acd157c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:33.812688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0800902-63ef-493e-8327-454acd157c5c admin admin] PATH_INFO: `/v3/projects/5209deeed01c425a98fe6302781159b6/users/2ca5bc888a674ef5beacfdc38735bf4f/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:33.820816 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:33.823456 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:33.823862 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:33.824712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] PATH_INFO: `/v3/projects/415eeb500b004e538624ce3dff7e3509` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:33.826165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] RBAC: Authorizing `identity:delete_project(project_id=415eeb500b004e538624ce3dff7e3509)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:33.829103 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:33.834741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0800902-63ef-493e-8327-454acd157c5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=5209deeed01c425a98fe6302781159b6, user_id=2ca5bc888a674ef5beacfdc38735bf4f, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:33.837646 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0800902-63ef-493e-8327-454acd157c5c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:33.866660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1390/2771] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:33 2022] PUT /identity/v3/projects/5209deeed01c425a98fe6302781159b6/users/2ca5bc888a674ef5beacfdc38735bf4f/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:33.868072 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0800902-63ef-493e-8327-454acd157c5c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:33.882627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:33.921454 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '415eeb500b004e538624ce3dff7e3509', 'request_id': 'req-80f81999-e5eb-4a0d-90d1-f19b5537525c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.929137 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '415eeb500b004e538624ce3dff7e3509', 'request_id': 'req-80f81999-e5eb-4a0d-90d1-f19b5537525c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.941209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '415eeb500b004e538624ce3dff7e3509', 'request_id': 'req-80f81999-e5eb-4a0d-90d1-f19b5537525c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.962558 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] The token cache is being invalidate because project 415eeb500b004e538624ce3dff7e3509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:33.963034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.963842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:33.964000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0800902-63ef-493e-8327-454acd157c5c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:33.967695 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1382/2772] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:33 2022] DELETE /identity/v3/projects/415eeb500b004e538624ce3dff7e3509 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:25:34.046071 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6200818-bcca-44e5-8a0f-95df9d5b0061 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:34.047081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6200818-bcca-44e5-8a0f-95df9d5b0061 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:34.047466 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6200818-bcca-44e5-8a0f-95df9d5b0061 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:34.047848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6200818-bcca-44e5-8a0f-95df9d5b0061 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:34.049077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6200818-bcca-44e5-8a0f-95df9d5b0061 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:34.051007 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6200818-bcca-44e5-8a0f-95df9d5b0061 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:34.067200 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1391/2773] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:33 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:34.071745 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:34.075416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:34.100892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f81999-e5eb-4a0d-90d1-f19b5537525c admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:34.112080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465f0b4-1081-4ef7-8c22-1fcd84f637a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:34.112981 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f0b4-1081-4ef7-8c22-1fcd84f637a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:34.113907 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f0b4-1081-4ef7-8c22-1fcd84f637a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:34.114269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465f0b4-1081-4ef7-8c22-1fcd84f637a4 admin admin] PATH_INFO: `/v3/projects/5209deeed01c425a98fe6302781159b6/users/2ca5bc888a674ef5beacfdc38735bf4f/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:34.117747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465f0b4-1081-4ef7-8c22-1fcd84f637a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5209deeed01c425a98fe6302781159b6, user_id=2ca5bc888a674ef5beacfdc38735bf4f, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:34.123094 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465f0b4-1081-4ef7-8c22-1fcd84f637a4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:34.147528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1383/2774] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:34 2022] PUT /identity/v3/projects/5209deeed01c425a98fe6302781159b6/users/2ca5bc888a674ef5beacfdc38735bf4f/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:34.229100 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a76089-2ac2-407c-9858-885a41a1813a None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:34.229546 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a76089-2ac2-407c-9858-885a41a1813a None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:34.230880 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a76089-2ac2-407c-9858-885a41a1813a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:34.280970 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d7a76089-2ac2-407c-9858-885a41a1813a None None] MFA Rules not processed for user `2ca5bc888a674ef5beacfdc38735bf4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:34.283943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d7a76089-2ac2-407c-9858-885a41a1813a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:34.441221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1392/2775] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:34 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:34.450497 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465f0b4-1081-4ef7-8c22-1fcd84f637a4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:34.453118 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d465f0b4-1081-4ef7-8c22-1fcd84f637a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:34.463873 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:34.574859 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465f0b4-1081-4ef7-8c22-1fcd84f637a4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:34.587730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451105ec-7f62-4b55-a9aa-ecdc92c8cba4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:34.588384 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451105ec-7f62-4b55-a9aa-ecdc92c8cba4 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:34.588659 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451105ec-7f62-4b55-a9aa-ecdc92c8cba4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:34.588937 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451105ec-7f62-4b55-a9aa-ecdc92c8cba4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:34.593918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-451105ec-7f62-4b55-a9aa-ecdc92c8cba4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:34.708922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451105ec-7f62-4b55-a9aa-ecdc92c8cba4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:34.710617 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451105ec-7f62-4b55-a9aa-ecdc92c8cba4 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:34.723090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1384/2776] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:35.431661 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e1f0c-c362-4166-8368-4fb63fc7debb None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:35.432617 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e1f0c-c362-4166-8368-4fb63fc7debb None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:35.433770 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9e1f0c-c362-4166-8368-4fb63fc7debb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:35.466862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4d9e1f0c-c362-4166-8368-4fb63fc7debb None None] MFA Rules not processed for user `1373e87c5152416081b7bc8591e49fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:35.468222 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4d9e1f0c-c362-4166-8368-4fb63fc7debb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:35.500952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:35.544618 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1393/2777] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:25:35.549379 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451105ec-7f62-4b55-a9aa-ecdc92c8cba4 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:35.550894 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-451105ec-7f62-4b55-a9aa-ecdc92c8cba4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:35.629445 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451105ec-7f62-4b55-a9aa-ecdc92c8cba4 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:35.634155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192d89f-5afc-47d3-9aa1-a518652a1795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:35.634791 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192d89f-5afc-47d3-9aa1-a518652a1795 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:35.635072 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192d89f-5afc-47d3-9aa1-a518652a1795 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:35.635348 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4192d89f-5afc-47d3-9aa1-a518652a1795 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:35.635995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192d89f-5afc-47d3-9aa1-a518652a1795 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:35.637936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4192d89f-5afc-47d3-9aa1-a518652a1795 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:35.669231 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1385/2778] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:35 2022] POST /identity/v3/projects => generated 371 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:35.673917 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e1f0c-c362-4166-8368-4fb63fc7debb None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:35.685238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9e1f0c-c362-4166-8368-4fb63fc7debb None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:35.757374 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021f781-219e-41a2-aa14-1937a8c467c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:35.758062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021f781-219e-41a2-aa14-1937a8c467c1 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:35.758339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021f781-219e-41a2-aa14-1937a8c467c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:35.758607 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c021f781-219e-41a2-aa14-1937a8c467c1 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:35.759245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021f781-219e-41a2-aa14-1937a8c467c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:35.761185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c021f781-219e-41a2-aa14-1937a8c467c1 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:35.793507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1394/2779] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:35 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:25:35.797643 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192d89f-5afc-47d3-9aa1-a518652a1795 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:35.809438 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4192d89f-5afc-47d3-9aa1-a518652a1795 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:35.816569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2171f-0c8f-4f8c-9783-8f0cea73b5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:35.817229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2171f-0c8f-4f8c-9783-8f0cea73b5c3 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:35.817613 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2171f-0c8f-4f8c-9783-8f0cea73b5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:35.817936 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb2171f-0c8f-4f8c-9783-8f0cea73b5c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:35.818728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2171f-0c8f-4f8c-9783-8f0cea73b5c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:35.820319 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb2171f-0c8f-4f8c-9783-8f0cea73b5c3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:35.834034 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1386/2780] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:35.838296 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021f781-219e-41a2-aa14-1937a8c467c1 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:35.852958 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c021f781-219e-41a2-aa14-1937a8c467c1 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:35.877234 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c00eb9-03ac-4ddc-93af-adff59c9adae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:35.877929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c00eb9-03ac-4ddc-93af-adff59c9adae admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:35.878178 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c00eb9-03ac-4ddc-93af-adff59c9adae admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:35.878474 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c00eb9-03ac-4ddc-93af-adff59c9adae admin admin] PATH_INFO: `/v3/projects/e88d9769c2d84465ada503b1da248d99/users/982b10d1169741eb9bc590d031ccc11b/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:35.903926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c00eb9-03ac-4ddc-93af-adff59c9adae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88d9769c2d84465ada503b1da248d99, user_id=982b10d1169741eb9bc590d031ccc11b, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:35.903926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c00eb9-03ac-4ddc-93af-adff59c9adae admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:35.933362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1395/2781] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:35 2022] PUT /identity/v3/projects/e88d9769c2d84465ada503b1da248d99/users/982b10d1169741eb9bc590d031ccc11b/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:35.934644 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2171f-0c8f-4f8c-9783-8f0cea73b5c3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:35.945340 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb2171f-0c8f-4f8c-9783-8f0cea73b5c3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:35.985774 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:36.017898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43581474-b2a9-4949-8d94-23ffebcdba63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:36.018692 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43581474-b2a9-4949-8d94-23ffebcdba63 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:36.019197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43581474-b2a9-4949-8d94-23ffebcdba63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:36.019570 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43581474-b2a9-4949-8d94-23ffebcdba63 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:36.020331 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43581474-b2a9-4949-8d94-23ffebcdba63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:36.022338 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43581474-b2a9-4949-8d94-23ffebcdba63 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:36.034371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1387/2782] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:35 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:36.038376 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c00eb9-03ac-4ddc-93af-adff59c9adae admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:36.051295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c00eb9-03ac-4ddc-93af-adff59c9adae admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:36.056562 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bcb36-aae7-4f19-935c-a0707b07cc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:36.057555 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bcb36-aae7-4f19-935c-a0707b07cc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:36.058076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bcb36-aae7-4f19-935c-a0707b07cc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:36.058524 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446bcb36-aae7-4f19-935c-a0707b07cc94 admin admin] PATH_INFO: `/v3/projects/e88d9769c2d84465ada503b1da248d99/users/982b10d1169741eb9bc590d031ccc11b/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:36.060796 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bcb36-aae7-4f19-935c-a0707b07cc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e88d9769c2d84465ada503b1da248d99, user_id=982b10d1169741eb9bc590d031ccc11b, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:36.063760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446bcb36-aae7-4f19-935c-a0707b07cc94 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:36.077146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1396/2783] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:36 2022] PUT /identity/v3/projects/e88d9769c2d84465ada503b1da248d99/users/982b10d1169741eb9bc590d031ccc11b/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:36.519282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43581474-b2a9-4949-8d94-23ffebcdba63 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:36.609451 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43581474-b2a9-4949-8d94-23ffebcdba63 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:36.679229 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb43e7-4520-415f-83bc-5698cc3cdf92 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:36.680017 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb43e7-4520-415f-83bc-5698cc3cdf92 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:36.680258 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb43e7-4520-415f-83bc-5698cc3cdf92 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:36.680528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb43e7-4520-415f-83bc-5698cc3cdf92 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:36.682747 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-78cb43e7-4520-415f-83bc-5698cc3cdf92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:36.774446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb43e7-4520-415f-83bc-5698cc3cdf92 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:36.776314 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb43e7-4520-415f-83bc-5698cc3cdf92 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:36.790879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1388/2784] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 273 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:37.672440 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bcb36-aae7-4f19-935c-a0707b07cc94 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:37.685899 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446bcb36-aae7-4f19-935c-a0707b07cc94 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:37.691295 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6fc880-b808-4b82-9e2b-5f493cf1f349 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:37.691926 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc880-b808-4b82-9e2b-5f493cf1f349 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:37.692214 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc880-b808-4b82-9e2b-5f493cf1f349 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:37.692484 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6fc880-b808-4b82-9e2b-5f493cf1f349 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:37.798531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fc880-b808-4b82-9e2b-5f493cf1f349 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:37.799822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b6fc880-b808-4b82-9e2b-5f493cf1f349 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:37.814081 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1397/2785] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:38.695248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb43e7-4520-415f-83bc-5698cc3cdf92 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:38.696952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-78cb43e7-4520-415f-83bc-5698cc3cdf92 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:38.759970 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=100 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:38.793403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb43e7-4520-415f-83bc-5698cc3cdf92 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:38.801273 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:38.802027 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:38.802389 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:38.802878 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] PATH_INFO: `/v3/users/72b18bfe4f0b464da097eeda9304bb8c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:38.804186 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72b18bfe4f0b464da097eeda9304bb8c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:38.806785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:38.898366 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72b18bfe4f0b464da097eeda9304bb8c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:38.911854 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72b18bfe4f0b464da097eeda9304bb8c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:38.913031 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72b18bfe4f0b464da097eeda9304bb8c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:38.914336 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72b18bfe4f0b464da097eeda9304bb8c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:38.925043 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72b18bfe4f0b464da097eeda9304bb8c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:38.975839 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1389/2786] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:38 2022] DELETE /identity/v3/users/72b18bfe4f0b464da097eeda9304bb8c => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:38.977400 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4b724-cb62-4588-a1c1-3342d523b382 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:38.978342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4b724-cb62-4588-a1c1-3342d523b382 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:38.978767 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd4b724-cb62-4588-a1c1-3342d523b382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:39.028911 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4dd4b724-cb62-4588-a1c1-3342d523b382 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:39.035593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4dd4b724-cb62-4588-a1c1-3342d523b382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:39.056822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:39.176966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1398/2787] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:39.188818 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:39.190354 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:39.365914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a6e164e-de21-4b86-979b-7ee10a74b654 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:39.383751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cb5b8-d1f6-48a7-aef0-9a3b8dd1a0e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:39.384476 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cb5b8-d1f6-48a7-aef0-9a3b8dd1a0e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:39.384662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cb5b8-d1f6-48a7-aef0-9a3b8dd1a0e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:39.384935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443cb5b8-d1f6-48a7-aef0-9a3b8dd1a0e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:39.426529 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cb5b8-d1f6-48a7-aef0-9a3b8dd1a0e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:39.427982 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443cb5b8-d1f6-48a7-aef0-9a3b8dd1a0e5 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:39.464282 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1390/2788] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:39.889351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4b724-cb62-4588-a1c1-3342d523b382 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:39.891476 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4dd4b724-cb62-4588-a1c1-3342d523b382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:39.917319 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd4b724-cb62-4588-a1c1-3342d523b382 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:39.935946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:39.936633 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:39.936913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:39.937192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] PATH_INFO: `/v3/projects/f2ae4ed47d264feb97b5cd5c123785a2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:39.938611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2ae4ed47d264feb97b5cd5c123785a2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:39.940556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:40.067362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2ae4ed47d264feb97b5cd5c123785a2', 'request_id': 'req-dfe21d6e-212a-40ca-870e-31807ee1248e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:40.081803 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2ae4ed47d264feb97b5cd5c123785a2', 'request_id': 'req-dfe21d6e-212a-40ca-870e-31807ee1248e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:40.106267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2ae4ed47d264feb97b5cd5c123785a2', 'request_id': 'req-dfe21d6e-212a-40ca-870e-31807ee1248e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:40.132582 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] The token cache is being invalidate because project f2ae4ed47d264feb97b5cd5c123785a2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:40.133386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:40.134662 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:40.139744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1399/2789] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:39 2022] DELETE /identity/v3/projects/f2ae4ed47d264feb97b5cd5c123785a2 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:40.144276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cb5b8-d1f6-48a7-aef0-9a3b8dd1a0e5 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:40.157525 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443cb5b8-d1f6-48a7-aef0-9a3b8dd1a0e5 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:40.255195 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d46492-9a6c-4bac-8dc3-538aade0a15b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:40.255864 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d46492-9a6c-4bac-8dc3-538aade0a15b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:40.256143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d46492-9a6c-4bac-8dc3-538aade0a15b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:40.256543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d46492-9a6c-4bac-8dc3-538aade0a15b admin admin] PATH_INFO: `/v3/users/3321b2082b094b3284bbef5021df180c` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:40.258404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d46492-9a6c-4bac-8dc3-538aade0a15b admin admin] RBAC: Authorizing `identity:delete_user(user_id=3321b2082b094b3284bbef5021df180c)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:40.260490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d46492-9a6c-4bac-8dc3-538aade0a15b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:40.266399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:40.359561 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a4d46492-9a6c-4bac-8dc3-538aade0a15b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3321b2082b094b3284bbef5021df180c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:40.394213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a4d46492-9a6c-4bac-8dc3-538aade0a15b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3321b2082b094b3284bbef5021df180c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:40.395356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a4d46492-9a6c-4bac-8dc3-538aade0a15b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3321b2082b094b3284bbef5021df180c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:40.396183 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a4d46492-9a6c-4bac-8dc3-538aade0a15b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3321b2082b094b3284bbef5021df180c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:40.405584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a4d46492-9a6c-4bac-8dc3-538aade0a15b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3321b2082b094b3284bbef5021df180c'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:40.457682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1391/2790] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:40 2022] DELETE /identity/v3/users/3321b2082b094b3284bbef5021df180c => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:41.270296 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:41.275049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:41.349719 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe21d6e-212a-40ca-870e-31807ee1248e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:41.520112 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:41.521179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:41.521654 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:41.522117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e admin admin] PATH_INFO: `/v3/projects/afabfb380b6c4028a672df57c94edbff` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:41.523797 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e admin admin] RBAC: Authorizing `identity:delete_project(project_id=afabfb380b6c4028a672df57c94edbff)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:41.527493 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:41.607455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:41.627667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afabfb380b6c4028a672df57c94edbff', 'request_id': 'req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:41.649368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afabfb380b6c4028a672df57c94edbff', 'request_id': 'req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:41.663959 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afabfb380b6c4028a672df57c94edbff', 'request_id': 'req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:41.684211 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e admin admin] The token cache is being invalidate because project afabfb380b6c4028a672df57c94edbff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:41.685773 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:41.686563 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7e8fe4d1-47ec-4ad3-a9fb-51e9cfe4728e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:41.688151 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1400/2791] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:41 2022] DELETE /identity/v3/projects/afabfb380b6c4028a672df57c94edbff => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:41.693861 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26f601-e15d-4845-be27-f377abf06b6f None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:41.694449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26f601-e15d-4845-be27-f377abf06b6f None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:41.694449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd26f601-e15d-4845-be27-f377abf06b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:41.743571 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-cd26f601-e15d-4845-be27-f377abf06b6f None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:41.744889 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cd26f601-e15d-4845-be27-f377abf06b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:41.893444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1392/2792] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:41.894760 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9034586-2132-4bd9-90fa-0d8f36e1e035 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:41.895043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9034586-2132-4bd9-90fa-0d8f36e1e035 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:41.895314 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9034586-2132-4bd9-90fa-0d8f36e1e035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:41.927084 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f9034586-2132-4bd9-90fa-0d8f36e1e035 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:41.928342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f9034586-2132-4bd9-90fa-0d8f36e1e035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:41.951520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1401/2793] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:41.958950 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26f601-e15d-4845-be27-f377abf06b6f None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:41.981853 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd26f601-e15d-4845-be27-f377abf06b6f None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:41.998155 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ea973-7648-49af-856b-5976f69ca963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:41.999608 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ea973-7648-49af-856b-5976f69ca963 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:42.000075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ea973-7648-49af-856b-5976f69ca963 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:42.000619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1ea973-7648-49af-856b-5976f69ca963 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:42.001241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b799a5b-3215-4338-9931-8b1c11f7beb6 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:42.001611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b799a5b-3215-4338-9931-8b1c11f7beb6 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:42.001971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ea973-7648-49af-856b-5976f69ca963 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:25:42.002528 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ea973-7648-49af-856b-5976f69ca963 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:42.003153 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b799a5b-3215-4338-9931-8b1c11f7beb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:42.006070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1ea973-7648-49af-856b-5976f69ca963 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:42.031020 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1393/2794] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:25:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:25:42.037352 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ea973-7648-49af-856b-5976f69ca963 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:42.049311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1ea973-7648-49af-856b-5976f69ca963 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:42.060343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf6ae0-1abb-4f75-9cc3-8cb27b52f79e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:42.060991 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf6ae0-1abb-4f75-9cc3-8cb27b52f79e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:42.061266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf6ae0-1abb-4f75-9cc3-8cb27b52f79e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:42.061526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf6ae0-1abb-4f75-9cc3-8cb27b52f79e admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:42.062241 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf6ae0-1abb-4f75-9cc3-8cb27b52f79e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:42.064393 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf6ae0-1abb-4f75-9cc3-8cb27b52f79e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:42.089885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-9b799a5b-3215-4338-9931-8b1c11f7beb6 None None] MFA Rules not processed for user `982b10d1169741eb9bc590d031ccc11b`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:42.092592 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9b799a5b-3215-4338-9931-8b1c11f7beb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:42.118175 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1394/2795] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:42 2022] POST /identity/v3/projects => generated 387 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:42.123403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf6ae0-1abb-4f75-9cc3-8cb27b52f79e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:42.219842 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:42.232743 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1402/2796] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:41 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:42.244879 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf6ae0-1abb-4f75-9cc3-8cb27b52f79e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:42.247332 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b799a5b-3215-4338-9931-8b1c11f7beb6 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:42.249652 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9b799a5b-3215-4338-9931-8b1c11f7beb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:42.261124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cc00e-9b5c-42be-9319-b32a67f41e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:42.261761 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cc00e-9b5c-42be-9319-b32a67f41e1b admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:42.262119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cc00e-9b5c-42be-9319-b32a67f41e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:42.262394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5cc00e-9b5c-42be-9319-b32a67f41e1b admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:42.263073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cc00e-9b5c-42be-9319-b32a67f41e1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:42.265135 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5cc00e-9b5c-42be-9319-b32a67f41e1b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:42.297118 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1395/2797] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:42 2022] POST /identity/v3/users => generated 294 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:25:42.298602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cc00e-9b5c-42be-9319-b32a67f41e1b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:42.313415 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5cc00e-9b5c-42be-9319-b32a67f41e1b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:42.320551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f631f2c-1bb9-476e-8981-e71e81d9cd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:42.321206 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f631f2c-1bb9-476e-8981-e71e81d9cd2d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:42.321506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f631f2c-1bb9-476e-8981-e71e81d9cd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:42.321775 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f631f2c-1bb9-476e-8981-e71e81d9cd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:42.322536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f631f2c-1bb9-476e-8981-e71e81d9cd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:42.324442 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f631f2c-1bb9-476e-8981-e71e81d9cd2d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:42.337826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1396/2798] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:42.342891 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f631f2c-1bb9-476e-8981-e71e81d9cd2d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:42.356496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f631f2c-1bb9-476e-8981-e71e81d9cd2d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:42.362745 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af830fbe-0dac-46dc-accf-8821557f68f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:42.363841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af830fbe-0dac-46dc-accf-8821557f68f9 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:42.364123 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af830fbe-0dac-46dc-accf-8821557f68f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:42.364389 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af830fbe-0dac-46dc-accf-8821557f68f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:42.365051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af830fbe-0dac-46dc-accf-8821557f68f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:42.366979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af830fbe-0dac-46dc-accf-8821557f68f9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:42.379614 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1397/2799] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:42 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:42.383892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af830fbe-0dac-46dc-accf-8821557f68f9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:42.386518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b799a5b-3215-4338-9931-8b1c11f7beb6 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:42.395394 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af830fbe-0dac-46dc-accf-8821557f68f9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:42.400748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2978b9-6c73-4caf-84fa-7d96aa0328b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:42.401438 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2978b9-6c73-4caf-84fa-7d96aa0328b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:42.401717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2978b9-6c73-4caf-84fa-7d96aa0328b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:42.402047 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2978b9-6c73-4caf-84fa-7d96aa0328b7 admin admin] PATH_INFO: `/v3/projects/92ca316e6abf460085baefd5be792a33/users/17c94f299df745129ee658b2aae91198/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:42.420898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2978b9-6c73-4caf-84fa-7d96aa0328b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92ca316e6abf460085baefd5be792a33, user_id=17c94f299df745129ee658b2aae91198, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:42.424487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2978b9-6c73-4caf-84fa-7d96aa0328b7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:42.449177 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:42.449614 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1398/2800] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:42 2022] PUT /identity/v3/projects/92ca316e6abf460085baefd5be792a33/users/17c94f299df745129ee658b2aae91198/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:25:42.460676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd55c3-b829-4b4f-89a4-afd16acc0868 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:42.461011 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd55c3-b829-4b4f-89a4-afd16acc0868 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:42.461220 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dd55c3-b829-4b4f-89a4-afd16acc0868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:42.505055 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f5dd55c3-b829-4b4f-89a4-afd16acc0868 None None] MFA Rules not processed for user `17c94f299df745129ee658b2aae91198`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:42.506164 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc175c4-ba99-44f6-b44f-e82aa444c020 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:42.506344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc175c4-ba99-44f6-b44f-e82aa444c020 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:42.506560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc175c4-ba99-44f6-b44f-e82aa444c020 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:42.506681 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f5dd55c3-b829-4b4f-89a4-afd16acc0868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:42.506827 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc175c4-ba99-44f6-b44f-e82aa444c020 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:42.512386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3fc175c4-ba99-44f6-b44f-e82aa444c020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:42.596437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc175c4-ba99-44f6-b44f-e82aa444c020 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:42.598301 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc175c4-ba99-44f6-b44f-e82aa444c020 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:42.611881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1403/2801] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:42 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:25:42.625636 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc175c4-ba99-44f6-b44f-e82aa444c020 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:42.627307 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-3fc175c4-ba99-44f6-b44f-e82aa444c020 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:42.636060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1399/2802] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:25:42.642121 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd55c3-b829-4b4f-89a4-afd16acc0868 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:42.648714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc175c4-ba99-44f6-b44f-e82aa444c020 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:42.761273 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f441751-7ce0-4535-bf32-007297411ce4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:42.762434 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f441751-7ce0-4535-bf32-007297411ce4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:42.764438 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f441751-7ce0-4535-bf32-007297411ce4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:42.764805 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f441751-7ce0-4535-bf32-007297411ce4 admin admin] PATH_INFO: `/v3/users/616f81265bf34214a67c15b6e02897d1` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:42.765279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dd55c3-b829-4b4f-89a4-afd16acc0868 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:42.767851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f441751-7ce0-4535-bf32-007297411ce4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=616f81265bf34214a67c15b6e02897d1)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:42.770554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f441751-7ce0-4535-bf32-007297411ce4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:42.771782 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfbf58-c80b-44c2-8200-699b5f8e8692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:42.772439 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfbf58-c80b-44c2-8200-699b5f8e8692 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:42.772722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfbf58-c80b-44c2-8200-699b5f8e8692 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:42.772992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bfbf58-c80b-44c2-8200-699b5f8e8692 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:42.773745 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfbf58-c80b-44c2-8200-699b5f8e8692 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:42.777951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bfbf58-c80b-44c2-8200-699b5f8e8692 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:42.840620 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1400/2803] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:42 2022] POST /identity/v3/projects => generated 387 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:42.844750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfbf58-c80b-44c2-8200-699b5f8e8692 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:42.861598 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:42.881278 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2f441751-7ce0-4535-bf32-007297411ce4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '616f81265bf34214a67c15b6e02897d1'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:42.896301 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2f441751-7ce0-4535-bf32-007297411ce4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '616f81265bf34214a67c15b6e02897d1'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:42.897362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2f441751-7ce0-4535-bf32-007297411ce4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '616f81265bf34214a67c15b6e02897d1'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:42.898117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2f441751-7ce0-4535-bf32-007297411ce4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '616f81265bf34214a67c15b6e02897d1'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:42.911668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2f441751-7ce0-4535-bf32-007297411ce4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '616f81265bf34214a67c15b6e02897d1'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:42.956173 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1404/2804] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:42 2022] DELETE /identity/v3/users/616f81265bf34214a67c15b6e02897d1 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:42.961080 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51991c-061b-4687-85e7-e022942c82f8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:42.961535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51991c-061b-4687-85e7-e022942c82f8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:42.962120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf51991c-061b-4687-85e7-e022942c82f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:42.971532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bfbf58-c80b-44c2-8200-699b5f8e8692 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:42.973389 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:42.989674 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-cf51991c-061b-4687-85e7-e022942c82f8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:42.992001 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cf51991c-061b-4687-85e7-e022942c82f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:43.060563 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c20e4-9cee-448c-b233-95324bd57911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:43.061378 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c20e4-9cee-448c-b233-95324bd57911 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:43.062089 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c20e4-9cee-448c-b233-95324bd57911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:43.062837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709c20e4-9cee-448c-b233-95324bd57911 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:43.063959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c20e4-9cee-448c-b233-95324bd57911 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:43.066301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709c20e4-9cee-448c-b233-95324bd57911 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:43.099158 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1401/2805] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:42 2022] POST /identity/v3/users => generated 294 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:25:43.102784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1405/2806] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:43.106697 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51991c-061b-4687-85e7-e022942c82f8 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:43.109714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cf51991c-061b-4687-85e7-e022942c82f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:43.116086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c20e4-9cee-448c-b233-95324bd57911 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:43.117949 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-709c20e4-9cee-448c-b233-95324bd57911 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:43.130833 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf51991c-061b-4687-85e7-e022942c82f8 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:43.138086 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556a722-f5d9-4abe-a516-acc6a143605b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:43.138765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556a722-f5d9-4abe-a516-acc6a143605b admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:43.139045 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556a722-f5d9-4abe-a516-acc6a143605b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:43.139311 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5556a722-f5d9-4abe-a516-acc6a143605b admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:43.139966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556a722-f5d9-4abe-a516-acc6a143605b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:43.141955 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5556a722-f5d9-4abe-a516-acc6a143605b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:43.154971 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1406/2807] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:43.162144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556a722-f5d9-4abe-a516-acc6a143605b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:43.177041 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5556a722-f5d9-4abe-a516-acc6a143605b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:43.185013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdee78-6430-4cf4-aa7a-210ad5c517bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:43.185978 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdee78-6430-4cf4-aa7a-210ad5c517bf admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:43.186437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdee78-6430-4cf4-aa7a-210ad5c517bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:43.192379 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bdee78-6430-4cf4-aa7a-210ad5c517bf admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:43.193321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdee78-6430-4cf4-aa7a-210ad5c517bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:43.195082 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bdee78-6430-4cf4-aa7a-210ad5c517bf admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:43.210730 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1407/2808] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:43.213333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdee78-6430-4cf4-aa7a-210ad5c517bf admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:43.226287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bdee78-6430-4cf4-aa7a-210ad5c517bf admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:43.231604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdb3502-ed6d-4ba6-8ed6-3d18dac2b204 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:43.232343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb3502-ed6d-4ba6-8ed6-3d18dac2b204 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:43.232627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb3502-ed6d-4ba6-8ed6-3d18dac2b204 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:43.232904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdb3502-ed6d-4ba6-8ed6-3d18dac2b204 admin admin] PATH_INFO: `/v3/projects/5a9de652ee4145c1b192591dab76f4f0/users/e69f8ac8e61e4a78ae6656e867f7702e/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:43.246856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709c20e4-9cee-448c-b233-95324bd57911 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:43.254643 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5579f-7b49-44a2-a876-84d1e5aed9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:43.255633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5579f-7b49-44a2-a876-84d1e5aed9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:43.256008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5579f-7b49-44a2-a876-84d1e5aed9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:43.256376 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca5579f-7b49-44a2-a876-84d1e5aed9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:43.259198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb3502-ed6d-4ba6-8ed6-3d18dac2b204 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a9de652ee4145c1b192591dab76f4f0, user_id=e69f8ac8e61e4a78ae6656e867f7702e, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:43.262786 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbdb3502-ed6d-4ba6-8ed6-3d18dac2b204 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:43.272221 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5579f-7b49-44a2-a876-84d1e5aed9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:43.273990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca5579f-7b49-44a2-a876-84d1e5aed9e9 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:43.283013 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1408/2809] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:43 2022] PUT /identity/v3/projects/5a9de652ee4145c1b192591dab76f4f0/users/e69f8ac8e61e4a78ae6656e867f7702e/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:43.290439 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1402/2810] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:25:43.293547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219d763-b8f1-4fff-8a88-d161a3fecb98 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:43.293968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219d763-b8f1-4fff-8a88-d161a3fecb98 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:43.294302 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f219d763-b8f1-4fff-8a88-d161a3fecb98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:43.337703 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f219d763-b8f1-4fff-8a88-d161a3fecb98 None None] MFA Rules not processed for user `e69f8ac8e61e4a78ae6656e867f7702e`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:43.339002 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f219d763-b8f1-4fff-8a88-d161a3fecb98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:43.423192 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1409/2811] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:43 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:43.428648 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5579f-7b49-44a2-a876-84d1e5aed9e9 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:43.454275 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca5579f-7b49-44a2-a876-84d1e5aed9e9 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:43.527248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:43.556361 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37557f-1b0d-4eef-891b-6149cc67e9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:43.557929 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37557f-1b0d-4eef-891b-6149cc67e9d9 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:43.558326 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37557f-1b0d-4eef-891b-6149cc67e9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:43.558703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a37557f-1b0d-4eef-891b-6149cc67e9d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:43.559474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37557f-1b0d-4eef-891b-6149cc67e9d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:43.561499 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a37557f-1b0d-4eef-891b-6149cc67e9d9 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:43.608056 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1403/2812] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:43 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:43.612936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219d763-b8f1-4fff-8a88-d161a3fecb98 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:43.639043 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f219d763-b8f1-4fff-8a88-d161a3fecb98 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:43.735520 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37557f-1b0d-4eef-891b-6149cc67e9d9 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:43.737322 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-2a37557f-1b0d-4eef-891b-6149cc67e9d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:43.754549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:43.773714 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c01f-fc62-4385-89bd-b2f8055cfa13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:43.774218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c01f-fc62-4385-89bd-b2f8055cfa13 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:43.774509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c01f-fc62-4385-89bd-b2f8055cfa13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:43.774781 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b94c01f-fc62-4385-89bd-b2f8055cfa13 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:43.775990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94c01f-fc62-4385-89bd-b2f8055cfa13 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:43.777554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b94c01f-fc62-4385-89bd-b2f8055cfa13 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:43.811432 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1410/2813] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:43 2022] POST /identity/v3/users => generated 299 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:25:43.817593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c01f-fc62-4385-89bd-b2f8055cfa13 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:43.830488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b94c01f-fc62-4385-89bd-b2f8055cfa13 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:43.837368 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30a27d-1988-4768-9497-54b5cf4e610a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:43.838047 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30a27d-1988-4768-9497-54b5cf4e610a admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:43.839100 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30a27d-1988-4768-9497-54b5cf4e610a admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:43.839100 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30a27d-1988-4768-9497-54b5cf4e610a admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:43.840292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30a27d-1988-4768-9497-54b5cf4e610a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:43.842016 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f30a27d-1988-4768-9497-54b5cf4e610a admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:43.861762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1411/2814] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:25:43.866446 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30a27d-1988-4768-9497-54b5cf4e610a admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:43.878061 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f30a27d-1988-4768-9497-54b5cf4e610a admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:43.881837 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a37557f-1b0d-4eef-891b-6149cc67e9d9 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:43.883048 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401f94e-acce-4561-97a5-a9d5675c12bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:43.883811 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401f94e-acce-4561-97a5-a9d5675c12bd admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:43.884172 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401f94e-acce-4561-97a5-a9d5675c12bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:43.884508 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0401f94e-acce-4561-97a5-a9d5675c12bd admin admin] PATH_INFO: `/v3/projects/410c5a9902ac463299b1f1a8a4579419/users/0f08195e78c14f67a0096d9567ff466b/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:43.886963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:43.887724 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:43.888067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:43.888350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] PATH_INFO: `/v3/projects/6e7e5f7cb52b4c6f95b4fc2769efb237` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:43.889565 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7e5f7cb52b4c6f95b4fc2769efb237)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:43.891683 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:43.907522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401f94e-acce-4561-97a5-a9d5675c12bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=410c5a9902ac463299b1f1a8a4579419, user_id=0f08195e78c14f67a0096d9567ff466b, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:43.910961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0401f94e-acce-4561-97a5-a9d5675c12bd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:43.941107 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1412/2815] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:43 2022] PUT /identity/v3/projects/410c5a9902ac463299b1f1a8a4579419/users/0f08195e78c14f67a0096d9567ff466b/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:25:43.946499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401f94e-acce-4561-97a5-a9d5675c12bd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:43.962671 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7e5f7cb52b4c6f95b4fc2769efb237', 'request_id': 'req-f62d50dd-3c05-45af-967d-ed236d4d0a2e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:43.970122 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7e5f7cb52b4c6f95b4fc2769efb237', 'request_id': 'req-f62d50dd-3c05-45af-967d-ed236d4d0a2e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:43.983370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7e5f7cb52b4c6f95b4fc2769efb237', 'request_id': 'req-f62d50dd-3c05-45af-967d-ed236d4d0a2e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:44.007107 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] The token cache is being invalidate because project 6e7e5f7cb52b4c6f95b4fc2769efb237 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:44.007633 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:44.009105 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:44.013910 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1404/2816] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:43 2022] DELETE /identity/v3/projects/6e7e5f7cb52b4c6f95b4fc2769efb237 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:25:44.021188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:44.022977 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:44.052765 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0401f94e-acce-4561-97a5-a9d5675c12bd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:44.112281 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62d50dd-3c05-45af-967d-ed236d4d0a2e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:44.118388 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb00ea0-53b1-4f81-9cf3-6ead5e060446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:44.119449 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00ea0-53b1-4f81-9cf3-6ead5e060446 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:44.119868 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00ea0-53b1-4f81-9cf3-6ead5e060446 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:44.120200 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb00ea0-53b1-4f81-9cf3-6ead5e060446 admin admin] PATH_INFO: `/v3/users/344a7de7cae4406fb74b5d44e5b02ac2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:44.121798 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb00ea0-53b1-4f81-9cf3-6ead5e060446 admin admin] RBAC: Authorizing `identity:delete_user(user_id=344a7de7cae4406fb74b5d44e5b02ac2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:44.124042 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb00ea0-53b1-4f81-9cf3-6ead5e060446 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:44.126584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:44.130394 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934e7fd-acc2-4e69-a9ea-6f66efadc249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:44.131189 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934e7fd-acc2-4e69-a9ea-6f66efadc249 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:44.131537 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934e7fd-acc2-4e69-a9ea-6f66efadc249 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:44.131879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9934e7fd-acc2-4e69-a9ea-6f66efadc249 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:44.132991 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934e7fd-acc2-4e69-a9ea-6f66efadc249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:44.134779 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9934e7fd-acc2-4e69-a9ea-6f66efadc249 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:44.154308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1413/2817] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:43 2022] GET /identity/v3/roles => generated 1420 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:25:44.156550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934e7fd-acc2-4e69-a9ea-6f66efadc249 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:44.160193 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-9934e7fd-acc2-4e69-a9ea-6f66efadc249 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:44.181921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9934e7fd-acc2-4e69-a9ea-6f66efadc249 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:44.187977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62243102-875d-44b3-8129-4e70231e4d86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:44.188845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62243102-875d-44b3-8129-4e70231e4d86 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:44.189184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62243102-875d-44b3-8129-4e70231e4d86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:44.189585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62243102-875d-44b3-8129-4e70231e4d86 admin admin] PATH_INFO: `/v3/projects/410c5a9902ac463299b1f1a8a4579419/users/0f08195e78c14f67a0096d9567ff466b/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:44.197755 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbb00ea0-53b1-4f81-9cf3-6ead5e060446 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '344a7de7cae4406fb74b5d44e5b02ac2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:44.199496 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62243102-875d-44b3-8129-4e70231e4d86 admin admin] RBAC: Authorizing `identity:create_grant(project_id=410c5a9902ac463299b1f1a8a4579419, user_id=0f08195e78c14f67a0096d9567ff466b, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:44.202821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62243102-875d-44b3-8129-4e70231e4d86 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:44.211702 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbb00ea0-53b1-4f81-9cf3-6ead5e060446 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '344a7de7cae4406fb74b5d44e5b02ac2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:44.212626 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbb00ea0-53b1-4f81-9cf3-6ead5e060446 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '344a7de7cae4406fb74b5d44e5b02ac2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:44.223202 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbb00ea0-53b1-4f81-9cf3-6ead5e060446 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '344a7de7cae4406fb74b5d44e5b02ac2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:44.223558 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1414/2818] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:44 2022] PUT /identity/v3/projects/410c5a9902ac463299b1f1a8a4579419/users/0f08195e78c14f67a0096d9567ff466b/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:44.225832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-bbb00ea0-53b1-4f81-9cf3-6ead5e060446 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '344a7de7cae4406fb74b5d44e5b02ac2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:44.229028 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0843f-6e70-4f51-b566-a892f59ffa36 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:44.229447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0843f-6e70-4f51-b566-a892f59ffa36 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:44.229593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c0843f-6e70-4f51-b566-a892f59ffa36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:44.250406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1405/2819] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:44 2022] DELETE /identity/v3/users/344a7de7cae4406fb74b5d44e5b02ac2 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:44.253947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-c3c0843f-6e70-4f51-b566-a892f59ffa36 None None] MFA Rules not processed for user `1373e87c5152416081b7bc8591e49fe3`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:44.253947 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c3c0843f-6e70-4f51-b566-a892f59ffa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:44.256074 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adb809-cd6f-40a4-9ecc-5cb93e2eb9c6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:44.256543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adb809-cd6f-40a4-9ecc-5cb93e2eb9c6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:44.257027 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7adb809-cd6f-40a4-9ecc-5cb93e2eb9c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:44.298939 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-e7adb809-cd6f-40a4-9ecc-5cb93e2eb9c6 None None] MFA Rules not processed for user `0f08195e78c14f67a0096d9567ff466b`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:44.300509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e7adb809-cd6f-40a4-9ecc-5cb93e2eb9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:44.312968 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:44.378095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1415/2820] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:44.424676 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1406/2821] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:44 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:44.436877 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0843f-6e70-4f51-b566-a892f59ffa36 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:44.439243 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-c3c0843f-6e70-4f51-b566-a892f59ffa36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:44.552984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c0843f-6e70-4f51-b566-a892f59ffa36 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:44.558593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24e68-b86e-40c4-8363-61dccbe8b4a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:44.559410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24e68-b86e-40c4-8363-61dccbe8b4a0 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:44.559695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24e68-b86e-40c4-8363-61dccbe8b4a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:44.559972 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de24e68-b86e-40c4-8363-61dccbe8b4a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:44.590302 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de24e68-b86e-40c4-8363-61dccbe8b4a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:44.592349 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de24e68-b86e-40c4-8363-61dccbe8b4a0 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:44.597700 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adb809-cd6f-40a4-9ecc-5cb93e2eb9c6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:44.600778 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-e7adb809-cd6f-40a4-9ecc-5cb93e2eb9c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:44.608216 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1416/2822] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:44 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:44.710479 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7adb809-cd6f-40a4-9ecc-5cb93e2eb9c6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:44.717505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:44.718380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:44.718672 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:44.718941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] PATH_INFO: `/v3/projects/edc76483061d4996ac14357b06840a17` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:44.720197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edc76483061d4996ac14357b06840a17)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:44.722746 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:44.739503 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:44.814917 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edc76483061d4996ac14357b06840a17', 'request_id': 'req-d59929fd-dc09-4c58-88f8-ca3b60788f02'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:44.823008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edc76483061d4996ac14357b06840a17', 'request_id': 'req-d59929fd-dc09-4c58-88f8-ca3b60788f02'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:44.833547 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edc76483061d4996ac14357b06840a17', 'request_id': 'req-d59929fd-dc09-4c58-88f8-ca3b60788f02'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:44.861344 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] The token cache is being invalidate because project edc76483061d4996ac14357b06840a17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:44.862197 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:44.863090 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:44.872060 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1407/2823] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:44 2022] DELETE /identity/v3/projects/edc76483061d4996ac14357b06840a17 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:44.874390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24e68-b86e-40c4-8363-61dccbe8b4a0 service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:44.887851 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de24e68-b86e-40c4-8363-61dccbe8b4a0 service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:44.976556 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:44.976936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:44.977406 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:44.977865 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] PATH_INFO: `/v3/users/2ca5bc888a674ef5beacfdc38735bf4f` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:44.979426 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ca5bc888a674ef5beacfdc38735bf4f)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:44.981944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:45.087310 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ca5bc888a674ef5beacfdc38735bf4f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:45.098966 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ca5bc888a674ef5beacfdc38735bf4f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:45.099666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ca5bc888a674ef5beacfdc38735bf4f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:45.100453 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ca5bc888a674ef5beacfdc38735bf4f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:45.109126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ca5bc888a674ef5beacfdc38735bf4f'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:45.126875 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:45.137372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1417/2824] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:44 2022] DELETE /identity/v3/users/2ca5bc888a674ef5beacfdc38735bf4f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:45.438918 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:45.441727 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:45.523979 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:45.526166 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:45.565299 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59929fd-dc09-4c58-88f8-ca3b60788f02 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:45.627105 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30b9caf-9c2c-4db6-ba59-83a000915fed admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:45.634292 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:45.635188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:45.635538 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:45.635879 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92 admin admin] PATH_INFO: `/v3/projects/5209deeed01c425a98fe6302781159b6` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:45.637362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5209deeed01c425a98fe6302781159b6)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:45.639678 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:45.650088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c42a204-5d92-4104-8e7f-8442dc1c9d41 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:45.650841 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a204-5d92-4104-8e7f-8442dc1c9d41 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:45.651001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a204-5d92-4104-8e7f-8442dc1c9d41 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:45.651272 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c42a204-5d92-4104-8e7f-8442dc1c9d41 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:45.653088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-5c42a204-5d92-4104-8e7f-8442dc1c9d41 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:45.717822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5209deeed01c425a98fe6302781159b6', 'request_id': 'req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:45.725712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5209deeed01c425a98fe6302781159b6', 'request_id': 'req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:45.737373 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5209deeed01c425a98fe6302781159b6', 'request_id': 'req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:45.754182 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92 admin admin] The token cache is being invalidate because project 5209deeed01c425a98fe6302781159b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:45.755464 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:45.756410 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-7e20d5fa-1686-42bc-bfe3-06b6ba3a6c92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:45.758316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1418/2825] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:45 2022] DELETE /identity/v3/projects/5209deeed01c425a98fe6302781159b6 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:45.762922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42a204-5d92-4104-8e7f-8442dc1c9d41 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:45.762922 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c42a204-5d92-4104-8e7f-8442dc1c9d41 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:45.764682 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76671bca-b5d7-4786-a6a4-6f492e43bcb3 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:45.766133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76671bca-b5d7-4786-a6a4-6f492e43bcb3 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:45.766623 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76671bca-b5d7-4786-a6a4-6f492e43bcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:45.773946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1408/2826] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:45.794375 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-76671bca-b5d7-4786-a6a4-6f492e43bcb3 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:45.795812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-76671bca-b5d7-4786-a6a4-6f492e43bcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:45.889055 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1419/2827] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:45.897952 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa570de-e210-48cc-8e79-82680d6c94a1 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:45.898374 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa570de-e210-48cc-8e79-82680d6c94a1 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:45.898683 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa570de-e210-48cc-8e79-82680d6c94a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:45.912241 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:45.923792 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-faa570de-e210-48cc-8e79-82680d6c94a1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:45.925839 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-faa570de-e210-48cc-8e79-82680d6c94a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:45.936943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1409/2828] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:45.941689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76671bca-b5d7-4786-a6a4-6f492e43bcb3 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:45.953149 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76671bca-b5d7-4786-a6a4-6f492e43bcb3 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:45.959579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93eeae-3920-4259-b7a6-8454f154a5f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:45.960476 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93eeae-3920-4259-b7a6-8454f154a5f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:45.960742 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93eeae-3920-4259-b7a6-8454f154a5f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:45.961018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b93eeae-3920-4259-b7a6-8454f154a5f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:45.961676 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93eeae-3920-4259-b7a6-8454f154a5f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:25:45.962028 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93eeae-3920-4259-b7a6-8454f154a5f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:45.963683 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b93eeae-3920-4259-b7a6-8454f154a5f4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:45.981831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1420/2829] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:25:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:25:45.984052 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa570de-e210-48cc-8e79-82680d6c94a1 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:45.995784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa570de-e210-48cc-8e79-82680d6c94a1 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:46.007749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1bef5-4215-496b-8846-ffdfe09dd7b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:46.015030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1bef5-4215-496b-8846-ffdfe09dd7b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:46.015260 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1bef5-4215-496b-8846-ffdfe09dd7b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:46.015754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1bef5-4215-496b-8846-ffdfe09dd7b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:46.016735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1bef5-4215-496b-8846-ffdfe09dd7b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:46.019412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1bef5-4215-496b-8846-ffdfe09dd7b7 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:46.055985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1410/2830] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:45 2022] POST /identity/v3/projects => generated 399 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:46.060946 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93eeae-3920-4259-b7a6-8454f154a5f4 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:46.083268 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b93eeae-3920-4259-b7a6-8454f154a5f4 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:46.107757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:46.226608 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf213e24-68ea-4c13-9fb2-8b7ef5325079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:46.227497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf213e24-68ea-4c13-9fb2-8b7ef5325079 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:46.227941 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf213e24-68ea-4c13-9fb2-8b7ef5325079 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:46.228531 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf213e24-68ea-4c13-9fb2-8b7ef5325079 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:46.229351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf213e24-68ea-4c13-9fb2-8b7ef5325079 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:46.234792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf213e24-68ea-4c13-9fb2-8b7ef5325079 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:46.287577 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1421/2831] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:46 2022] POST /identity/v3/users => generated 300 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:46.291751 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1bef5-4215-496b-8846-ffdfe09dd7b7 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:46.316634 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1bef5-4215-496b-8846-ffdfe09dd7b7 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:46.324807 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628fcc4-f7b0-4f33-a4d3-6dc324d15f1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:46.326369 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628fcc4-f7b0-4f33-a4d3-6dc324d15f1f admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:46.326502 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628fcc4-f7b0-4f33-a4d3-6dc324d15f1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:46.327013 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f628fcc4-f7b0-4f33-a4d3-6dc324d15f1f admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:46.328163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628fcc4-f7b0-4f33-a4d3-6dc324d15f1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:46.334150 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f628fcc4-f7b0-4f33-a4d3-6dc324d15f1f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:46.357401 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1411/2832] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:46.362205 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf213e24-68ea-4c13-9fb2-8b7ef5325079 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:46.374872 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf213e24-68ea-4c13-9fb2-8b7ef5325079 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:46.386329 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e9517-9302-4e41-961a-5cb6cb46df86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:46.387198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e9517-9302-4e41-961a-5cb6cb46df86 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:46.387676 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e9517-9302-4e41-961a-5cb6cb46df86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:46.387912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e9517-9302-4e41-961a-5cb6cb46df86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:46.388578 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e9517-9302-4e41-961a-5cb6cb46df86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:46.392621 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e9517-9302-4e41-961a-5cb6cb46df86 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:46.407733 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1422/2833] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:46 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:46.412423 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628fcc4-f7b0-4f33-a4d3-6dc324d15f1f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:46.425588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f628fcc4-f7b0-4f33-a4d3-6dc324d15f1f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:46.432641 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a1028-44a2-4ea2-ac52-4a88e3887df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:46.433424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1028-44a2-4ea2-ac52-4a88e3887df5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:46.433754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1028-44a2-4ea2-ac52-4a88e3887df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:46.434112 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538a1028-44a2-4ea2-ac52-4a88e3887df5 admin admin] PATH_INFO: `/v3/projects/49159099ff1243ce81e7f4ae22f72011/users/7b728e19f1924833ba5740d115e1cf36/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:46.453112 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a1028-44a2-4ea2-ac52-4a88e3887df5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=49159099ff1243ce81e7f4ae22f72011, user_id=7b728e19f1924833ba5740d115e1cf36, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:46.456505 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538a1028-44a2-4ea2-ac52-4a88e3887df5 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:46.475252 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1412/2834] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:46 2022] PUT /identity/v3/projects/49159099ff1243ce81e7f4ae22f72011/users/7b728e19f1924833ba5740d115e1cf36/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:46.487208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc282542-c1fd-4580-b8a5-2932a071a05f None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:46.487458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc282542-c1fd-4580-b8a5-2932a071a05f None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:46.487725 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc282542-c1fd-4580-b8a5-2932a071a05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:46.522579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-cc282542-c1fd-4580-b8a5-2932a071a05f None None] MFA Rules not processed for user `7b728e19f1924833ba5740d115e1cf36`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:46.524049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-cc282542-c1fd-4580-b8a5-2932a071a05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:46.630560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1423/2835] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:46.648824 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a1028-44a2-4ea2-ac52-4a88e3887df5 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:46.650749 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-538a1028-44a2-4ea2-ac52-4a88e3887df5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:46.746558 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538a1028-44a2-4ea2-ac52-4a88e3887df5 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:46.761093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8b4f0-98af-4066-bad4-bd01473ff577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:46.761093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8b4f0-98af-4066-bad4-bd01473ff577 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:46.761093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8b4f0-98af-4066-bad4-bd01473ff577 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:46.761093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8b4f0-98af-4066-bad4-bd01473ff577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:46.771404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8b4f0-98af-4066-bad4-bd01473ff577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:46.773030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8b4f0-98af-4066-bad4-bd01473ff577 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:46.785025 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1413/2836] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:46 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:50.434185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc282542-c1fd-4580-b8a5-2932a071a05f None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:50.446028 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc282542-c1fd-4580-b8a5-2932a071a05f None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:50.450485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8e0b05-d99a-4130-95eb-1c319bfd80fa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:50.451113 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e0b05-d99a-4130-95eb-1c319bfd80fa service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:50.451390 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e0b05-d99a-4130-95eb-1c319bfd80fa service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:50.451657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8e0b05-d99a-4130-95eb-1c319bfd80fa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:50.453744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-ba8e0b05-d99a-4130-95eb-1c319bfd80fa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:50.526322 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e0b05-d99a-4130-95eb-1c319bfd80fa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:50.528167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8e0b05-d99a-4130-95eb-1c319bfd80fa service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:50.540571 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1424/2837] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:50 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:52.240103 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8b4f0-98af-4066-bad4-bd01473ff577 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:52.322182 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8b4f0-98af-4066-bad4-bd01473ff577 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:52.326932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:52.327581 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:52.327854 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:52.328119 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] PATH_INFO: `/v3/users/7b728e19f1924833ba5740d115e1cf36` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:52.329766 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b728e19f1924833ba5740d115e1cf36)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:52.331732 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:52.389584 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:52.391655 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b728e19f1924833ba5740d115e1cf36'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:52.401743 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b728e19f1924833ba5740d115e1cf36'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:52.403163 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b728e19f1924833ba5740d115e1cf36'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:52.404000 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b728e19f1924833ba5740d115e1cf36'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:52.411815 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b728e19f1924833ba5740d115e1cf36'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:52.433566 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1414/2838] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:52 2022] DELETE /identity/v3/users/7b728e19f1924833ba5740d115e1cf36 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:52.439185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470f90d-6758-4349-acf3-a1c9ff273558 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:52.439810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470f90d-6758-4349-acf3-a1c9ff273558 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:52.439810 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f470f90d-6758-4349-acf3-a1c9ff273558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:52.461634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f470f90d-6758-4349-acf3-a1c9ff273558 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:52.462831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f470f90d-6758-4349-acf3-a1c9ff273558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:52.484481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:52.554123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1425/2839] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:52.573356 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:52.575115 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:52.681803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cad77a-8d1a-40ef-b7b3-c35761ddb194 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:52.688332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69607832-932a-4dd5-a66a-f3121b2f43a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:52.689297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607832-932a-4dd5-a66a-f3121b2f43a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:52.689980 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607832-932a-4dd5-a66a-f3121b2f43a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:52.690355 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69607832-932a-4dd5-a66a-f3121b2f43a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:52.705180 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69607832-932a-4dd5-a66a-f3121b2f43a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:52.706168 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69607832-932a-4dd5-a66a-f3121b2f43a9 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:52.718181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1415/2840] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:53.090998 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470f90d-6758-4349-acf3-a1c9ff273558 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:53.092862 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f470f90d-6758-4349-acf3-a1c9ff273558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:53.107688 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f470f90d-6758-4349-acf3-a1c9ff273558 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:53.116089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b905dc6b-b974-4c50-bb3f-c78059458b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:53.116805 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905dc6b-b974-4c50-bb3f-c78059458b34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:53.117199 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905dc6b-b974-4c50-bb3f-c78059458b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:53.117477 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b905dc6b-b974-4c50-bb3f-c78059458b34 admin admin] PATH_INFO: `/v3/users/17c94f299df745129ee658b2aae91198` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:53.118821 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905dc6b-b974-4c50-bb3f-c78059458b34 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17c94f299df745129ee658b2aae91198)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:53.121036 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b905dc6b-b974-4c50-bb3f-c78059458b34 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:53.133481 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69607832-932a-4dd5-a66a-f3121b2f43a9 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:53.135603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-69607832-932a-4dd5-a66a-f3121b2f43a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:53.162785 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69607832-932a-4dd5-a66a-f3121b2f43a9 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:53.175526 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:53.176226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:53.176666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:53.177054 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] PATH_INFO: `/v3/projects/49159099ff1243ce81e7f4ae22f72011` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:53.179750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] RBAC: Authorizing `identity:delete_project(project_id=49159099ff1243ce81e7f4ae22f72011)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:53.182795 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:53.209602 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b905dc6b-b974-4c50-bb3f-c78059458b34 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17c94f299df745129ee658b2aae91198'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:53.222891 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b905dc6b-b974-4c50-bb3f-c78059458b34 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17c94f299df745129ee658b2aae91198'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:53.223649 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b905dc6b-b974-4c50-bb3f-c78059458b34 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17c94f299df745129ee658b2aae91198'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:53.224352 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b905dc6b-b974-4c50-bb3f-c78059458b34 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17c94f299df745129ee658b2aae91198'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:53.234460 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b905dc6b-b974-4c50-bb3f-c78059458b34 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17c94f299df745129ee658b2aae91198'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:53.258676 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1426/2841] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:53 2022] DELETE /identity/v3/users/17c94f299df745129ee658b2aae91198 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:53.263588 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db4669-232b-47ae-ae6a-a68743116ec8 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:53.264089 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db4669-232b-47ae-ae6a-a68743116ec8 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:53.264362 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db4669-232b-47ae-ae6a-a68743116ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:53.268330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '49159099ff1243ce81e7f4ae22f72011', 'request_id': 'req-4f0218a6-eb86-4535-9cbe-9408bb71e915'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:53.275606 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '49159099ff1243ce81e7f4ae22f72011', 'request_id': 'req-4f0218a6-eb86-4535-9cbe-9408bb71e915'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:53.288198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '49159099ff1243ce81e7f4ae22f72011', 'request_id': 'req-4f0218a6-eb86-4535-9cbe-9408bb71e915'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:53.296478 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-e0db4669-232b-47ae-ae6a-a68743116ec8 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:53.298668 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e0db4669-232b-47ae-ae6a-a68743116ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:53.318483 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] The token cache is being invalidate because project 49159099ff1243ce81e7f4ae22f72011 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:53.319895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:53.321888 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:53.324399 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1416/2842] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:53 2022] DELETE /identity/v3/projects/49159099ff1243ce81e7f4ae22f72011 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:53.381489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1427/2843] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:53.393543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:53.395661 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:53.488209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:53.493756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0218a6-eb86-4535-9cbe-9408bb71e915 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:53.568103 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a0b3-4f8c-4725-99b0-fc51e789e273 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:53.569088 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a0b3-4f8c-4725-99b0-fc51e789e273 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:53.569578 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a0b3-4f8c-4725-99b0-fc51e789e273 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:53.570111 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e63a0b3-4f8c-4725-99b0-fc51e789e273 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:53.587784 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63a0b3-4f8c-4725-99b0-fc51e789e273 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:53.590245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e63a0b3-4f8c-4725-99b0-fc51e789e273 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:53.609230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1417/2844] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:53.946445 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db4669-232b-47ae-ae6a-a68743116ec8 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:53.948832 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e0db4669-232b-47ae-ae6a-a68743116ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:53.966977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db4669-232b-47ae-ae6a-a68743116ec8 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:53.977241 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:53.978370 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:53.978844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:53.979327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] PATH_INFO: `/v3/projects/92ca316e6abf460085baefd5be792a33` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:53.981342 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92ca316e6abf460085baefd5be792a33)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:53.986065 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:54.044452 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:54.067905 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92ca316e6abf460085baefd5be792a33', 'request_id': 'req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.077386 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92ca316e6abf460085baefd5be792a33', 'request_id': 'req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.088566 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92ca316e6abf460085baefd5be792a33', 'request_id': 'req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.105140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] The token cache is being invalidate because project 92ca316e6abf460085baefd5be792a33 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:54.105435 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.106194 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.107895 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1428/2845] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:53 2022] DELETE /identity/v3/projects/92ca316e6abf460085baefd5be792a33 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:54.113218 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a0b3-4f8c-4725-99b0-fc51e789e273 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:54.125876 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e63a0b3-4f8c-4725-99b0-fc51e789e273 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:54.225224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:54.226101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:54.226408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:54.226677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] PATH_INFO: `/v3/users/e69f8ac8e61e4a78ae6656e867f7702e` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:54.228026 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] RBAC: Authorizing `identity:delete_user(user_id=e69f8ac8e61e4a78ae6656e867f7702e)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:54.230051 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:54.295814 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e69f8ac8e61e4a78ae6656e867f7702e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.307317 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e69f8ac8e61e4a78ae6656e867f7702e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.308280 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e69f8ac8e61e4a78ae6656e867f7702e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.309096 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e69f8ac8e61e4a78ae6656e867f7702e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.320112 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e69f8ac8e61e4a78ae6656e867f7702e'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.349444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1418/2846] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:54 2022] DELETE /identity/v3/users/e69f8ac8e61e4a78ae6656e867f7702e => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:54.708819 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:54.710547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:54.726425 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724db38b-78a1-48c1-b9f4-2e6933b2a2d1 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:54.795535 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:54.796202 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:54.796485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:54.796775 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] PATH_INFO: `/v3/projects/5a9de652ee4145c1b192591dab76f4f0` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:54.798731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a9de652ee4145c1b192591dab76f4f0)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:54.800665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:54.869073 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a9de652ee4145c1b192591dab76f4f0', 'request_id': 'req-6f274e13-913b-4242-8669-d3e3162471a6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.876912 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a9de652ee4145c1b192591dab76f4f0', 'request_id': 'req-6f274e13-913b-4242-8669-d3e3162471a6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.888012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a9de652ee4145c1b192591dab76f4f0', 'request_id': 'req-6f274e13-913b-4242-8669-d3e3162471a6'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.901547 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] The token cache is being invalidate because project 5a9de652ee4145c1b192591dab76f4f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:54.901856 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.902584 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:54.904167 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1429/2847] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:54 2022] DELETE /identity/v3/projects/5a9de652ee4145c1b192591dab76f4f0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:54.909307 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:54.910941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:54.924895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85ae00-43fe-4aa0-a8d7-09bd54ddf48b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:54.965568 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:55.027209 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122da6e-4edc-4356-8b7e-2f672ca092fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:55.028332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122da6e-4edc-4356-8b7e-2f672ca092fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:55.028813 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122da6e-4edc-4356-8b7e-2f672ca092fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:55.029288 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122da6e-4edc-4356-8b7e-2f672ca092fe admin admin] PATH_INFO: `/v3/users/0f08195e78c14f67a0096d9567ff466b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:55.031549 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122da6e-4edc-4356-8b7e-2f672ca092fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=0f08195e78c14f67a0096d9567ff466b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:55.035712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a122da6e-4edc-4356-8b7e-2f672ca092fe admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:55.112001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a122da6e-4edc-4356-8b7e-2f672ca092fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0f08195e78c14f67a0096d9567ff466b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:55.122284 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a122da6e-4edc-4356-8b7e-2f672ca092fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0f08195e78c14f67a0096d9567ff466b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:55.122915 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a122da6e-4edc-4356-8b7e-2f672ca092fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0f08195e78c14f67a0096d9567ff466b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:55.123610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a122da6e-4edc-4356-8b7e-2f672ca092fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0f08195e78c14f67a0096d9567ff466b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:55.133298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a122da6e-4edc-4356-8b7e-2f672ca092fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0f08195e78c14f67a0096d9567ff466b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:55.155806 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1419/2848] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:25:54 2022] DELETE /identity/v3/users/0f08195e78c14f67a0096d9567ff466b => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:55.489764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:55.491497 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:55.506304 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f274e13-913b-4242-8669-d3e3162471a6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:55.562499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:55.578327 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd29506-485b-40ce-835e-5a25bd5e2037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:55.579489 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd29506-485b-40ce-835e-5a25bd5e2037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:55.579660 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd29506-485b-40ce-835e-5a25bd5e2037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:55.579952 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd29506-485b-40ce-835e-5a25bd5e2037 admin admin] PATH_INFO: `/v3/projects/410c5a9902ac463299b1f1a8a4579419` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:55.581198 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd29506-485b-40ce-835e-5a25bd5e2037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=410c5a9902ac463299b1f1a8a4579419)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:55.583219 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd29506-485b-40ce-835e-5a25bd5e2037 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:55.645344 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3fd29506-485b-40ce-835e-5a25bd5e2037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '410c5a9902ac463299b1f1a8a4579419', 'request_id': 'req-3fd29506-485b-40ce-835e-5a25bd5e2037'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:55.652336 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3fd29506-485b-40ce-835e-5a25bd5e2037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '410c5a9902ac463299b1f1a8a4579419', 'request_id': 'req-3fd29506-485b-40ce-835e-5a25bd5e2037'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:55.662890 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3fd29506-485b-40ce-835e-5a25bd5e2037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '410c5a9902ac463299b1f1a8a4579419', 'request_id': 'req-3fd29506-485b-40ce-835e-5a25bd5e2037'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:55.678208 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3fd29506-485b-40ce-835e-5a25bd5e2037 admin admin] The token cache is being invalidate because project 410c5a9902ac463299b1f1a8a4579419 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:25:55.678507 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3fd29506-485b-40ce-835e-5a25bd5e2037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:55.679339 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-3fd29506-485b-40ce-835e-5a25bd5e2037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:25:55.681245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1430/2849] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:25:55 2022] DELETE /identity/v3/projects/410c5a9902ac463299b1f1a8a4579419 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:55.687812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841c569-f7b1-4403-840d-be1ecb70685b None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:55.688656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841c569-f7b1-4403-840d-be1ecb70685b None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:55.688656 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841c569-f7b1-4403-840d-be1ecb70685b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:55.712208 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1841c569-f7b1-4403-840d-be1ecb70685b None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:55.713480 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1841c569-f7b1-4403-840d-be1ecb70685b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:55.783405 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1420/2850] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:55.793044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca66c3-c0cf-4fc9-80ad-d2981eb5535e None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:55.793333 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca66c3-c0cf-4fc9-80ad-d2981eb5535e None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:55.793578 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bca66c3-c0cf-4fc9-80ad-d2981eb5535e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:55.815881 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6bca66c3-c0cf-4fc9-80ad-d2981eb5535e None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:55.817130 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6bca66c3-c0cf-4fc9-80ad-d2981eb5535e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:55.826554 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1431/2851] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:55.831865 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841c569-f7b1-4403-840d-be1ecb70685b None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:55.843599 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841c569-f7b1-4403-840d-be1ecb70685b None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:55.849961 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6f31-9b41-4f98-ba2e-edb79e8628a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:55.850723 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6f31-9b41-4f98-ba2e-edb79e8628a3 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:55.851093 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6f31-9b41-4f98-ba2e-edb79e8628a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:55.851476 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457f6f31-9b41-4f98-ba2e-edb79e8628a3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:55.852380 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f6f31-9b41-4f98-ba2e-edb79e8628a3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:25:55.852809 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f6f31-9b41-4f98-ba2e-edb79e8628a3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:55.854722 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457f6f31-9b41-4f98-ba2e-edb79e8628a3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:55.869974 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1421/2852] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:25:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:25:55.875044 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca66c3-c0cf-4fc9-80ad-d2981eb5535e None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:55.885430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bca66c3-c0cf-4fc9-80ad-d2981eb5535e None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:55.891365 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f6ed-3a2a-4c30-a22d-3ead50b6d797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:55.891954 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f6ed-3a2a-4c30-a22d-3ead50b6d797 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:55.892233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f6ed-3a2a-4c30-a22d-3ead50b6d797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:55.892500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c1f6ed-3a2a-4c30-a22d-3ead50b6d797 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:55.893148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f6ed-3a2a-4c30-a22d-3ead50b6d797 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:55.895145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c1f6ed-3a2a-4c30-a22d-3ead50b6d797 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:55.931076 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1432/2853] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:55 2022] POST /identity/v3/projects => generated 399 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:25:55.935602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6f31-9b41-4f98-ba2e-edb79e8628a3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:55.947543 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457f6f31-9b41-4f98-ba2e-edb79e8628a3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:56.008854 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:56.049425 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433411c2-6a1f-4240-92ab-cff8f48f0b82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:56.050108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433411c2-6a1f-4240-92ab-cff8f48f0b82 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:56.050387 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433411c2-6a1f-4240-92ab-cff8f48f0b82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:56.050663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433411c2-6a1f-4240-92ab-cff8f48f0b82 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:56.051313 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433411c2-6a1f-4240-92ab-cff8f48f0b82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:56.053289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433411c2-6a1f-4240-92ab-cff8f48f0b82 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:56.080003 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1422/2854] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:55 2022] POST /identity/v3/users => generated 300 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:56.084923 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f6ed-3a2a-4c30-a22d-3ead50b6d797 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:56.098882 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c1f6ed-3a2a-4c30-a22d-3ead50b6d797 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:56.104986 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31bccc-1a9d-4142-8efd-790930e840b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:56.105627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31bccc-1a9d-4142-8efd-790930e840b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:56.105941 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31bccc-1a9d-4142-8efd-790930e840b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:56.106212 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e31bccc-1a9d-4142-8efd-790930e840b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:56.106870 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31bccc-1a9d-4142-8efd-790930e840b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:56.108519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e31bccc-1a9d-4142-8efd-790930e840b4 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:56.121712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1433/2855] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:56.126514 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433411c2-6a1f-4240-92ab-cff8f48f0b82 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:56.138567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433411c2-6a1f-4240-92ab-cff8f48f0b82 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:56.144787 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4eb2cc2-0629-461f-8135-9304584052da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:56.145416 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb2cc2-0629-461f-8135-9304584052da admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:56.145687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb2cc2-0629-461f-8135-9304584052da admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:56.145995 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4eb2cc2-0629-461f-8135-9304584052da admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:56.146728 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb2cc2-0629-461f-8135-9304584052da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:56.149279 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4eb2cc2-0629-461f-8135-9304584052da admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:56.161263 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1423/2856] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:56.165804 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31bccc-1a9d-4142-8efd-790930e840b4 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:56.176791 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e31bccc-1a9d-4142-8efd-790930e840b4 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:56.181727 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744655b-d239-4035-a454-6f618849a42c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:56.182436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744655b-d239-4035-a454-6f618849a42c admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:56.182716 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744655b-d239-4035-a454-6f618849a42c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:56.183022 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1744655b-d239-4035-a454-6f618849a42c admin admin] PATH_INFO: `/v3/projects/1bb6f4b0a6b348b2a1df2910fdcca381/users/689a852b247f42e9b7dfd7eb16b792b2/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:56.200999 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744655b-d239-4035-a454-6f618849a42c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bb6f4b0a6b348b2a1df2910fdcca381, user_id=689a852b247f42e9b7dfd7eb16b792b2, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:56.204447 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1744655b-d239-4035-a454-6f618849a42c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:56.220257 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1434/2857] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:56 2022] PUT /identity/v3/projects/1bb6f4b0a6b348b2a1df2910fdcca381/users/689a852b247f42e9b7dfd7eb16b792b2/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:56.232215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b9d18-ace4-4e84-b524-9b775ef2aedc None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:56.232706 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b9d18-ace4-4e84-b524-9b775ef2aedc None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:56.233134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b9d18-ace4-4e84-b524-9b775ef2aedc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:56.267758 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-987b9d18-ace4-4e84-b524-9b775ef2aedc None None] MFA Rules not processed for user `689a852b247f42e9b7dfd7eb16b792b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:56.269022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-987b9d18-ace4-4e84-b524-9b775ef2aedc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:56.348081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1424/2858] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:56.355120 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744655b-d239-4035-a454-6f618849a42c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:56.430715 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1744655b-d239-4035-a454-6f618849a42c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:56.436522 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16817f0a-62f2-4e02-b670-22d9b6eb2a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:56.437321 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16817f0a-62f2-4e02-b670-22d9b6eb2a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:56.437747 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16817f0a-62f2-4e02-b670-22d9b6eb2a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:56.438159 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16817f0a-62f2-4e02-b670-22d9b6eb2a47 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:56.438915 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16817f0a-62f2-4e02-b670-22d9b6eb2a47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:56.441025 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16817f0a-62f2-4e02-b670-22d9b6eb2a47 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:56.467634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:56.477231 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1435/2859] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:25:56 2022] POST /identity/v3/projects => generated 401 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:25:56.482086 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b9d18-ace4-4e84-b524-9b775ef2aedc None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:56.494538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b9d18-ace4-4e84-b524-9b775ef2aedc None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:56.566595 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81ac4c-17a9-47a1-9414-632b4422ad31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:56.567243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81ac4c-17a9-47a1-9414-632b4422ad31 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:56.567538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81ac4c-17a9-47a1-9414-632b4422ad31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:56.567803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c81ac4c-17a9-47a1-9414-632b4422ad31 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:56.568711 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81ac4c-17a9-47a1-9414-632b4422ad31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:56.570729 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c81ac4c-17a9-47a1-9414-632b4422ad31 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:56.598397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1425/2860] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:25:56 2022] POST /identity/v3/users => generated 307 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:25:56.603680 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16817f0a-62f2-4e02-b670-22d9b6eb2a47 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:56.616845 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16817f0a-62f2-4e02-b670-22d9b6eb2a47 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:56.622778 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e124b-f5ed-4489-9962-d66314454c54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:56.623424 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e124b-f5ed-4489-9962-d66314454c54 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:56.623711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e124b-f5ed-4489-9962-d66314454c54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:56.623977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e124b-f5ed-4489-9962-d66314454c54 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:56.624634 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e124b-f5ed-4489-9962-d66314454c54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:56.626526 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e124b-f5ed-4489-9962-d66314454c54 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:56.639781 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1436/2861] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:56.645080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81ac4c-17a9-47a1-9414-632b4422ad31 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:56.657272 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c81ac4c-17a9-47a1-9414-632b4422ad31 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:56.664986 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbc035-f981-4f93-b414-7066ded028d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:56.665685 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbc035-f981-4f93-b414-7066ded028d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:56.666296 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbc035-f981-4f93-b414-7066ded028d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:56.666576 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53bbc035-f981-4f93-b414-7066ded028d3 admin admin] PATH_INFO: `/v3/projects/71afdc101db6491c8fad7b7a0e15fef5/users/c94ef92bf9f5400bb135808b3324aa12/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:56.690932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbc035-f981-4f93-b414-7066ded028d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71afdc101db6491c8fad7b7a0e15fef5, user_id=c94ef92bf9f5400bb135808b3324aa12, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:56.696184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53bbc035-f981-4f93-b414-7066ded028d3 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:56.716602 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1426/2862] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:56 2022] PUT /identity/v3/projects/71afdc101db6491c8fad7b7a0e15fef5/users/c94ef92bf9f5400bb135808b3324aa12/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:56.721188 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e124b-f5ed-4489-9962-d66314454c54 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:56.732408 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e124b-f5ed-4489-9962-d66314454c54 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:56.801202 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15289a67-ee52-4dd3-beb8-2d46ce3259bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:56.801817 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15289a67-ee52-4dd3-beb8-2d46ce3259bb admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:56.802126 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15289a67-ee52-4dd3-beb8-2d46ce3259bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:56.802396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15289a67-ee52-4dd3-beb8-2d46ce3259bb admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:56.803055 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15289a67-ee52-4dd3-beb8-2d46ce3259bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:56.804691 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15289a67-ee52-4dd3-beb8-2d46ce3259bb admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:56.815960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1437/2863] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:25:56 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:25:56.820605 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbc035-f981-4f93-b414-7066ded028d3 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:56.832330 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53bbc035-f981-4f93-b414-7066ded028d3 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:56.837686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c55d-30e5-4458-a950-d0d546aa2348 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:56.838412 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c55d-30e5-4458-a950-d0d546aa2348 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:56.838693 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c55d-30e5-4458-a950-d0d546aa2348 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:56.838964 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c1c55d-30e5-4458-a950-d0d546aa2348 admin admin] PATH_INFO: `/v3/projects/71afdc101db6491c8fad7b7a0e15fef5/users/c94ef92bf9f5400bb135808b3324aa12/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:56.841312 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1c55d-30e5-4458-a950-d0d546aa2348 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71afdc101db6491c8fad7b7a0e15fef5, user_id=c94ef92bf9f5400bb135808b3324aa12, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:56.844065 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c1c55d-30e5-4458-a950-d0d546aa2348 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:56.846832 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:25:56.858538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1427/2864] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:25:56 2022] PUT /identity/v3/projects/71afdc101db6491c8fad7b7a0e15fef5/users/c94ef92bf9f5400bb135808b3324aa12/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:25:56.871218 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6bfcf-41fd-4655-adba-69d928424080 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:56.871510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6bfcf-41fd-4655-adba-69d928424080 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:56.871754 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d6bfcf-41fd-4655-adba-69d928424080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:56.904950 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-54d6bfcf-41fd-4655-adba-69d928424080 None None] MFA Rules not processed for user `c94ef92bf9f5400bb135808b3324aa12`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:25:56.906233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-54d6bfcf-41fd-4655-adba-69d928424080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:56.994812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1438/2865] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:25:56 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:25:57.008064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c55d-30e5-4458-a950-d0d546aa2348 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:57.010269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-b2c1c55d-30e5-4458-a950-d0d546aa2348 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:25:57.080466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c1c55d-30e5-4458-a950-d0d546aa2348 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:57.084536 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c213cd4-11f0-4e8f-a01a-e965654f4129 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:57.085373 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c213cd4-11f0-4e8f-a01a-e965654f4129 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:57.085715 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c213cd4-11f0-4e8f-a01a-e965654f4129 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:57.086065 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c213cd4-11f0-4e8f-a01a-e965654f4129 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:57.097951 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c213cd4-11f0-4e8f-a01a-e965654f4129 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:57.099666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c213cd4-11f0-4e8f-a01a-e965654f4129 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:57.112014 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1428/2866] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:57 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:25:57.207893 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6bfcf-41fd-4655-adba-69d928424080 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:25:57.219260 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d6bfcf-41fd-4655-adba-69d928424080 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:25:57.224277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b02d180-f4d7-4a1a-af2c-32764553db27 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:25:57.225033 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02d180-f4d7-4a1a-af2c-32764553db27 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:25:57.225363 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02d180-f4d7-4a1a-af2c-32764553db27 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:25:57.225699 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b02d180-f4d7-4a1a-af2c-32764553db27 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:25:57.294323 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02d180-f4d7-4a1a-af2c-32764553db27 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:25:57.295838 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b02d180-f4d7-4a1a-af2c-32764553db27 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:25:57.306951 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1439/2867] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:25:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:26:01.948212 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c213cd4-11f0-4e8f-a01a-e965654f4129 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:02.070554 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c213cd4-11f0-4e8f-a01a-e965654f4129 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:02.079845 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:02.081021 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:02.081513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:02.082022 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] PATH_INFO: `/v3/users/689a852b247f42e9b7dfd7eb16b792b2` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:02.084301 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=689a852b247f42e9b7dfd7eb16b792b2)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:02.088186 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:02.187134 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '689a852b247f42e9b7dfd7eb16b792b2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:02.201298 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '689a852b247f42e9b7dfd7eb16b792b2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:02.202472 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '689a852b247f42e9b7dfd7eb16b792b2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:02.204501 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '689a852b247f42e9b7dfd7eb16b792b2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:02.217495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '689a852b247f42e9b7dfd7eb16b792b2'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:02.260948 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1429/2868] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:26:01 2022] DELETE /identity/v3/users/689a852b247f42e9b7dfd7eb16b792b2 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:02.269498 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad62d45-eb52-4c5e-bdeb-3213c3e10003 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:02.270146 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad62d45-eb52-4c5e-bdeb-3213c3e10003 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:02.270495 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad62d45-eb52-4c5e-bdeb-3213c3e10003 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:02.310223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-bad62d45-eb52-4c5e-bdeb-3213c3e10003 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:02.312505 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bad62d45-eb52-4c5e-bdeb-3213c3e10003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:02.320108 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:02.429359 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1440/2869] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:02.446388 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:02.448781 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:02.485343 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:02.538897 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5c3e9b-7c2f-4dec-a16b-e092ddba6b4f admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:02.543476 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd952687-e74a-4b5f-b5ba-83720eee69cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:02.544127 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952687-e74a-4b5f-b5ba-83720eee69cf service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:02.544403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952687-e74a-4b5f-b5ba-83720eee69cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:02.544684 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd952687-e74a-4b5f-b5ba-83720eee69cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:02.559397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd952687-e74a-4b5f-b5ba-83720eee69cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:02.565073 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd952687-e74a-4b5f-b5ba-83720eee69cf service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:02.586069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1430/2870] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:26:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:26:03.552689 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad62d45-eb52-4c5e-bdeb-3213c3e10003 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:03.555009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-bad62d45-eb52-4c5e-bdeb-3213c3e10003 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:03.577067 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad62d45-eb52-4c5e-bdeb-3213c3e10003 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:03.585929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:03.586805 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:03.587324 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:03.587829 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] PATH_INFO: `/v3/projects/1bb6f4b0a6b348b2a1df2910fdcca381` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:03.590607 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bb6f4b0a6b348b2a1df2910fdcca381)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:03.592762 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:03.681163 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bb6f4b0a6b348b2a1df2910fdcca381', 'request_id': 'req-b11c8a02-5371-4d03-b20a-5d2677362fcd'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:03.689820 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bb6f4b0a6b348b2a1df2910fdcca381', 'request_id': 'req-b11c8a02-5371-4d03-b20a-5d2677362fcd'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:03.705929 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bb6f4b0a6b348b2a1df2910fdcca381', 'request_id': 'req-b11c8a02-5371-4d03-b20a-5d2677362fcd'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:03.733381 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] The token cache is being invalidate because project 1bb6f4b0a6b348b2a1df2910fdcca381 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:26:03.733941 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:03.735220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:03.738005 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1441/2871] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:26:03 2022] DELETE /identity/v3/projects/1bb6f4b0a6b348b2a1df2910fdcca381 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:26:03.744372 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd952687-e74a-4b5f-b5ba-83720eee69cf service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:03.762491 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd952687-e74a-4b5f-b5ba-83720eee69cf service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:03.840932 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026879c8-883d-4cdc-96dd-24c98885b259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:03.841592 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026879c8-883d-4cdc-96dd-24c98885b259 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:03.841904 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026879c8-883d-4cdc-96dd-24c98885b259 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:03.842171 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026879c8-883d-4cdc-96dd-24c98885b259 admin admin] PATH_INFO: `/v3/users/c94ef92bf9f5400bb135808b3324aa12` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:03.843364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026879c8-883d-4cdc-96dd-24c98885b259 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c94ef92bf9f5400bb135808b3324aa12)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:03.845608 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026879c8-883d-4cdc-96dd-24c98885b259 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:03.907087 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-026879c8-883d-4cdc-96dd-24c98885b259 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c94ef92bf9f5400bb135808b3324aa12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:03.917750 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-026879c8-883d-4cdc-96dd-24c98885b259 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c94ef92bf9f5400bb135808b3324aa12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:03.918532 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-026879c8-883d-4cdc-96dd-24c98885b259 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c94ef92bf9f5400bb135808b3324aa12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:03.919555 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-026879c8-883d-4cdc-96dd-24c98885b259 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c94ef92bf9f5400bb135808b3324aa12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:03.930128 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-026879c8-883d-4cdc-96dd-24c98885b259 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c94ef92bf9f5400bb135808b3324aa12'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:03.953339 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1431/2872] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:26:03 2022] DELETE /identity/v3/users/c94ef92bf9f5400bb135808b3324aa12 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:04.397974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:04.400436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:04.423859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11c8a02-5371-4d03-b20a-5d2677362fcd admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:04.519468 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb77d0c-e10e-464e-9982-5c8afa4cde69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:04.520718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb77d0c-e10e-464e-9982-5c8afa4cde69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:04.521207 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb77d0c-e10e-464e-9982-5c8afa4cde69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:04.521667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb77d0c-e10e-464e-9982-5c8afa4cde69 admin admin] PATH_INFO: `/v3/projects/71afdc101db6491c8fad7b7a0e15fef5` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:04.523561 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb77d0c-e10e-464e-9982-5c8afa4cde69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71afdc101db6491c8fad7b7a0e15fef5)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:04.527246 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb77d0c-e10e-464e-9982-5c8afa4cde69 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:04.608576 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:04.642990 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-fcb77d0c-e10e-464e-9982-5c8afa4cde69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71afdc101db6491c8fad7b7a0e15fef5', 'request_id': 'req-fcb77d0c-e10e-464e-9982-5c8afa4cde69'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:04.652565 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-fcb77d0c-e10e-464e-9982-5c8afa4cde69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71afdc101db6491c8fad7b7a0e15fef5', 'request_id': 'req-fcb77d0c-e10e-464e-9982-5c8afa4cde69'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:04.663627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-fcb77d0c-e10e-464e-9982-5c8afa4cde69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71afdc101db6491c8fad7b7a0e15fef5', 'request_id': 'req-fcb77d0c-e10e-464e-9982-5c8afa4cde69'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:04.682247 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-fcb77d0c-e10e-464e-9982-5c8afa4cde69 admin admin] The token cache is being invalidate because project 71afdc101db6491c8fad7b7a0e15fef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:26:04.682560 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-fcb77d0c-e10e-464e-9982-5c8afa4cde69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:04.683233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-fcb77d0c-e10e-464e-9982-5c8afa4cde69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:04.684800 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1442/2873] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:26:04 2022] DELETE /identity/v3/projects/71afdc101db6491c8fad7b7a0e15fef5 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:26:04.690361 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c9a6-e700-4e43-b16d-c04b911a1cc6 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:04.690803 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c9a6-e700-4e43-b16d-c04b911a1cc6 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:04.692238 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d60c9a6-e700-4e43-b16d-c04b911a1cc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:04.714957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-4d60c9a6-e700-4e43-b16d-c04b911a1cc6 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:04.716248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-4d60c9a6-e700-4e43-b16d-c04b911a1cc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:04.761510 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:04.800390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1432/2874] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:04.809631 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c920-cdc7-48c7-9d62-b08fc9f18406 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:04.809973 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c920-cdc7-48c7-9d62-b08fc9f18406 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:04.810227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4405c920-cdc7-48c7-9d62-b08fc9f18406 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:04.833745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-4405c920-cdc7-48c7-9d62-b08fc9f18406 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:04.835227 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4405c920-cdc7-48c7-9d62-b08fc9f18406 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:04.846014 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1443/2875] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:04.851240 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60c9a6-e700-4e43-b16d-c04b911a1cc6 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:04.862477 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d60c9a6-e700-4e43-b16d-c04b911a1cc6 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:04.867663 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112595e-4bdc-41c9-97ae-3db56028cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:04.868482 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112595e-4bdc-41c9-97ae-3db56028cdcd admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:04.868829 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112595e-4bdc-41c9-97ae-3db56028cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:04.869174 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9112595e-4bdc-41c9-97ae-3db56028cdcd admin admin] PATH_INFO: `/v3/domains` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:04.869899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112595e-4bdc-41c9-97ae-3db56028cdcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81626) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:26:04.870213 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112595e-4bdc-41c9-97ae-3db56028cdcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:04.871895 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9112595e-4bdc-41c9-97ae-3db56028cdcd admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:04.887224 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1433/2876] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:26:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:26:04.893000 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c920-cdc7-48c7-9d62-b08fc9f18406 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:04.904115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4405c920-cdc7-48c7-9d62-b08fc9f18406 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:04.910448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e17ae-3d05-4229-9e06-d8fd19f54f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:04.911109 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e17ae-3d05-4229-9e06-d8fd19f54f49 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:04.911387 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e17ae-3d05-4229-9e06-d8fd19f54f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:04.911665 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6e17ae-3d05-4229-9e06-d8fd19f54f49 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:04.912326 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e17ae-3d05-4229-9e06-d8fd19f54f49 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:04.914343 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6e17ae-3d05-4229-9e06-d8fd19f54f49 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:04.956935 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1444/2877] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:26:04 2022] POST /identity/v3/projects => generated 381 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:26:04.958857 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112595e-4bdc-41c9-97ae-3db56028cdcd admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:04.972709 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9112595e-4bdc-41c9-97ae-3db56028cdcd admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:05.102611 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450e506-8362-41cf-a9b9-d25280f2ca57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:05.103955 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e506-8362-41cf-a9b9-d25280f2ca57 admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:05.104463 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e506-8362-41cf-a9b9-d25280f2ca57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:05.104958 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3450e506-8362-41cf-a9b9-d25280f2ca57 admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:05.105849 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450e506-8362-41cf-a9b9-d25280f2ca57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:05.108756 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3450e506-8362-41cf-a9b9-d25280f2ca57 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:05.142876 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1434/2878] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:26:04 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:26:05.147735 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e17ae-3d05-4229-9e06-d8fd19f54f49 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:05.162849 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6e17ae-3d05-4229-9e06-d8fd19f54f49 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:05.168852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2535397-7ed2-4e51-8ff8-7a3357c3b9d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:05.169908 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2535397-7ed2-4e51-8ff8-7a3357c3b9d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:05.170380 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2535397-7ed2-4e51-8ff8-7a3357c3b9d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:05.170787 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2535397-7ed2-4e51-8ff8-7a3357c3b9d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:05.171627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2535397-7ed2-4e51-8ff8-7a3357c3b9d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:05.173712 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2535397-7ed2-4e51-8ff8-7a3357c3b9d3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:05.195155 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1445/2879] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:26:05.195777 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450e506-8362-41cf-a9b9-d25280f2ca57 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:05.209998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3450e506-8362-41cf-a9b9-d25280f2ca57 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:05.219390 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fe69d-1d8e-4e7c-9d4b-8ba7f226b631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:05.220712 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fe69d-1d8e-4e7c-9d4b-8ba7f226b631 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:05.221184 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fe69d-1d8e-4e7c-9d4b-8ba7f226b631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:05.221665 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fe69d-1d8e-4e7c-9d4b-8ba7f226b631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:05.223157 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fe69d-1d8e-4e7c-9d4b-8ba7f226b631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:05.226230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fe69d-1d8e-4e7c-9d4b-8ba7f226b631 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:05.250588 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1435/2880] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:26:05.254814 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2535397-7ed2-4e51-8ff8-7a3357c3b9d3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:05.269380 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2535397-7ed2-4e51-8ff8-7a3357c3b9d3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:05.276317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf2ccf-ca3c-4e36-825b-be99e7e2e01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:05.277437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2ccf-ca3c-4e36-825b-be99e7e2e01c admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:05.277977 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2ccf-ca3c-4e36-825b-be99e7e2e01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:05.278455 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2acf2ccf-ca3c-4e36-825b-be99e7e2e01c admin admin] PATH_INFO: `/v3/projects/b1ed223369fa44419522f99bc8098988/users/9941ed9483bc435a9ca670b206a879c4/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:05.308134 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf2ccf-ca3c-4e36-825b-be99e7e2e01c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ed223369fa44419522f99bc8098988, user_id=9941ed9483bc435a9ca670b206a879c4, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:05.314058 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2acf2ccf-ca3c-4e36-825b-be99e7e2e01c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:05.335160 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1446/2881] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:26:05 2022] PUT /identity/v3/projects/b1ed223369fa44419522f99bc8098988/users/9941ed9483bc435a9ca670b206a879c4/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:26:05.347350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8696e-c097-4c59-90ca-f60c106dbd89 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:05.347618 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8696e-c097-4c59-90ca-f60c106dbd89 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:05.347892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8696e-c097-4c59-90ca-f60c106dbd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:05.389887 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f5d8696e-c097-4c59-90ca-f60c106dbd89 None None] MFA Rules not processed for user `9941ed9483bc435a9ca670b206a879c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:05.391899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f5d8696e-c097-4c59-90ca-f60c106dbd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:05.490660 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1436/2882] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:05 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:05.495741 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf2ccf-ca3c-4e36-825b-be99e7e2e01c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:05.572757 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2acf2ccf-ca3c-4e36-825b-be99e7e2e01c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:05.582277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45626fae-6bb7-4287-9eb7-bc216fd4b6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:05.583423 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45626fae-6bb7-4287-9eb7-bc216fd4b6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:05.583848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45626fae-6bb7-4287-9eb7-bc216fd4b6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:05.584303 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45626fae-6bb7-4287-9eb7-bc216fd4b6f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:05.585494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45626fae-6bb7-4287-9eb7-bc216fd4b6f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:05.589399 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45626fae-6bb7-4287-9eb7-bc216fd4b6f3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:05.630853 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1447/2883] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:26:05 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:26:05.635788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8696e-c097-4c59-90ca-f60c106dbd89 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:05.648854 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8696e-c097-4c59-90ca-f60c106dbd89 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:05.686726 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:05.720938 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c996e-32f3-4c67-8cbe-b76da008787e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:05.721652 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c996e-32f3-4c67-8cbe-b76da008787e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:05.721983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c996e-32f3-4c67-8cbe-b76da008787e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:05.722233 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2c996e-32f3-4c67-8cbe-b76da008787e admin admin] PATH_INFO: `/v3/users` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:05.722899 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c996e-32f3-4c67-8cbe-b76da008787e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:05.724979 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2c996e-32f3-4c67-8cbe-b76da008787e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:05.751402 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1437/2884] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:26:05 2022] POST /identity/v3/users => generated 298 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:26:05.757448 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45626fae-6bb7-4287-9eb7-bc216fd4b6f3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:05.770365 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45626fae-6bb7-4287-9eb7-bc216fd4b6f3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:05.775960 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523cd89-0f9f-4d3f-a434-533f0ee4822e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:05.776603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523cd89-0f9f-4d3f-a434-533f0ee4822e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:05.776886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523cd89-0f9f-4d3f-a434-533f0ee4822e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:05.777159 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523cd89-0f9f-4d3f-a434-533f0ee4822e admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:05.777844 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523cd89-0f9f-4d3f-a434-533f0ee4822e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:05.779543 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523cd89-0f9f-4d3f-a434-533f0ee4822e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:05.795611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1448/2885] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:26:05.800567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c996e-32f3-4c67-8cbe-b76da008787e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:05.811436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2c996e-32f3-4c67-8cbe-b76da008787e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:05.819903 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd292be-46ca-43a7-ae55-9d4de66d0971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:05.821115 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd292be-46ca-43a7-ae55-9d4de66d0971 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:05.821610 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd292be-46ca-43a7-ae55-9d4de66d0971 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:05.822138 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd292be-46ca-43a7-ae55-9d4de66d0971 admin admin] PATH_INFO: `/v3/projects/00615bb580904fee9071de74332a810b/users/07fc69e3f77d456e9e3048777b55f7e2/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:05.851050 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd292be-46ca-43a7-ae55-9d4de66d0971 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00615bb580904fee9071de74332a810b, user_id=07fc69e3f77d456e9e3048777b55f7e2, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:05.856608 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dd292be-46ca-43a7-ae55-9d4de66d0971 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:05.875946 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1438/2886] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:26:05 2022] PUT /identity/v3/projects/00615bb580904fee9071de74332a810b/users/07fc69e3f77d456e9e3048777b55f7e2/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:05.880913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523cd89-0f9f-4d3f-a434-533f0ee4822e admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:05.897293 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523cd89-0f9f-4d3f-a434-533f0ee4822e admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:05.958282 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:05.994969 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3979f76-2ce8-4727-a452-5e60c9df8349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:05.995632 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3979f76-2ce8-4727-a452-5e60c9df8349 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:05.996012 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3979f76-2ce8-4727-a452-5e60c9df8349 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:05.996355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3979f76-2ce8-4727-a452-5e60c9df8349 admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:05.997073 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3979f76-2ce8-4727-a452-5e60c9df8349 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:05.998802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3979f76-2ce8-4727-a452-5e60c9df8349 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:06.019148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1449/2887] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:26:05 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:26:06.025008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd292be-46ca-43a7-ae55-9d4de66d0971 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:06.058033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd292be-46ca-43a7-ae55-9d4de66d0971 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:06.067124 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f910ae-05ac-40eb-9551-8c04f85c56ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:06.068295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f910ae-05ac-40eb-9551-8c04f85c56ae admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:06.068781 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f910ae-05ac-40eb-9551-8c04f85c56ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:06.069257 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f910ae-05ac-40eb-9551-8c04f85c56ae admin admin] PATH_INFO: `/v3/projects/00615bb580904fee9071de74332a810b/users/07fc69e3f77d456e9e3048777b55f7e2/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:06.076914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f910ae-05ac-40eb-9551-8c04f85c56ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=00615bb580904fee9071de74332a810b, user_id=07fc69e3f77d456e9e3048777b55f7e2, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:06.078596 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f910ae-05ac-40eb-9551-8c04f85c56ae admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:06.101264 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1439/2888] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:26:06 2022] PUT /identity/v3/projects/00615bb580904fee9071de74332a810b/users/07fc69e3f77d456e9e3048777b55f7e2/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:06.179678 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d64a48-72d3-4169-b985-44095e06f3e9 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:06.180035 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d64a48-72d3-4169-b985-44095e06f3e9 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:06.180237 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d64a48-72d3-4169-b985-44095e06f3e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:06.227117 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-06d64a48-72d3-4169-b985-44095e06f3e9 None None] MFA Rules not processed for user `07fc69e3f77d456e9e3048777b55f7e2`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:06.229549 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-06d64a48-72d3-4169-b985-44095e06f3e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:06.378983 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1450/2889] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:06 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:06.396081 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f910ae-05ac-40eb-9551-8c04f85c56ae admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:06.398745 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-63f910ae-05ac-40eb-9551-8c04f85c56ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:06.493987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f910ae-05ac-40eb-9551-8c04f85c56ae admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:06.500363 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aab711-d9bf-4d29-8217-da7947e49499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:06.501306 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aab711-d9bf-4d29-8217-da7947e49499 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:06.501719 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aab711-d9bf-4d29-8217-da7947e49499 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:06.502196 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aab711-d9bf-4d29-8217-da7947e49499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:06.517603 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aab711-d9bf-4d29-8217-da7947e49499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:06.520333 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aab711-d9bf-4d29-8217-da7947e49499 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:06.539273 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1440/2890] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:26:06 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:26:06.678233 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d64a48-72d3-4169-b985-44095e06f3e9 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:06.692225 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d64a48-72d3-4169-b985-44095e06f3e9 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:06.697438 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec26f6-a237-4316-adf5-a4e39ef92ab4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:06.698396 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec26f6-a237-4316-adf5-a4e39ef92ab4 service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:06.698695 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec26f6-a237-4316-adf5-a4e39ef92ab4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:06.698967 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec26f6-a237-4316-adf5-a4e39ef92ab4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:06.772179 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec26f6-a237-4316-adf5-a4e39ef92ab4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:06.773666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec26f6-a237-4316-adf5-a4e39ef92ab4 service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:06.784938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1451/2891] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:26:06 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:26:09.614794 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aab711-d9bf-4d29-8217-da7947e49499 service cinder] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:09.749768 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:09.766620 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aab711-d9bf-4d29-8217-da7947e49499 service cinder] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:09.772215 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:09.772925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:09.773244 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:09.773555 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] PATH_INFO: `/v3/users/9941ed9483bc435a9ca670b206a879c4` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:09.774970 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9941ed9483bc435a9ca670b206a879c4)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:09.777297 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:09.851466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9941ed9483bc435a9ca670b206a879c4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:09.865140 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9941ed9483bc435a9ca670b206a879c4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:09.866276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9941ed9483bc435a9ca670b206a879c4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:09.867234 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9941ed9483bc435a9ca670b206a879c4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:09.884703 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9941ed9483bc435a9ca670b206a879c4'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:09.915513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1441/2892] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:26:09 2022] DELETE /identity/v3/users/9941ed9483bc435a9ca670b206a879c4 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:09.923008 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229513c-3197-45ec-9750-623bc1398029 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:09.923708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229513c-3197-45ec-9750-623bc1398029 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:09.924231 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229513c-3197-45ec-9750-623bc1398029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:10.026456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-d229513c-3197-45ec-9750-623bc1398029 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:10.027833 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d229513c-3197-45ec-9750-623bc1398029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:10.055534 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=100 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:10.131612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1452/2893] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:10.145720 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:10.148075 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:10.289017 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd75c2b-939e-44a4-b893-310341911fa4 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:10.296845 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909481b4-1b48-48a8-936b-47832c4242cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:10.297935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909481b4-1b48-48a8-936b-47832c4242cf service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:10.298436 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909481b4-1b48-48a8-936b-47832c4242cf service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:10.298919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909481b4-1b48-48a8-936b-47832c4242cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:10.317151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909481b4-1b48-48a8-936b-47832c4242cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:10.320269 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909481b4-1b48-48a8-936b-47832c4242cf service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:10.336045 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1442/2894] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:26:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:26:10.378401 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229513c-3197-45ec-9750-623bc1398029 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:10.380298 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-d229513c-3197-45ec-9750-623bc1398029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:10.395585 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229513c-3197-45ec-9750-623bc1398029 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:10.400494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa5d41-c627-4c82-8fb1-710d5e1734b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:10.401316 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa5d41-c627-4c82-8fb1-710d5e1734b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:10.401679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa5d41-c627-4c82-8fb1-710d5e1734b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:10.402124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aa5d41-c627-4c82-8fb1-710d5e1734b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:10.404737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-55aa5d41-c627-4c82-8fb1-710d5e1734b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:10.512287 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa5d41-c627-4c82-8fb1-710d5e1734b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:10.514049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aa5d41-c627-4c82-8fb1-710d5e1734b9 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:10.528430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1453/2895] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:26:10 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:26:10.777350 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909481b4-1b48-48a8-936b-47832c4242cf service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:10.778960 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-909481b4-1b48-48a8-936b-47832c4242cf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:10.798172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909481b4-1b48-48a8-936b-47832c4242cf service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:10.803845 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:10.804525 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:10.804828 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:10.805141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] PATH_INFO: `/v3/projects/b1ed223369fa44419522f99bc8098988` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:10.806734 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ed223369fa44419522f99bc8098988)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:10.808509 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:10.868759 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:10.871133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ed223369fa44419522f99bc8098988', 'request_id': 'req-a227c9b1-189f-40e4-839c-09c640bafe3b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:10.880992 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ed223369fa44419522f99bc8098988', 'request_id': 'req-a227c9b1-189f-40e4-839c-09c640bafe3b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:10.897738 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ed223369fa44419522f99bc8098988', 'request_id': 'req-a227c9b1-189f-40e4-839c-09c640bafe3b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:10.919506 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] The token cache is being invalidate because project b1ed223369fa44419522f99bc8098988 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:26:10.920157 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:10.921522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:10.924969 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1443/2896] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:26:10 2022] DELETE /identity/v3/projects/b1ed223369fa44419522f99bc8098988 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:26:10.930842 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa5d41-c627-4c82-8fb1-710d5e1734b9 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:10.943485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aa5d41-c627-4c82-8fb1-710d5e1734b9 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:11.049503 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca683b1-c5dc-4e9b-988c-e0285d4f67ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:11.050236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca683b1-c5dc-4e9b-988c-e0285d4f67ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:11.050527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca683b1-c5dc-4e9b-988c-e0285d4f67ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:11.050779 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca683b1-c5dc-4e9b-988c-e0285d4f67ce admin admin] PATH_INFO: `/v3/users/07fc69e3f77d456e9e3048777b55f7e2` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:11.052286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca683b1-c5dc-4e9b-988c-e0285d4f67ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=07fc69e3f77d456e9e3048777b55f7e2)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:11.054464 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca683b1-c5dc-4e9b-988c-e0285d4f67ce admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:11.140736 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2ca683b1-c5dc-4e9b-988c-e0285d4f67ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07fc69e3f77d456e9e3048777b55f7e2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:11.156144 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2ca683b1-c5dc-4e9b-988c-e0285d4f67ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07fc69e3f77d456e9e3048777b55f7e2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:11.158486 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2ca683b1-c5dc-4e9b-988c-e0285d4f67ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07fc69e3f77d456e9e3048777b55f7e2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:11.159579 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2ca683b1-c5dc-4e9b-988c-e0285d4f67ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07fc69e3f77d456e9e3048777b55f7e2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:11.176425 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-2ca683b1-c5dc-4e9b-988c-e0285d4f67ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07fc69e3f77d456e9e3048777b55f7e2'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:11.178707 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:11.208631 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1454/2897] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:26:10 2022] DELETE /identity/v3/users/07fc69e3f77d456e9e3048777b55f7e2 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:26:11.625342 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:11.628167 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:11.651024 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227c9b1-189f-40e4-839c-09c640bafe3b admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:11.730092 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b397c1e8-18d2-4d29-b77f-df38a763bcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:11.730882 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397c1e8-18d2-4d29-b77f-df38a763bcab admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:11.731232 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397c1e8-18d2-4d29-b77f-df38a763bcab admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:11.731574 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b397c1e8-18d2-4d29-b77f-df38a763bcab admin admin] PATH_INFO: `/v3/projects/00615bb580904fee9071de74332a810b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:11.733007 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397c1e8-18d2-4d29-b77f-df38a763bcab admin admin] RBAC: Authorizing `identity:delete_project(project_id=00615bb580904fee9071de74332a810b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:11.735551 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b397c1e8-18d2-4d29-b77f-df38a763bcab admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:11.813430 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b397c1e8-18d2-4d29-b77f-df38a763bcab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00615bb580904fee9071de74332a810b', 'request_id': 'req-b397c1e8-18d2-4d29-b77f-df38a763bcab'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:11.825208 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b397c1e8-18d2-4d29-b77f-df38a763bcab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00615bb580904fee9071de74332a810b', 'request_id': 'req-b397c1e8-18d2-4d29-b77f-df38a763bcab'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:11.839987 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b397c1e8-18d2-4d29-b77f-df38a763bcab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00615bb580904fee9071de74332a810b', 'request_id': 'req-b397c1e8-18d2-4d29-b77f-df38a763bcab'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:11.854965 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b397c1e8-18d2-4d29-b77f-df38a763bcab admin admin] The token cache is being invalidate because project 00615bb580904fee9071de74332a810b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:26:11.855262 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b397c1e8-18d2-4d29-b77f-df38a763bcab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:11.855984 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-b397c1e8-18d2-4d29-b77f-df38a763bcab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:11.857559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1444/2898] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:26:11 2022] DELETE /identity/v3/projects/00615bb580904fee9071de74332a810b => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:11.864944 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b381b-4e25-4955-9ecc-65575ec878b1 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:11.865720 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b381b-4e25-4955-9ecc-65575ec878b1 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:11.866215 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b381b-4e25-4955-9ecc-65575ec878b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:11.958852 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-191b381b-4e25-4955-9ecc-65575ec878b1 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:11.960936 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-191b381b-4e25-4955-9ecc-65575ec878b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:12.081938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1455/2899] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 15 19:26:12.090495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d434a6-8fc7-4012-90cd-ad0d459780a0 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:12.090840 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d434a6-8fc7-4012-90cd-ad0d459780a0 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:12.091037 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d434a6-8fc7-4012-90cd-ad0d459780a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:12.114518 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-f4d434a6-8fc7-4012-90cd-ad0d459780a0 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:12.115802 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f4d434a6-8fc7-4012-90cd-ad0d459780a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:12.124650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1445/2900] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:12.130480 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b381b-4e25-4955-9ecc-65575ec878b1 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:12.148984 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b381b-4e25-4955-9ecc-65575ec878b1 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:12.154485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa13ff-f6a4-4432-9127-8b40a389e32b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:12.155262 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa13ff-f6a4-4432-9127-8b40a389e32b admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:12.155657 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa13ff-f6a4-4432-9127-8b40a389e32b admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:12.155988 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa13ff-f6a4-4432-9127-8b40a389e32b admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:12.156749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa13ff-f6a4-4432-9127-8b40a389e32b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:26:12.157105 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa13ff-f6a4-4432-9127-8b40a389e32b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:12.159427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa13ff-f6a4-4432-9127-8b40a389e32b admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:12.176221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1456/2901] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:26:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 15 19:26:12.181406 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d434a6-8fc7-4012-90cd-ad0d459780a0 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:12.194165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d434a6-8fc7-4012-90cd-ad0d459780a0 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:12.199999 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46878e-cd6a-4dea-93e4-f31ee1768e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:12.200787 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46878e-cd6a-4dea-93e4-f31ee1768e8e admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:12.201151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46878e-cd6a-4dea-93e4-f31ee1768e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:12.201513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c46878e-cd6a-4dea-93e4-f31ee1768e8e admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:12.202344 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46878e-cd6a-4dea-93e4-f31ee1768e8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:12.205377 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c46878e-cd6a-4dea-93e4-f31ee1768e8e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:12.245203 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1446/2902] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:26:12 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:26:12.252794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa13ff-f6a4-4432-9127-8b40a389e32b admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:12.266626 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa13ff-f6a4-4432-9127-8b40a389e32b admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:12.369018 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0816d-580b-43b4-a36b-34257ce7f777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:12.369841 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0816d-580b-43b4-a36b-34257ce7f777 admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:12.370318 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0816d-580b-43b4-a36b-34257ce7f777 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:12.370694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0816d-580b-43b4-a36b-34257ce7f777 admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:12.371494 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0816d-580b-43b4-a36b-34257ce7f777 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:12.374145 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0816d-580b-43b4-a36b-34257ce7f777 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:12.411062 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1457/2903] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:26:12 2022] POST /identity/v3/users => generated 292 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 15 19:26:12.412581 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46878e-cd6a-4dea-93e4-f31ee1768e8e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:12.429902 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c46878e-cd6a-4dea-93e4-f31ee1768e8e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:12.438332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c68884-9144-47b2-8d4d-a1b3fc094539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:12.438332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c68884-9144-47b2-8d4d-a1b3fc094539 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:12.438332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c68884-9144-47b2-8d4d-a1b3fc094539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:12.438332 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c68884-9144-47b2-8d4d-a1b3fc094539 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:12.439132 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c68884-9144-47b2-8d4d-a1b3fc094539 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:12.444690 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c68884-9144-47b2-8d4d-a1b3fc094539 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:12.459487 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1447/2904] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:26:12.463848 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0816d-580b-43b4-a36b-34257ce7f777 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:12.476708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0816d-580b-43b4-a36b-34257ce7f777 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:12.483964 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b026d610-7471-4146-9b51-ed8e47ac6d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:12.484853 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026d610-7471-4146-9b51-ed8e47ac6d6e admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:12.485388 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026d610-7471-4146-9b51-ed8e47ac6d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:12.485859 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b026d610-7471-4146-9b51-ed8e47ac6d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:12.486885 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026d610-7471-4146-9b51-ed8e47ac6d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:12.489506 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b026d610-7471-4146-9b51-ed8e47ac6d6e admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:12.506483 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1458/2905] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:26:12.512590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c68884-9144-47b2-8d4d-a1b3fc094539 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:12.541678 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c68884-9144-47b2-8d4d-a1b3fc094539 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:12.548160 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cbe1d-8813-46ed-ac31-9db6b07b2b3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:12.549016 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cbe1d-8813-46ed-ac31-9db6b07b2b3e admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:12.549397 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cbe1d-8813-46ed-ac31-9db6b07b2b3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:12.549771 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18cbe1d-8813-46ed-ac31-9db6b07b2b3e admin admin] PATH_INFO: `/v3/projects/c63ecc4de15348b7a77c67e5334e0663/users/9246f7852a014d0191a4932d492edfd0/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:12.571925 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cbe1d-8813-46ed-ac31-9db6b07b2b3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c63ecc4de15348b7a77c67e5334e0663, user_id=9246f7852a014d0191a4932d492edfd0, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:12.574914 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18cbe1d-8813-46ed-ac31-9db6b07b2b3e admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:12.600069 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1448/2906] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:26:12 2022] PUT /identity/v3/projects/c63ecc4de15348b7a77c67e5334e0663/users/9246f7852a014d0191a4932d492edfd0/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:12.618667 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98ae9d-50ae-49a3-a183-449467144206 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:12.619178 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98ae9d-50ae-49a3-a183-449467144206 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:12.619669 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98ae9d-50ae-49a3-a183-449467144206 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:12.670812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-1d98ae9d-50ae-49a3-a183-449467144206 None None] MFA Rules not processed for user `9246f7852a014d0191a4932d492edfd0`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:12.673122 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1d98ae9d-50ae-49a3-a183-449467144206 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:12.688503 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:12.764463 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1459/2907] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:12.770470 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cbe1d-8813-46ed-ac31-9db6b07b2b3e admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:12.778432 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:12.878018 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18cbe1d-8813-46ed-ac31-9db6b07b2b3e admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:12.886254 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b5543-6be3-48ad-a328-60e6026004ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:12.887320 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5543-6be3-48ad-a328-60e6026004ee admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:12.887826 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5543-6be3-48ad-a328-60e6026004ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:12.890486 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e8b5543-6be3-48ad-a328-60e6026004ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:12.890486 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b5543-6be3-48ad-a328-60e6026004ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:12.893664 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e8b5543-6be3-48ad-a328-60e6026004ee admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:12.946941 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1449/2908] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:26:12 2022] POST /identity/v3/projects => generated 383 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:26:12.948816 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98ae9d-50ae-49a3-a183-449467144206 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:12.964989 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98ae9d-50ae-49a3-a183-449467144206 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:13.055140 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7659cf-cae9-4733-b58b-f2c7db33ac2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:13.055768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7659cf-cae9-4733-b58b-f2c7db33ac2c admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:13.056437 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7659cf-cae9-4733-b58b-f2c7db33ac2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:13.056692 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7659cf-cae9-4733-b58b-f2c7db33ac2c admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:13.057383 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7659cf-cae9-4733-b58b-f2c7db33ac2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:13.059384 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7659cf-cae9-4733-b58b-f2c7db33ac2c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:13.085919 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1460/2909] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:26:12 2022] POST /identity/v3/users => generated 298 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:26:13.090963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b5543-6be3-48ad-a328-60e6026004ee admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:13.108975 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e8b5543-6be3-48ad-a328-60e6026004ee admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:13.118962 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674da33d-68f6-42e8-9fac-0ed0c4d3126d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:13.120181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674da33d-68f6-42e8-9fac-0ed0c4d3126d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:13.120783 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674da33d-68f6-42e8-9fac-0ed0c4d3126d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:13.121344 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674da33d-68f6-42e8-9fac-0ed0c4d3126d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:13.122645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674da33d-68f6-42e8-9fac-0ed0c4d3126d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:13.127717 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674da33d-68f6-42e8-9fac-0ed0c4d3126d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:13.151063 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1450/2910] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:26:13.157611 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7659cf-cae9-4733-b58b-f2c7db33ac2c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:13.186920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7659cf-cae9-4733-b58b-f2c7db33ac2c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:13.197731 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e365755-0f5d-4b13-ac81-0fd17a423806 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:13.200095 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e365755-0f5d-4b13-ac81-0fd17a423806 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:13.201317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e365755-0f5d-4b13-ac81-0fd17a423806 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:13.202037 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e365755-0f5d-4b13-ac81-0fd17a423806 admin admin] PATH_INFO: `/v3/projects/7fc3b9ad84c947f488717cb9b640a07d/users/6138ad7645fc4f7bb8935de91147bc2a/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:13.242527 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e365755-0f5d-4b13-ac81-0fd17a423806 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc3b9ad84c947f488717cb9b640a07d, user_id=6138ad7645fc4f7bb8935de91147bc2a, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:13.245949 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e365755-0f5d-4b13-ac81-0fd17a423806 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:13.269197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1461/2911] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:26:13 2022] PUT /identity/v3/projects/7fc3b9ad84c947f488717cb9b640a07d/users/6138ad7645fc4f7bb8935de91147bc2a/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:13.275067 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674da33d-68f6-42e8-9fac-0ed0c4d3126d admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:13.294490 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674da33d-68f6-42e8-9fac-0ed0c4d3126d admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:13.385035 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7707534-22b1-456b-b399-c412a7a0980d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:13.385686 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7707534-22b1-456b-b399-c412a7a0980d admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:13.386064 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7707534-22b1-456b-b399-c412a7a0980d admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:13.386305 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7707534-22b1-456b-b399-c412a7a0980d admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:13.386943 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7707534-22b1-456b-b399-c412a7a0980d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:13.388628 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7707534-22b1-456b-b399-c412a7a0980d admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:13.405990 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1451/2912] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 15 19:26:13.406718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e365755-0f5d-4b13-ac81-0fd17a423806 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:13.420485 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e365755-0f5d-4b13-ac81-0fd17a423806 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:13.426427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5017c-ce0a-463c-8db7-1bfbeddeefe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:13.427128 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5017c-ce0a-463c-8db7-1bfbeddeefe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:13.427515 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5017c-ce0a-463c-8db7-1bfbeddeefe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:13.427794 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf5017c-ce0a-463c-8db7-1bfbeddeefe0 admin admin] PATH_INFO: `/v3/projects/7fc3b9ad84c947f488717cb9b640a07d/users/6138ad7645fc4f7bb8935de91147bc2a/roles/8c827c3f69ef45bfa17c290bf2a29333` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:13.430264 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5017c-ce0a-463c-8db7-1bfbeddeefe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fc3b9ad84c947f488717cb9b640a07d, user_id=6138ad7645fc4f7bb8935de91147bc2a, role_id=8c827c3f69ef45bfa17c290bf2a29333)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:13.433064 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf5017c-ce0a-463c-8db7-1bfbeddeefe0 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:13.456746 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1462/2913] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:26:13 2022] PUT /identity/v3/projects/7fc3b9ad84c947f488717cb9b640a07d/users/6138ad7645fc4f7bb8935de91147bc2a/roles/8c827c3f69ef45bfa17c290bf2a29333 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:26:13.459716 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebc731-53e2-4a16-b9ae-8256dd380742 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:13.460194 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebc731-53e2-4a16-b9ae-8256dd380742 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:13.460662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ebc731-53e2-4a16-b9ae-8256dd380742 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:13.516001 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-92ebc731-53e2-4a16-b9ae-8256dd380742 None None] MFA Rules not processed for user `6138ad7645fc4f7bb8935de91147bc2a`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:13.519245 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-92ebc731-53e2-4a16-b9ae-8256dd380742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:13.646149 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:13.659240 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1452/2914] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:13.681635 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5017c-ce0a-463c-8db7-1bfbeddeefe0 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:13.683921 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-edf5017c-ce0a-463c-8db7-1bfbeddeefe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:13.805372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf5017c-ce0a-463c-8db7-1bfbeddeefe0 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:13.813185 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2308ec-4813-40d4-babd-5eea6e83b3dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:13.814603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2308ec-4813-40d4-babd-5eea6e83b3dc service cinder] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:13.815121 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2308ec-4813-40d4-babd-5eea6e83b3dc service cinder] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:13.815599 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2308ec-4813-40d4-babd-5eea6e83b3dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:13.856054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:13.947204 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2308ec-4813-40d4-babd-5eea6e83b3dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:13.952238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2308ec-4813-40d4-babd-5eea6e83b3dc service cinder] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:13.970458 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1463/2915] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:26:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:26:18.960151 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebc731-53e2-4a16-b9ae-8256dd380742 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:18.962973 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-92ebc731-53e2-4a16-b9ae-8256dd380742 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:18.981748 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ebc731-53e2-4a16-b9ae-8256dd380742 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:18.986005 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087f3b2e-aa3a-4df2-926e-2195ebb2c593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:18.986706 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f3b2e-aa3a-4df2-926e-2195ebb2c593 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:18.986963 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f3b2e-aa3a-4df2-926e-2195ebb2c593 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:18.987242 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087f3b2e-aa3a-4df2-926e-2195ebb2c593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:18.998764 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f3b2e-aa3a-4df2-926e-2195ebb2c593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:19.000403 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087f3b2e-aa3a-4df2-926e-2195ebb2c593 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:19.012607 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1453/2916] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:26:18 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:26:23.961520 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=19 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:24.219858 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2308ec-4813-40d4-babd-5eea6e83b3dc service cinder] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:24.336581 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2308ec-4813-40d4-babd-5eea6e83b3dc service cinder] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:24.342792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:24.343679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:24.344023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:24.344338 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] PATH_INFO: `/v3/users/9246f7852a014d0191a4932d492edfd0` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:24.346550 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9246f7852a014d0191a4932d492edfd0)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:24.348677 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:24.415778 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9246f7852a014d0191a4932d492edfd0'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:24.425353 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9246f7852a014d0191a4932d492edfd0'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:24.426171 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9246f7852a014d0191a4932d492edfd0'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:24.426920 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9246f7852a014d0191a4932d492edfd0'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:24.436411 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9246f7852a014d0191a4932d492edfd0'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:24.463176 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1464/2917] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:26:24 2022] DELETE /identity/v3/users/9246f7852a014d0191a4932d492edfd0 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:24.471226 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069ea49-65d6-4a2c-b1a1-a053f3c89f71 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:24.471894 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069ea49-65d6-4a2c-b1a1-a053f3c89f71 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:24.472311 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1069ea49-65d6-4a2c-b1a1-a053f3c89f71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:24.506912 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-1069ea49-65d6-4a2c-b1a1-a053f3c89f71 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:24.509426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1069ea49-65d6-4a2c-b1a1-a053f3c89f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:24.594998 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1454/2918] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:24.606575 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:24.608604 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:24.699784 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f631accc-a305-41d5-9cb8-869e6775c25c admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:24.706085 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8c6ad-e48f-40a3-90d6-21063a57cd7e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:24.706793 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8c6ad-e48f-40a3-90d6-21063a57cd7e service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:24.707115 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8c6ad-e48f-40a3-90d6-21063a57cd7e service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:24.707427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab8c6ad-e48f-40a3-90d6-21063a57cd7e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:24.719337 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8c6ad-e48f-40a3-90d6-21063a57cd7e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:24.720737 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab8c6ad-e48f-40a3-90d6-21063a57cd7e service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:24.732764 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1465/2919] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:26:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:26:25.082452 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069ea49-65d6-4a2c-b1a1-a053f3c89f71 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:25.084219 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-1069ea49-65d6-4a2c-b1a1-a053f3c89f71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:25.102496 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1069ea49-65d6-4a2c-b1a1-a053f3c89f71 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:25.109631 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:25.110359 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:25.110645 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:25.110919 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] PATH_INFO: `/v3/projects/c63ecc4de15348b7a77c67e5334e0663` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:25.112392 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c63ecc4de15348b7a77c67e5334e0663)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:25.114559 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:25.180413 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c63ecc4de15348b7a77c67e5334e0663', 'request_id': 'req-0f7400a3-9482-484c-acba-7a119658ffc0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:25.189687 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c63ecc4de15348b7a77c67e5334e0663', 'request_id': 'req-0f7400a3-9482-484c-acba-7a119658ffc0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:25.200719 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c63ecc4de15348b7a77c67e5334e0663', 'request_id': 'req-0f7400a3-9482-484c-acba-7a119658ffc0'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:25.223512 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] The token cache is being invalidate because project c63ecc4de15348b7a77c67e5334e0663 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:26:25.224246 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:25.225474 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:25.228466 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1455/2920] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:26:25 2022] DELETE /identity/v3/projects/c63ecc4de15348b7a77c67e5334e0663 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:25.238308 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8c6ad-e48f-40a3-90d6-21063a57cd7e service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:25.254593 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab8c6ad-e48f-40a3-90d6-21063a57cd7e service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:25.278027 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:25.341576 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517da534-bc76-40fa-9991-1f724f5a0c73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:25.342797 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517da534-bc76-40fa-9991-1f724f5a0c73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:25.343276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517da534-bc76-40fa-9991-1f724f5a0c73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:25.343755 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517da534-bc76-40fa-9991-1f724f5a0c73 admin admin] PATH_INFO: `/v3/users/6138ad7645fc4f7bb8935de91147bc2a` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:25.346017 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517da534-bc76-40fa-9991-1f724f5a0c73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6138ad7645fc4f7bb8935de91147bc2a)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:25.350236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517da534-bc76-40fa-9991-1f724f5a0c73 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:25.430317 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-517da534-bc76-40fa-9991-1f724f5a0c73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6138ad7645fc4f7bb8935de91147bc2a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:25.440499 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-517da534-bc76-40fa-9991-1f724f5a0c73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6138ad7645fc4f7bb8935de91147bc2a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:25.441244 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-517da534-bc76-40fa-9991-1f724f5a0c73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6138ad7645fc4f7bb8935de91147bc2a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:25.442091 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-517da534-bc76-40fa-9991-1f724f5a0c73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6138ad7645fc4f7bb8935de91147bc2a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:25.451277 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-517da534-bc76-40fa-9991-1f724f5a0c73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6138ad7645fc4f7bb8935de91147bc2a'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:25.474245 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1466/2921] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:26:25 2022] DELETE /identity/v3/users/6138ad7645fc4f7bb8935de91147bc2a => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:25.813942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:25.815446 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:25.833165 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7400a3-9482-484c-acba-7a119658ffc0 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:25.917324 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4441b5-876f-4031-a5ba-381b0d7b9f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:25.918030 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4441b5-876f-4031-a5ba-381b0d7b9f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:25.918316 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4441b5-876f-4031-a5ba-381b0d7b9f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:25.918592 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4441b5-876f-4031-a5ba-381b0d7b9f15 admin admin] PATH_INFO: `/v3/projects/7fc3b9ad84c947f488717cb9b640a07d` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:25.920066 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4441b5-876f-4031-a5ba-381b0d7b9f15 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fc3b9ad84c947f488717cb9b640a07d)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:25.923173 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea4441b5-876f-4031-a5ba-381b0d7b9f15 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:25.936632 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:25.989008 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ea4441b5-876f-4031-a5ba-381b0d7b9f15 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fc3b9ad84c947f488717cb9b640a07d', 'request_id': 'req-ea4441b5-876f-4031-a5ba-381b0d7b9f15'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:25.997153 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ea4441b5-876f-4031-a5ba-381b0d7b9f15 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fc3b9ad84c947f488717cb9b640a07d', 'request_id': 'req-ea4441b5-876f-4031-a5ba-381b0d7b9f15'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:26.010538 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ea4441b5-876f-4031-a5ba-381b0d7b9f15 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fc3b9ad84c947f488717cb9b640a07d', 'request_id': 'req-ea4441b5-876f-4031-a5ba-381b0d7b9f15'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:26.024323 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ea4441b5-876f-4031-a5ba-381b0d7b9f15 admin admin] The token cache is being invalidate because project 7fc3b9ad84c947f488717cb9b640a07d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:26:26.024619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ea4441b5-876f-4031-a5ba-381b0d7b9f15 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:26.025300 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-ea4441b5-876f-4031-a5ba-381b0d7b9f15 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:26.026900 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1456/2922] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:26:25 2022] DELETE /identity/v3/projects/7fc3b9ad84c947f488717cb9b640a07d => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:26.035698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2123fb-d67f-41e0-b2d5-6de1a560cc87 None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:26.036019 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2123fb-d67f-41e0-b2d5-6de1a560cc87 None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:26.036403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2123fb-d67f-41e0-b2d5-6de1a560cc87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:26.058587 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-6c2123fb-d67f-41e0-b2d5-6de1a560cc87 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:26.059768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-6c2123fb-d67f-41e0-b2d5-6de1a560cc87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:26.139359 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1467/2923] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:26.153371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3ba33-849e-4f36-8046-4fb0426dc567 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:26.153882 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3ba33-849e-4f36-8046-4fb0426dc567 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:26.154357 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b3ba33-849e-4f36-8046-4fb0426dc567 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:26.177959 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-54b3ba33-849e-4f36-8046-4fb0426dc567 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:26.179185 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-54b3ba33-849e-4f36-8046-4fb0426dc567 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:26.187971 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1457/2924] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:26.194040 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2123fb-d67f-41e0-b2d5-6de1a560cc87 None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:26.206104 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2123fb-d67f-41e0-b2d5-6de1a560cc87 None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:26.211517 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45bc09-f2d3-481d-91ef-27f5180845b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:26.212177 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45bc09-f2d3-481d-91ef-27f5180845b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:26.212502 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45bc09-f2d3-481d-91ef-27f5180845b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:26.212779 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef45bc09-f2d3-481d-91ef-27f5180845b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:26.213462 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45bc09-f2d3-481d-91ef-27f5180845b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81625) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 15 19:26:26.213768 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45bc09-f2d3-481d-91ef-27f5180845b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:26.215478 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef45bc09-f2d3-481d-91ef-27f5180845b6 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:26.229627 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1468/2925] 10.222.0.25 () {58 vars in 1153 bytes} [Thu Sep 15 19:26:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 15 19:26:26.237070 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3ba33-849e-4f36-8046-4fb0426dc567 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:26.247719 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b3ba33-849e-4f36-8046-4fb0426dc567 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:26.253550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a6c6b-f3e2-4203-87fd-84e2ed7fddab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:26.254398 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6c6b-f3e2-4203-87fd-84e2ed7fddab admin admin] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:26.254811 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6c6b-f3e2-4203-87fd-84e2ed7fddab admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:26.255198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9a6c6b-f3e2-4203-87fd-84e2ed7fddab admin admin] PATH_INFO: `/v3/projects` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:26.255983 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a6c6b-f3e2-4203-87fd-84e2ed7fddab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:26.258101 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9a6c6b-f3e2-4203-87fd-84e2ed7fddab admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:26.303664 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1458/2926] 10.222.0.25 () {60 vars in 1153 bytes} [Thu Sep 15 19:26:26 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:26:26.317123 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45bc09-f2d3-481d-91ef-27f5180845b6 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:26.331624 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef45bc09-f2d3-481d-91ef-27f5180845b6 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:26.368009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:26.408551 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a6641-4f74-4264-8272-b2425e66077f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:26.409191 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a6641-4f74-4264-8272-b2425e66077f admin admin] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:26.409481 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a6641-4f74-4264-8272-b2425e66077f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:26.409749 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407a6641-4f74-4264-8272-b2425e66077f admin admin] PATH_INFO: `/v3/users` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:26.410430 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a6641-4f74-4264-8272-b2425e66077f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:26.412427 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407a6641-4f74-4264-8272-b2425e66077f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:26.438698 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1469/2927] 10.222.0.25 () {60 vars in 1144 bytes} [Thu Sep 15 19:26:26 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 15 19:26:26.443306 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a6c6b-f3e2-4203-87fd-84e2ed7fddab admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:26.456148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9a6c6b-f3e2-4203-87fd-84e2ed7fddab admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:26.461531 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c7de9-c2a2-49fe-a950-36ca26ba2f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:26.462237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c7de9-c2a2-49fe-a950-36ca26ba2f60 admin admin] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:26.462585 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c7de9-c2a2-49fe-a950-36ca26ba2f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:26.462856 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428c7de9-c2a2-49fe-a950-36ca26ba2f60 admin admin] PATH_INFO: `/v3/roles` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:26.463527 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c7de9-c2a2-49fe-a950-36ca26ba2f60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:26.465192 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428c7de9-c2a2-49fe-a950-36ca26ba2f60 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:26.477426 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1459/2928] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:26:26.482701 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a6641-4f74-4264-8272-b2425e66077f admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:26.500988 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407a6641-4f74-4264-8272-b2425e66077f admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:26.509124 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1892a7ab-b4e3-45fd-8f90-ad781f04822f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:26.510223 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892a7ab-b4e3-45fd-8f90-ad781f04822f admin admin] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:26.510711 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892a7ab-b4e3-45fd-8f90-ad781f04822f admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:26.511256 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1892a7ab-b4e3-45fd-8f90-ad781f04822f admin admin] PATH_INFO: `/v3/roles` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:26.512414 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892a7ab-b4e3-45fd-8f90-ad781f04822f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:26.515802 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1892a7ab-b4e3-45fd-8f90-ad781f04822f admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:26.530613 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1470/2929] 10.222.0.25 () {58 vars in 1122 bytes} [Thu Sep 15 19:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 15 19:26:26.535457 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c7de9-c2a2-49fe-a950-36ca26ba2f60 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:26.547363 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428c7de9-c2a2-49fe-a950-36ca26ba2f60 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:26.553672 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa37c8-39b7-4111-88e6-3e673b9af932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:26.554400 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa37c8-39b7-4111-88e6-3e673b9af932 admin admin] REQUEST_METHOD: `PUT` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:26.554674 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa37c8-39b7-4111-88e6-3e673b9af932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:26.554957 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daa37c8-39b7-4111-88e6-3e673b9af932 admin admin] PATH_INFO: `/v3/projects/0d27f714f1f04c15919bc689f87b3c5f/users/2a0668c4edda459fa1cac475fb3eec8b/roles/1e24ea020d1a46989b4f460308a32229` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:26.575688 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa37c8-39b7-4111-88e6-3e673b9af932 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d27f714f1f04c15919bc689f87b3c5f, user_id=2a0668c4edda459fa1cac475fb3eec8b, role_id=1e24ea020d1a46989b4f460308a32229)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:26.579068 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6daa37c8-39b7-4111-88e6-3e673b9af932 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:26.597187 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1460/2930] 10.222.0.25 () {60 vars in 1483 bytes} [Thu Sep 15 19:26:26 2022] PUT /identity/v3/projects/0d27f714f1f04c15919bc689f87b3c5f/users/2a0668c4edda459fa1cac475fb3eec8b/roles/1e24ea020d1a46989b4f460308a32229 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:26:26.611818 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba230d-3bc3-4128-bc71-000ff921a5cc None None] REQUEST_METHOD: `POST` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:26.612238 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba230d-3bc3-4128-bc71-000ff921a5cc None None] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:26.612490 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ba230d-3bc3-4128-bc71-000ff921a5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:26.646913 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.auth.core [None req-f9ba230d-3bc3-4128-bc71-000ff921a5cc None None] MFA Rules not processed for user `2a0668c4edda459fa1cac475fb3eec8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81625) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:26.648709 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-f9ba230d-3bc3-4128-bc71-000ff921a5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:26.740355 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1471/2931] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:26.752754 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa37c8-39b7-4111-88e6-3e673b9af932 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:26.754993 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-6daa37c8-39b7-4111-88e6-3e673b9af932 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:26.826243 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daa37c8-39b7-4111-88e6-3e673b9af932 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:26.831370 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a6d30-449a-4f02-87ce-44dfe5b3cae8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '677623b8ea5042ffa0169be83a7205d4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:26.832020 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a6d30-449a-4f02-87ce-44dfe5b3cae8 service cinder] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:26.832295 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a6d30-449a-4f02-87ce-44dfe5b3cae8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:26.832567 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a6d30-449a-4f02-87ce-44dfe5b3cae8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:26.843146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a6d30-449a-4f02-87ce-44dfe5b3cae8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:26.844847 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a6d30-449a-4f02-87ce-44dfe5b3cae8 service cinder] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:26.855898 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1461/2932] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:26:26 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:26:32.773276 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba230d-3bc3-4128-bc71-000ff921a5cc None None] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:32.851745 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ba230d-3bc3-4128-bc71-000ff921a5cc None None] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:32.856792 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:32.857472 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:32.857883 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:32.858165 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] PATH_INFO: `/v3/users/2a0668c4edda459fa1cac475fb3eec8b` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:32.859501 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0668c4edda459fa1cac475fb3eec8b)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:32.861488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:32.918735 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:32.928255 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0668c4edda459fa1cac475fb3eec8b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:32.940133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0668c4edda459fa1cac475fb3eec8b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:32.941190 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0668c4edda459fa1cac475fb3eec8b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:32.942125 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0668c4edda459fa1cac475fb3eec8b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:32.952477 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0668c4edda459fa1cac475fb3eec8b'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:32.979236 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1472/2933] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:26:32 2022] DELETE /identity/v3/users/2a0668c4edda459fa1cac475fb3eec8b => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:32.987143 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e4858-179c-472d-9ee7-9550254d2091 None None] REQUEST_METHOD: `POST` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:32.987739 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e4858-179c-472d-9ee7-9550254d2091 None None] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:32.987739 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772e4858-179c-472d-9ee7-9550254d2091 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:33.009634 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.auth.core [None req-772e4858-179c-472d-9ee7-9550254d2091 None None] MFA Rules not processed for user `ec63c21fc22648d4ac6ebbc9ee1cd9d1`. Rule list: `[]` (Enabled: `True`). {{(pid=81626) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 15 19:26:33.011033 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-772e4858-179c-472d-9ee7-9550254d2091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:33.052198 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:33.098262 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1462/2934] 10.222.0.25 () {58 vars in 958 bytes} [Thu Sep 15 19:26:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 15 19:26:33.111129 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:33.112831 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:33.223635 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee9123b-b910-4be1-adb2-2bd609f446b5 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:33.227850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213f856-e0e9-48e3-892e-dd77f60abf3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:33.228500 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213f856-e0e9-48e3-892e-dd77f60abf3b service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:33.228778 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213f856-e0e9-48e3-892e-dd77f60abf3b service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:33.229049 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e213f856-e0e9-48e3-892e-dd77f60abf3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:33.240509 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213f856-e0e9-48e3-892e-dd77f60abf3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:33.242079 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e213f856-e0e9-48e3-892e-dd77f60abf3b service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:33.254886 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1473/2935] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:26:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 15 19:26:33.620230 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e4858-179c-472d-9ee7-9550254d2091 None None] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:26:33.622558 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-772e4858-179c-472d-9ee7-9550254d2091 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:26:33.647248 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772e4858-179c-472d-9ee7-9550254d2091 None None] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:26:33.654266 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:26:33.655303 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:26:33.655730 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:26:33.656181 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] PATH_INFO: `/v3/projects/0d27f714f1f04c15919bc689f87b3c5f` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:26:33.658422 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d27f714f1f04c15919bc689f87b3c5f)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:26:33.662812 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:26:33.733220 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d27f714f1f04c15919bc689f87b3c5f', 'request_id': 'req-f46ecc52-8da7-4b52-8f8c-733f482b4517'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:33.740640 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d27f714f1f04c15919bc689f87b3c5f', 'request_id': 'req-f46ecc52-8da7-4b52-8f8c-733f482b4517'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:33.751278 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d27f714f1f04c15919bc689f87b3c5f', 'request_id': 'req-f46ecc52-8da7-4b52-8f8c-733f482b4517'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:33.764108 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] The token cache is being invalidate because project 0d27f714f1f04c15919bc689f87b3c5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81626) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:26:33.764444 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:33.765396 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:26:33.767289 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1463/2936] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:26:33 2022] DELETE /identity/v3/projects/0d27f714f1f04c15919bc689f87b3c5f => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:26:43.249097 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:DELETE=5,keystone:SELECT=49,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:26:43.760424 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=37,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:27:18.625201 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213f856-e0e9-48e3-892e-dd77f60abf3b service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:27:18.626857 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-e213f856-e0e9-48e3-892e-dd77f60abf3b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:27:18.750706 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e213f856-e0e9-48e3-892e-dd77f60abf3b service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:27:18.836648 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b086a40-43a8-4057-b0a2-9672721a4ce0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d5f3ec00844cf28c01a14f8a071a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:27:18.837351 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b086a40-43a8-4057-b0a2-9672721a4ce0 service placement] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:27:18.837694 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b086a40-43a8-4057-b0a2-9672721a4ce0 service placement] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:27:18.838053 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b086a40-43a8-4057-b0a2-9672721a4ce0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:27:18.840133 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-0b086a40-43a8-4057-b0a2-9672721a4ce0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:27:18.853184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b086a40-43a8-4057-b0a2-9672721a4ce0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:27:18.855102 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b086a40-43a8-4057-b0a2-9672721a4ce0 service placement] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:27:18.868666 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1474/2937] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:27:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 244 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:27:28.863456 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=67 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:10.265141 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:28:10.267146 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:28:10.335283 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46ecc52-8da7-4b52-8f8c-733f482b4517 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:28:10.339629 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc7559-4d39-414d-afee-d0e25bf434d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:28:10.340253 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7559-4d39-414d-afee-d0e25bf434d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:28:10.340523 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7559-4d39-414d-afee-d0e25bf434d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:28:10.340788 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc7559-4d39-414d-afee-d0e25bf434d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:28:10.342719 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-c6cc7559-4d39-414d-afee-d0e25bf434d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:28:10.442349 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc7559-4d39-414d-afee-d0e25bf434d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:28:10.444005 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc7559-4d39-414d-afee-d0e25bf434d8 service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:28:10.473333 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1464/2938] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:28:10 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:28:14.080904 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b086a40-43a8-4057-b0a2-9672721a4ce0 service placement] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:28:14.091938 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b086a40-43a8-4057-b0a2-9672721a4ce0 service placement] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:28:14.095799 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297a372-2b1d-44da-8c31-532997488a85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:28:14.096436 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297a372-2b1d-44da-8c31-532997488a85 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:28:14.096708 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297a372-2b1d-44da-8c31-532997488a85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:28:14.096974 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4297a372-2b1d-44da-8c31-532997488a85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:28:14.098943 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-4297a372-2b1d-44da-8c31-532997488a85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:28:14.114612 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297a372-2b1d-44da-8c31-532997488a85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:28:14.116306 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4297a372-2b1d-44da-8c31-532997488a85 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:28:14.130203 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1475/2939] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:28:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:28:15.679513 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc7559-4d39-414d-afee-d0e25bf434d8 service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:28:15.690672 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc7559-4d39-414d-afee-d0e25bf434d8 service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:28:15.694682 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea114fb9-fe31-4e4a-998b-64bdc33dc4fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:28:15.695344 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea114fb9-fe31-4e4a-998b-64bdc33dc4fd service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:28:15.695619 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea114fb9-fe31-4e4a-998b-64bdc33dc4fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:28:15.695894 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea114fb9-fe31-4e4a-998b-64bdc33dc4fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:28:15.697718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-ea114fb9-fe31-4e4a-998b-64bdc33dc4fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:28:15.709058 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea114fb9-fe31-4e4a-998b-64bdc33dc4fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:28:15.710583 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea114fb9-fe31-4e4a-998b-64bdc33dc4fd service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:28:15.721340 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1465/2940] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:28:15 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:28:15.854077 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297a372-2b1d-44da-8c31-532997488a85 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:28:15.865718 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4297a372-2b1d-44da-8c31-532997488a85 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:28:15.870403 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40074b16-e5d0-44ab-9222-72a3ac37c529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:28:15.871197 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40074b16-e5d0-44ab-9222-72a3ac37c529 service neutron] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:28:15.871645 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40074b16-e5d0-44ab-9222-72a3ac37c529 service neutron] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:28:15.872332 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40074b16-e5d0-44ab-9222-72a3ac37c529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:28:15.874478 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-40074b16-e5d0-44ab-9222-72a3ac37c529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:28:15.897603 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40074b16-e5d0-44ab-9222-72a3ac37c529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:28:15.900488 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40074b16-e5d0-44ab-9222-72a3ac37c529 service neutron] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:28:15.923042 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1476/2941] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:28:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:28:25.716080 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=72 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:28:25.912812 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=12 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:20.966897 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea114fb9-fe31-4e4a-998b-64bdc33dc4fd service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:29:20.977666 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea114fb9-fe31-4e4a-998b-64bdc33dc4fd service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:29:20.982820 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9b933-41b7-4a45-a1a2-31e53008830d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4591e01ab4954b22a81f6b09cdb2d544', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:29:20.983462 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9b933-41b7-4a45-a1a2-31e53008830d service neutron] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:29:20.983735 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9b933-41b7-4a45-a1a2-31e53008830d service neutron] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:29:20.983997 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad9b933-41b7-4a45-a1a2-31e53008830d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:29:20.986172 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cad9b933-41b7-4a45-a1a2-31e53008830d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:29:20.998341 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9b933-41b7-4a45-a1a2-31e53008830d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:29:20.999881 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad9b933-41b7-4a45-a1a2-31e53008830d service neutron] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:29:21.009590 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1466/2942] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:29:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:29:31.005404 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=6 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:36.602523 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40074b16-e5d0-44ab-9222-72a3ac37c529 service neutron] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:29:36.605010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-40074b16-e5d0-44ab-9222-72a3ac37c529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:29:36.628184 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40074b16-e5d0-44ab-9222-72a3ac37c529 service neutron] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:29:36.639023 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837220f-76ad-4567-bcaf-037e093d8742 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '38b19e4add2a4321a2fbfeb9a3a1b61d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'admin', 'member', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:29:36.640024 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837220f-76ad-4567-bcaf-037e093d8742 service nova] REQUEST_METHOD: `GET` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:29:36.640510 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837220f-76ad-4567-bcaf-037e093d8742 service nova] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:29:36.641010 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b837220f-76ad-4567-bcaf-037e093d8742 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:29:36.644195 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-b837220f-76ad-4567-bcaf-037e093d8742 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:29:36.666128 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837220f-76ad-4567-bcaf-037e093d8742 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:29:36.667822 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b837220f-76ad-4567-bcaf-037e093d8742 service nova] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:29:36.681275 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1477/2943] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:29:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:29:46.675518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=6 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:47.014495 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9b933-41b7-4a45-a1a2-31e53008830d service neutron] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:29:47.016408 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-cad9b933-41b7-4a45-a1a2-31e53008830d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:29:47.102650 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad9b933-41b7-4a45-a1a2-31e53008830d service neutron] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:29:47.108692 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:29:47.109362 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:29:47.109638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:29:47.109948 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] PATH_INFO: `/v3/users/1373e87c5152416081b7bc8591e49fe3` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:29:47.111188 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1373e87c5152416081b7bc8591e49fe3)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:29:47.113133 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:29:47.175395 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1373e87c5152416081b7bc8591e49fe3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.185892 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1373e87c5152416081b7bc8591e49fe3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.186935 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1373e87c5152416081b7bc8591e49fe3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.187942 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1373e87c5152416081b7bc8591e49fe3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.198187 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1373e87c5152416081b7bc8591e49fe3'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.225988 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1467/2944] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:29:47 2022] DELETE /identity/v3/users/1373e87c5152416081b7bc8591e49fe3 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:29:47.467744 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837220f-76ad-4567-bcaf-037e093d8742 service nova] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:29:47.487220 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b837220f-76ad-4567-bcaf-037e093d8742 service nova] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:29:47.586385 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:29:47.587054 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:29:47.587334 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:29:47.587599 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] PATH_INFO: `/v3/projects/260bf22894894975a89eaed3bf7dfd3c` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:29:47.588896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=260bf22894894975a89eaed3bf7dfd3c)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:29:47.591296 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:29:47.653378 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '260bf22894894975a89eaed3bf7dfd3c', 'request_id': 'req-06835581-3452-450b-b5cf-c86111e6b1c3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.661148 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '260bf22894894975a89eaed3bf7dfd3c', 'request_id': 'req-06835581-3452-450b-b5cf-c86111e6b1c3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.671850 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '260bf22894894975a89eaed3bf7dfd3c', 'request_id': 'req-06835581-3452-450b-b5cf-c86111e6b1c3'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.685896 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] The token cache is being invalidate because project 260bf22894894975a89eaed3bf7dfd3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:29:47.686996 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.687383 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.689267 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1478/2945] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:29:47 2022] DELETE /identity/v3/projects/260bf22894894975a89eaed3bf7dfd3c => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:29:47.693801 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:29:47.695447 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:29:47.711364 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919a83ff-2013-4c95-ae96-2b5588dd4c61 admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:29:47.779569 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:29:47.780240 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] REQUEST_METHOD: `DELETE` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:29:47.780522 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:29:47.780793 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] PATH_INFO: `/v3/users/982b10d1169741eb9bc590d031ccc11b` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:29:47.782148 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] RBAC: Authorizing `identity:delete_user(user_id=982b10d1169741eb9bc590d031ccc11b)` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:29:47.784126 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:29:47.813902 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:47.848718 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '982b10d1169741eb9bc590d031ccc11b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.860634 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '982b10d1169741eb9bc590d031ccc11b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.861638 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '982b10d1169741eb9bc590d031ccc11b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.862677 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '982b10d1169741eb9bc590d031ccc11b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.876550 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.notifications [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '982b10d1169741eb9bc590d031ccc11b'} {{(pid=81626) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:47.912047 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1468/2946] 10.222.0.25 () {58 vars in 1224 bytes} [Thu Sep 15 19:29:47 2022] DELETE /identity/v3/users/982b10d1169741eb9bc590d031ccc11b => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 15 19:29:48.170756 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] Authenticating user token {{(pid=81625) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:29:48.173262 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.fernet_utils [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81625) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:29:48.194600 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06835581-3452-450b-b5cf-c86111e6b1c3 admin admin] Validating token access rules against request {{(pid=81625) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:29:48.272009 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ec63c21fc22648d4ac6ebbc9ee1cd9d1', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '0bc762c67fb94d798d853612955d1b04', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81625) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:29:48.272679 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:29:48.272961 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058 admin admin] SCRIPT_NAME: `/identity` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:29:48.273286 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058 admin admin] PATH_INFO: `/v3/projects/e88d9769c2d84465ada503b1da248d99` {{(pid=81625) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:29:48.274518 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e88d9769c2d84465ada503b1da248d99)` {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:29:48.276573 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058 admin admin] RBAC: Authorization granted {{(pid=81625) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:29:48.321942 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:48.341372 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e88d9769c2d84465ada503b1da248d99', 'request_id': 'req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:48.348993 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e88d9769c2d84465ada503b1da248d99', 'request_id': 'req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:48.359813 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e88d9769c2d84465ada503b1da248d99', 'request_id': 'req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058'} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:48.372231 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058 admin admin] The token cache is being invalidate because project e88d9769c2d84465ada503b1da248d99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81625) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 15 19:29:48.372519 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:48.373221 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG keystone.notifications [None req-733e32b0-1a21-43f8-a6aa-b0ad13a4c058 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81625) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 15 19:29:48.374830 dv-cinder-849846-10-smb devstack@keystone.service[81625]: [pid: 81625|app: 0|req: 1479/2947] 10.222.0.25 () {58 vars in 1233 bytes} [Thu Sep 15 19:29:48 2022] DELETE /identity/v3/projects/e88d9769c2d84465ada503b1da248d99 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 15 19:29:57.904546 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:29:58.368572 dv-cinder-849846-10-smb devstack@keystone.service[81625]: DEBUG dbcounter [-] [81625] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81625) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 15 19:32:25.611142 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] Authenticating user token {{(pid=81626) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 15 19:32:25.612934 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:32:25.719276 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0587efe-dfb5-4ed6-b9ed-e6c09c52d8df admin admin] Validating token access rules against request {{(pid=81626) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 15 19:32:25.797662 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2a40a-fe05-45d4-8ee8-11ec65bc88c8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '35d5f3ec00844cf28c01a14f8a071a69', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2958a115e7974fc4b5c74a633fc4322c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81626) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 15 19:32:25.798371 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a40a-fe05-45d4-8ee8-11ec65bc88c8 service placement] REQUEST_METHOD: `GET` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 15 19:32:25.798661 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a40a-fe05-45d4-8ee8-11ec65bc88c8 service placement] SCRIPT_NAME: `/identity` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 15 19:32:25.798930 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2a40a-fe05-45d4-8ee8-11ec65bc88c8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81626) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 15 19:32:25.800985 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.fernet_utils [None req-caa2a40a-fe05-45d4-8ee8-11ec65bc88c8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81626) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 15 19:32:25.815414 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2a40a-fe05-45d4-8ee8-11ec65bc88c8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 15 19:32:25.817068 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2a40a-fe05-45d4-8ee8-11ec65bc88c8 service placement] RBAC: Authorization granted {{(pid=81626) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 15 19:32:25.829237 dv-cinder-849846-10-smb devstack@keystone.service[81626]: [pid: 81626|app: 0|req: 1469/2948] 10.222.0.25 () {60 vars in 1365 bytes} [Thu Sep 15 19:32:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 15 19:32:35.823582 dv-cinder-849846-10-smb devstack@keystone.service[81626]: DEBUG dbcounter [-] [81626] Writing DB stats keystone:SELECT=58 {{(pid=81626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}